-- Logs begin at Thu 2022-09-01 04:29:51 UTC, end at Thu 2022-09-01 06:06:36 UTC. -- Sep 01 05:05:54.516899 dv-cinder-853910-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 05:05:54.524318 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 05:05:54 2022] *** Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: nodename: dv-cinder-853910-6-iscsi Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: machine: x86_64 Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: clock source: unix Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: pcre jit disabled Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: detected number of CPU cores: 4 Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: current working directory: / Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: detected binary path: /usr/bin/uwsgi-core Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: your processes number limit is 47680 Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: your memory page size is 4096 bytes Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: detected max file descriptor number: 2048 Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: lock engine: pthread robust mutexes Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: thunder lock: enabled Sep 01 05:05:54.527811 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 05:05:54.528703 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 05:05:54.567360 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: Python main interpreter initialized at 0x564e2515a9c0 Sep 01 05:05:54.567360 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: python threads support enabled Sep 01 05:05:54.567360 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: your server socket listen backlog is limited to 100 connections Sep 01 05:05:54.567360 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: your mercy for graceful operations on workers is 90 seconds Sep 01 05:05:54.567733 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 05:05:54.567813 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: *** Operational MODE: preforking *** Sep 01 05:05:54.568020 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: *** uWSGI is running in multiple interpreter mode *** Sep 01 05:05:54.568020 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: spawned uWSGI master process (pid: 105676) Sep 01 05:05:54.568216 dv-cinder-853910-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 05:05:54.569613 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: spawned uWSGI worker 1 (pid: 105677, cores: 1) Sep 01 05:05:54.569613 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: spawned uWSGI worker 2 (pid: 105678, cores: 1) Sep 01 05:05:54.569613 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 05:05:55.225283 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 05:05:55.225873 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 05:05:56.305523 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:05:56.305523 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: from cryptography.utils import int_from_bytes Sep 01 05:05:56.306264 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:05:56.306264 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: from cryptography.utils import int_from_bytes Sep 01 05:05:56.308621 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:05:56.308621 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: from cryptography.utils import int_from_bytes Sep 01 05:05:56.309078 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:05:56.309078 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: from cryptography.utils import int_from_bytes Sep 01 05:05:58.781728 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:05:58.782298 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:05:58.782488 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:05:58.782843 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:05:58.783094 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:05:58.783478 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.783799 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.784115 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.784430 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.784695 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:05:58.785105 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.785192 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:05:58.785289 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.785380 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.785508 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:05:58.785681 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.785873 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:05:58.786002 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.786131 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:05:58.786292 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.786521 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.786611 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.786853 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.786958 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-6-iscsi {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.787173 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.787266 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.787473 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.787560 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.787777 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.787872 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.788089 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.788183 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.788388 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.788480 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.788703 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.788806 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.789042 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.789128 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.789308 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.789534 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.789651 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.790665 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-6-iscsi {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.790760 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.790831 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.790907 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.790992 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.791060 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.791131 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.791198 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.791268 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.791334 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.791433 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.791556 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.791759 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.791862 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.792051 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.792147 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.792371 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.792549 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.792660 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.792885 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.793076 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-6-iscsi {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.793174 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.793387 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.793484 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.793693 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.793802 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.794000 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.794176 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.794399 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.794516 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.794709 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.794807 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.795019 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.795116 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.795332 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.796041 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.796196 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.796315 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.796503 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.796646 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-6-iscsi {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.796930 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.797065 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.797158 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.797249 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.797450 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.797551 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.797765 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.797918 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.798063 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.798234 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.798371 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.798551 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.798677 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.798875 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.799008 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.799209 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.799313 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.799517 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.799604 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.799805 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.799891 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.800111 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.800208 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.800426 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.800512 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.800739 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.800856 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.801075 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.801171 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.801324 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.801413 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.801570 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.801666 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.801881 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.801975 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.802194 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.802282 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.802499 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.802937 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.803054 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.803142 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.803358 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.803455 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.803679 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.803823 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.803966 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.804053 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.804268 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.804355 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.804524 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.804624 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.804811 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.804904 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.805122 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.805228 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.805442 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.805532 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.805751 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.805839 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.806061 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.806146 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.806370 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.806466 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.806683 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.806782 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.806990 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.807076 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.807297 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.807395 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.807603 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.807689 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.807912 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.808012 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.808217 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.808309 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.808530 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.808618 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.808872 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.808982 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.809183 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.809277 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.809483 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.809570 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.809787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.809886 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.810102 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.810189 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.810415 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.810506 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.810712 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.810853 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.810959 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.811091 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.811402 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.811530 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.811701 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.811791 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.812026 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.812122 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.812341 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.812441 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.812648 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.812737 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.812986 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.813073 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.813289 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.813376 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.813597 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.813683 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.813902 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.813996 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.814168 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.814253 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.814471 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.814566 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.814781 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.814868 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.815077 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.815270 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.815368 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.815450 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.815666 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.815762 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.815965 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.816070 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.816274 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.816371 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.816583 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.816687 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.816912 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.817020 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.817217 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.817311 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.817519 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.817616 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.817824 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.817920 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.818129 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.818228 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.818428 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.818513 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.818729 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.818832 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.819033 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.819125 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.819340 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.819426 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.819639 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.819735 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.819951 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.820038 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.820258 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.820367 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.820609 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.820705 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.820947 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.821037 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.821272 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.821357 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.821583 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.821680 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.821894 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.821994 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.822203 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.822290 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.822506 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.822601 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.822803 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.822889 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.823102 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.823196 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.823401 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.823488 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.823700 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.823787 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.823995 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.824087 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.824292 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.824381 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.824586 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.824672 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.824916 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.825018 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.825233 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.825387 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.825537 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.825624 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.825838 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.825924 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.826135 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.826228 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.826439 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.826524 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.826804 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.826940 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.827112 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.827248 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.827418 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.827509 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.827720 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.827816 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.828036 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.828130 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.828362 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.828450 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.828673 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.828768 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.829011 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.829096 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.829318 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.829404 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.829635 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.829731 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:58.829942 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.830029 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.830249 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.830343 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.830554 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.830642 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.830870 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.830994 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.831186 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.831275 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.831508 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.831595 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.831819 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.831905 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.832131 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.832216 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.832447 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.832534 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.832752 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.832925 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.833093 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.833182 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.833410 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.833504 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.833725 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.833819 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.834028 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.834114 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.834356 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.834443 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.834686 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.834782 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.834993 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.835088 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.835310 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.835402 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.835623 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.835722 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.835929 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.836033 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.836236 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.836323 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.836542 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.836636 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.836885 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.836989 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.837227 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.837366 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.837576 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.837710 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.837910 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.838050 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.838224 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.838361 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.838547 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.838636 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.838863 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.838960 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.839171 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.839259 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.839481 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.839567 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.839791 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.839885 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.840098 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.840184 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.840430 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.840520 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.840743 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.840901 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.841093 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.841211 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.841404 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.841531 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.841715 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.841858 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.842028 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.842180 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.842871 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.843012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.843157 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.843316 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.843487 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.843627 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.843931 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.844028 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.844237 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.844323 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.844539 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.844634 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.844870 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.844981 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.845174 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.845261 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.845491 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.845578 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.845813 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.845918 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.846115 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.846201 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.846428 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.846513 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.846731 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.846825 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.847035 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.847120 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.847339 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.847427 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.847642 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.847735 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.847941 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.848034 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.848243 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.848329 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.848547 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.848633 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.848873 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.848961 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.849194 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.849282 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.849504 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.849592 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.849808 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.849894 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.850117 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.850202 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.850416 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.850502 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.850718 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.850805 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.851022 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.851116 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.851326 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.851412 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.851634 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.851730 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.851939 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.852038 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.852244 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.852340 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.852559 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.852646 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.852894 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.853067 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.853204 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.853290 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.853517 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.853614 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.853832 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.853932 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.854137 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.854231 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.854447 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.854542 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.854761 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.854857 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.855069 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.855154 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.855367 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.855462 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.855672 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.855760 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.855972 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.856070 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.856273 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.856367 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.856573 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.856660 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.856901 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.856990 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.857203 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.857291 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.857504 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.857599 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.857804 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.857930 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.858724 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.858852 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.859031 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.859246 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.859332 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.859576 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.859663 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.859890 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.859978 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.860197 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.860291 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.860500 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.860587 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.860825 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.860929 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.861134 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.861228 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.861439 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.861537 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.861744 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.861838 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.862048 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.862136 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.862368 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.862472 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.862676 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.862770 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.862985 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.863085 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.863287 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.863392 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.863590 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.863678 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.863899 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.863984 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.864209 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.864304 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.864522 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.864612 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.864867 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.864959 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.865178 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.865279 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.865497 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.865584 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.865803 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.865889 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.866120 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.866215 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.866426 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.866512 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.866739 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.866824 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.867037 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.867124 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.867350 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.867480 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.867672 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.867766 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.867992 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.868113 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.868303 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.868405 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.868612 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.868708 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.868940 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.869046 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.869251 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.869342 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.869555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.869644 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.869865 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.869953 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.870169 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.870256 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.870475 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.870592 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.870792 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.870890 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.871098 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.871186 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.871411 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.871509 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.871715 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.871806 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.872029 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.872118 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.872333 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.872430 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.872646 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.872740 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.872965 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.873053 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.873272 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.873377 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.873695 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.873844 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.874008 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.874099 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.874311 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.874408 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.874622 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.874720 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.874938 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.875026 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.875244 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.875333 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.875548 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.875636 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.875853 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.875941 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.876155 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.876243 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.876456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.876552 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.876761 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.876871 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.877092 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.877182 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.877397 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.877506 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.877705 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.877807 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.878002 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.878100 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.878308 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.878406 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.878612 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.878709 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.878910 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.878997 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.879207 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.879294 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.879515 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.879612 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.879831 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.879918 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.880136 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.880222 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.880444 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.880540 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.880750 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.880876 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.881072 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.881159 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.881371 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.881469 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.881679 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.881766 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.881979 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.882067 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.882281 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.882380 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.882579 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.882671 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.882877 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.882974 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.883205 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.883301 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.883519 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.883608 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.883807 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.883896 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.884115 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.884204 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.884425 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.884520 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.884728 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.884858 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.885060 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.885158 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.885362 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.885458 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.885662 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.885763 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.885976 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.886064 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.886282 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.886379 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.886584 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.886689 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.886890 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.886978 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.887197 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.887288 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.887504 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.887600 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.887809 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.887909 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.888117 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.888224 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.888418 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.888515 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.888723 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.888855 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.889057 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.889225 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.889440 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.889568 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.889759 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.890026 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.890120 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.890347 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.890624 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.890727 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.890990 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.891075 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.891253 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.891390 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.891578 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.891859 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.891952 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.892228 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.892323 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.892503 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.892656 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.892851 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.893013 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.893159 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.893303 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.893458 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.893692 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.893870 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.894025 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.894656 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.894794 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.894879 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.894879 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.895042 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.895130 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.895211 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.895290 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.895377 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.895496 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.895596 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.895797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.895927 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.896102 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.896248 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.896401 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.896559 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.896700 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.896898 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.897026 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.897209 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.897326 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.897518 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.897635 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.897831 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.897963 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.898144 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.898286 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.898453 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.898604 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.898753 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.898892 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.899036 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.899181 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.899335 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.899482 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.899618 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.899769 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.899915 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.900060 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.900218 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.900356 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.900533 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.900671 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.900862 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.901029 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.901179 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.901277 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.901486 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.901575 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.901809 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.901907 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.902114 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.902209 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.902419 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.902506 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.902722 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.902810 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.903022 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.903111 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.903321 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.903418 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.903626 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.903714 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.903929 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.904017 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.904226 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.904324 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.904534 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.904622 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.905389 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.905543 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.905688 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.905862 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.906002 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.906192 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.906325 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.906502 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.906648 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.906862 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.906998 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.907135 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.907268 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.907401 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.907543 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.907691 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.907825 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.907982 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.908114 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.908327 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.908478 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.908613 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.908746 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.908899 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.908985 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.909165 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.909270 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.909469 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.909558 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.909778 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.909866 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.910077 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.910172 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.910373 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.910461 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.910669 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.910756 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.910973 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.911116 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.911277 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.911365 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.911575 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.911662 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.911881 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.911976 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.912186 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.912275 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.912483 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.912568 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.912810 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.912902 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.913102 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.913189 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.913401 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.913488 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.913702 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.913832 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.914002 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.914126 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.914345 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.914485 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.914619 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.914731 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.914917 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.915031 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.915221 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.915346 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.915522 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.915637 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.915819 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.915934 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.916116 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.916241 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.916419 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.916534 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.918787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.918906 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.918993 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.919097 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.919183 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.919263 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.919342 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.919423 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.919513 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.919595 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.919675 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.919762 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.919847 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.919927 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.920015 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.920097 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.920184 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.920272 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.920354 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.920541 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.920642 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.920725 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.920811 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.920882 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.920882 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.921000 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.921000 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.921166 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.921379 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.921468 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.921549 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.921639 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.921721 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.921807 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.921887 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.921966 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.922112 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.922233 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.922410 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.922539 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.922722 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.922846 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.923030 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.923192 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.923339 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.923501 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.923638 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.923870 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.923993 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.924178 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.924281 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.924495 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.924594 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.924837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.924940 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.925154 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.925246 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.925467 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.925556 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.925782 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.925880 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.926081 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.926169 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.926386 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.926476 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.926693 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.926791 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.926997 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.927090 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.927299 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.927386 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.927852 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.927955 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.928166 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.928308 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.928476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.928574 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.928794 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.928899 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.929113 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.929201 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.929427 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.929514 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.929727 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.929816 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.930030 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.930117 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.930332 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.930420 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.930631 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.930720 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.930941 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.931027 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.931243 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.931337 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.931541 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.931637 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.931843 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.931931 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.932145 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.932234 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.932452 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.932540 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.932753 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.932863 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.933090 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.933189 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.933400 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.933488 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.933715 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.933804 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.934026 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.934133 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.934333 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.934428 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.934659 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.934746 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.934969 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.935135 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.935276 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.935371 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.935574 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.935661 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.935880 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.935976 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.936733 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.937126 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.937217 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.937345 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.937481 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.937730 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.937826 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.938037 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.938131 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.938338 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.938438 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.938649 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.938743 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.938970 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.939059 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.939271 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.939371 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.939574 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.939663 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.939881 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.939969 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.940197 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.940292 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.940497 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.940591 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.940832 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.940925 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.941223 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.941319 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.941530 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.941663 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.941828 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.941915 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.942138 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.942225 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.942462 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.942549 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.942768 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.942851 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.943074 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.943175 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.943378 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.943473 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.943698 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.943793 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.944008 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.944130 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.944318 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.944418 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.944624 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.944734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.944967 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.945076 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.945288 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.945386 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.945596 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.945755 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.945908 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.946087 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.946210 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.946366 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.946528 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.946690 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.946843 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.947015 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.947152 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.947337 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.947469 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.947645 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.947877 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.947974 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.948194 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.948281 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.948504 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.948591 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.948845 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.948954 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.949167 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.949255 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.949468 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.949557 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.949774 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.949863 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.950081 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.950169 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.950382 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.950468 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.950684 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.950773 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.951000 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.951088 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.951299 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.951425 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.951609 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.952368 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.952625 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.952714 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.952961 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.953181 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.953284 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.953515 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.953603 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.953825 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.953913 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.954134 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.954230 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.954451 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.954539 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.954759 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.954859 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.955072 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.955168 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.955377 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.955464 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.955677 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.955764 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.955993 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.956080 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.956296 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.956383 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.956598 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.956685 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.956919 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.957021 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.957222 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.957357 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.957544 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.957640 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.957848 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.957934 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.958163 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.958251 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.958476 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.958607 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.958797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.958926 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.959103 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.959198 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.959406 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.959502 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.959730 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.959817 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.960041 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.960142 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.960350 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.960447 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.960656 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.960744 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.960977 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.961064 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.961277 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.961367 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.961584 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.961671 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.961889 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.961988 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.962188 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.962278 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.962486 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.962574 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.962790 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.962880 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.963086 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.963182 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.963383 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.963470 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.963680 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.963795 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.963995 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.964099 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.964294 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.964432 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.964608 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.964739 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.964935 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.965070 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.965236 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.965383 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.965534 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.965691 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.965832 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.965999 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.966168 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.966305 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.966470 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.966613 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.966795 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.966916 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.967099 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.967221 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.967463 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.967618 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.967809 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.967944 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.968251 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.968346 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.968574 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.968706 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.968913 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.969046 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.969222 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.969310 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.969531 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.969621 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.969836 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.969923 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.970138 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.970232 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.970458 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.970554 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.970773 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.970861 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.971084 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.971180 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.971407 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.971612 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.971730 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.971946 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.972068 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.972255 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.972369 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.972564 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.972665 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.972896 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.972998 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.973209 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.973302 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.973520 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.973609 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.973828 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.973918 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.974134 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.974226 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.974440 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.974539 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.974746 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.974845 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.975072 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.975318 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.975408 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.975651 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.975749 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.975967 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.976060 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.976281 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.976380 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.976595 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.976693 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.976927 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.977019 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.977238 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.977338 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.977561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.977681 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.977873 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.977964 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.978176 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.978264 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.978483 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.978586 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.978795 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.978896 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.979104 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.979204 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.979411 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.979510 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.979719 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.979809 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.980029 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.980119 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.980343 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.980433 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.980648 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.980746 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.980977 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.981076 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.981286 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.981386 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.981594 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.981697 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.981913 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.982014 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.982231 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.982336 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.982545 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.982634 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.982855 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.983154 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.983308 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.983460 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.983626 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.983774 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.983864 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.984105 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.984195 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.984423 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.984520 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.984736 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.984863 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.985090 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.985179 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.985407 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.985496 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.985734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.985833 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.986044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.986138 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.986365 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.986454 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.986667 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.986764 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.986968 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.987056 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.987272 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.987360 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.987647 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.987797 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.987889 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.988119 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.988216 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.988457 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.988556 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.988757 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.988933 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.989093 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.989246 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.989398 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.989496 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.989741 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.989922 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.990074 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.990266 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.990385 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.990581 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.990694 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.990901 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.990991 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.991220 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.991310 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.991533 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.991622 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.991835 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.991934 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.992151 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.992288 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.992452 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.992542 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.992752 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.992887 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.993084 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.993183 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.993390 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.993653 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.993742 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.993977 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.994072 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.994298 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.994397 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.994588 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.994677 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.994887 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.994985 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.995191 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.995288 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.995491 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.995580 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.995814 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.995916 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.996115 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.996204 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.996415 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.996506 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.996714 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.996866 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.997046 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.997143 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.997349 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.997438 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.997647 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.997803 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.997947 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.998045 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.998246 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.998344 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.999069 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.999179 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.999377 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.999551 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.999708 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.999828 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:58.999994 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.000087 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.000301 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.000390 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.000608 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.000699 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.000956 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.001057 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.001276 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.001366 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.001585 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.001675 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.001891 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.002024 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.002196 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.002317 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.002491 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.002611 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.002789 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.002881 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.003091 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.003179 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.003398 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.003493 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.003701 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.003802 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.004016 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.004105 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.004320 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.004417 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.004631 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.004875 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.005018 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.005204 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.005331 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.005504 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.005638 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.005832 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.005945 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.006156 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.006245 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.006459 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.006550 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.006760 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.006859 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.007061 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.007158 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.007379 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.007475 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.007683 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.007797 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.007989 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.008110 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.008293 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.008600 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.008688 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.008939 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.009076 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.009232 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.009324 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.009535 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.009624 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.009837 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.009935 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.010141 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.010230 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.010443 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.010545 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.010749 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.010848 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.011052 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.011147 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.011356 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.011444 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.011658 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.011759 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.011967 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.012056 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.012300 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.012390 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.012607 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.012698 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.012942 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.013035 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.013255 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.013344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.013565 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.013657 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.013867 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.013955 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.014777 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.014911 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.015060 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.015205 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.015359 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.015509 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.015796 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.015886 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.016123 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.016215 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.016433 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.016529 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.016737 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.016871 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.017133 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.017221 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.017455 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.017551 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.017774 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.017870 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.018094 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.018184 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.018398 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.018486 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.018708 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.018805 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.019019 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.019116 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.019329 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.019416 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.019646 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.019734 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.019950 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.020037 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.020275 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.020363 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.020581 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.020669 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.020947 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.021050 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.021269 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.021358 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.021572 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.021663 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.021872 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.021961 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.022173 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.022270 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.022480 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.022617 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.022793 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.022883 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.023098 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.023195 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.023400 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.023488 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.023699 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.023787 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.024005 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.024102 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.024307 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.024395 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.024608 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.024697 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.024929 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.025045 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.025230 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.025353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.025534 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.025659 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.025832 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.025966 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.026130 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.026276 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.026428 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.026596 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.026726 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.026905 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.027025 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.027209 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.027322 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.027512 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.027609 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.027822 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.027910 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.028129 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.028217 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.028434 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.028524 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.028739 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.028860 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.029078 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.029168 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.029387 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.029529 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.029691 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.029781 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.030094 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.030258 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.030402 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.030491 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.030708 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.030798 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.031024 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.031112 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.031333 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.031455 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.031650 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.031794 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.031965 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.032075 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.032268 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.032372 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.032571 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.032681 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.032901 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.033016 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.033207 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.033296 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.033516 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.033602 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.033826 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.033923 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.034132 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.034221 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.034438 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.034525 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.034744 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.034930 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.035067 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.035155 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.035374 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.035469 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.035674 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.035769 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.035993 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.036081 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.036303 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.036391 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.036615 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.036710 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.036946 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.037093 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.037257 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.037357 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.037583 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.037672 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.037892 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.037979 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.038204 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.038317 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.038504 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.038605 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.038814 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.038917 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.039118 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.039222 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.039432 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.039533 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.039750 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.039847 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.040050 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.040162 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.040363 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.040450 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.040679 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.040766 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.041023 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.041111 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.041340 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.041438 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.041642 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.041729 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.041961 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.042050 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.042275 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.042363 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.042585 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.042680 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.042900 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.043005 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.043213 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.043302 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.043534 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.043631 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.043842 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.043929 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.044151 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.044252 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.044452 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.044549 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.044692 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:05:59.044803 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.045128 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.045500 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.045814 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.046143 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.046471 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.046819 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.047136 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.047481 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.047812 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.048129 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.048448 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.048753 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:59.049022 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:05:59.198841 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO dbcounter [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Registered counter for database nova_api Sep 01 05:05:59.204230 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO dbcounter [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Registered counter for database nova_api Sep 01 05:05:59.219645 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG oslo_db.sqlalchemy.engines [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:05:59.223893 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_db.sqlalchemy.engines [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:05:59.226292 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG dbcounter [-] [105677] Writer thread running {{(pid=105677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:05:59.230422 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writer thread running {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:05:59.283110 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.context [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a090075-45e2-480a-a3b7-44373d134320(cell1) {{(pid=105677) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 05:05:59.286883 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG oslo_concurrency.lockutils [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:59.287352 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG oslo_concurrency.lockutils [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:59.287499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.context [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a090075-45e2-480a-a3b7-44373d134320(cell1) {{(pid=105678) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 05:05:59.288921 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG oslo_concurrency.lockutils [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:59.289647 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG oslo_concurrency.lockutils [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:59.290085 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG oslo_concurrency.lockutils [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:59.291321 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:59.291796 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:59.292043 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG oslo_concurrency.lockutils [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:59.293400 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:59.294095 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO dbcounter [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Registered counter for database nova_cell0 Sep 01 05:05:59.294190 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:59.294565 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:59.297534 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:59.298725 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO dbcounter [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Registered counter for database nova_cell1 Sep 01 05:05:59.299680 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO dbcounter [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Registered counter for database nova_cell0 Sep 01 05:05:59.304049 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO dbcounter [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Registered counter for database nova_cell1 Sep 01 05:05:59.306630 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG oslo_db.sqlalchemy.engines [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:05:59.308902 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG oslo_db.sqlalchemy.engines [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:05:59.310730 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_db.sqlalchemy.engines [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:05:59.314421 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_db.sqlalchemy.engines [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:05:59.315301 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG dbcounter [-] [105677] Writer thread running {{(pid=105677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:05:59.317304 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writer thread running {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:05:59.317542 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG dbcounter [-] [105677] Writer thread running {{(pid=105677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:05:59.457590 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writer thread running {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:05:59.459506 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO dbcounter [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Registered counter for database nova_cell0 Sep 01 05:05:59.466424 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO dbcounter [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Registered counter for database nova_cell0 Sep 01 05:05:59.468809 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG oslo_db.sqlalchemy.engines [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:05:59.473730 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG dbcounter [-] [105677] Writer thread running {{(pid=105677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:05:59.475730 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_db.sqlalchemy.engines [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:05:59.480346 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writer thread running {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:05:59.815794 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: WARNING keystonemiddleware.auth_token [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:05:59.818041 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: WARNING keystonemiddleware.auth_token [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:05:59.823153 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: WARNING keystonemiddleware.auth_token [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:05:59.825298 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: WARNING keystonemiddleware.auth_token [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:06:00.168289 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: WARNING keystonemiddleware.auth_token [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:06:00.171341 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: WARNING keystonemiddleware.auth_token [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:06:00.174963 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: WARNING keystonemiddleware.auth_token [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:06:00.177295 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: WARNING keystonemiddleware.auth_token [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:06:00.180563 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564e2515a9c0 pid: 105677 (default app) Sep 01 05:06:00.182643 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:00.182799 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564e2515a9c0 pid: 105678 (default app) Sep 01 05:06:00.183811 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-f47480dd-38fb-4180-8d7f-bf95f6241e94 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Sep 01 05:06:00.184216 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Thu Sep 1 05:06:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:18.652056 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:18.653316 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Sep 01 05:07:18.653883 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:07:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:07:18.665530 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG dbcounter [-] [105677] Writing DB stats nova_api:SELECT=3 {{(pid=105677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:18.666652 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG dbcounter [-] [105677] Writing DB stats nova_cell0:SELECT=3 {{(pid=105677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:18.667857 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG dbcounter [-] [105677] Writing DB stats nova_cell1:SELECT=3 {{(pid=105677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:18.668998 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG dbcounter [-] [105677] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:19.556143 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-7196c10d-5690-4714-98f9-af5480e6d75f admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:19.588962 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-7196c10d-5690-4714-98f9-af5480e6d75f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.928550 Sep 01 05:07:19.589694 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1292 bytes} [Thu Sep 1 05:07:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:21.996668 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:21.999870 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-6b8f89d8-bc31-48f1-8a6e-c53711a4c0d5 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003797 Sep 01 05:07:22.005368 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 2/4] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:07:21 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:22.443608 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-1262fc19-bf76-484d-b02d-0aaaef1bc3d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:22.492624 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-1262fc19-bf76-484d-b02d-0aaaef1bc3d5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.484182 Sep 01 05:07:22.493238 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 3/5] 10.222.0.49 () {64 vars in 1283 bytes} [Thu Sep 1 05:07:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:07:22.506584 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writing DB stats nova_api:SELECT=3 {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:22.507177 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writing DB stats nova_cell0:SELECT=3 {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:22.508132 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writing DB stats nova_cell1:SELECT=3 {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:22.509156 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:22.719467 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-1c52f314-e276-4809-b2e0-3cb0ff2ddca1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:22.787219 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-1c52f314-e276-4809-b2e0-3cb0ff2ddca1 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285894 Sep 01 05:07:22.787919 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 3/6] 10.222.0.49 () {64 vars in 1336 bytes} [Thu Sep 1 05:07:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:25.143512 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-1262fc19-bf76-484d-b02d-0aaaef1bc3d5 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:25.144519 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-1262fc19-bf76-484d-b02d-0aaaef1bc3d5 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 01 05:07:25.145236 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 4/7] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:07:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:25.812866 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-7e409d1d-f30c-4b3e-870b-174d48afffbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "vcpus": 1}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:25.853357 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-7e409d1d-f30c-4b3e-870b-174d48afffbb admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.702118 Sep 01 05:07:25.853902 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 4/8] 10.222.0.49 () {64 vars in 1283 bytes} [Thu Sep 1 05:07:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:07:25.866722 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-79686c49-4ddc-4a00-b1da-c48a852d58d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:25.907984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-79686c49-4ddc-4a00-b1da-c48a852d58d7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045017 Sep 01 05:07:25.913093 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 5/9] 10.222.0.49 () {64 vars in 1336 bytes} [Thu Sep 1 05:07:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:28.287310 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-7e409d1d-f30c-4b3e-870b-174d48afffbb admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:28.288263 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-7e409d1d-f30c-4b3e-870b-174d48afffbb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 01 05:07:28.288664 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:07:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:28.687623 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-c3c56f59-3415-483f-8033-0ca6e6386a09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:28.706823 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-c3c56f59-3415-483f-8033-0ca6e6386a09 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.412149 Sep 01 05:07:28.707365 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 6/11] 10.222.0.49 () {64 vars in 1283 bytes} [Thu Sep 1 05:07:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:07:28.720087 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-b41319bc-3d66-4848-8cfd-fb639d518579 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:28.744731 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-b41319bc-3d66-4848-8cfd-fb639d518579 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029091 Sep 01 05:07:28.745333 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 6/12] 10.222.0.49 () {64 vars in 1336 bytes} [Thu Sep 1 05:07:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:07:31.124589 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-c3c56f59-3415-483f-8033-0ca6e6386a09 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:31.125649 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-c3c56f59-3415-483f-8033-0ca6e6386a09 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Sep 01 05:07:31.126047 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 7/13] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:07:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:31.604643 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-e635a695-e94b-4678-b0a3-b289534fd340 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G"}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:31.624592 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-e635a695-e94b-4678-b0a3-b289534fd340 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492487 Sep 01 05:07:31.625334 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 7/14] 10.222.0.49 () {64 vars in 1283 bytes} [Thu Sep 1 05:07:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:07:31.636903 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-2ea735aa-a6ff-4b83-be57-61df9abfe324 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:31.661719 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-2ea735aa-a6ff-4b83-be57-61df9abfe324 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028434 Sep 01 05:07:31.662949 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 8/15] 10.222.0.49 () {64 vars in 1336 bytes} [Thu Sep 1 05:07:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:34.020603 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-e635a695-e94b-4678-b0a3-b289534fd340 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:34.021565 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-e635a695-e94b-4678-b0a3-b289534fd340 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 01 05:07:34.021962 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 8/16] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:07:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:34.488000 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-20aea99f-7fa3-4539-81f8-99e26d8fb99c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:34.508659 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-20aea99f-7fa3-4539-81f8-99e26d8fb99c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480500 Sep 01 05:07:34.512815 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 9/17] 10.222.0.49 () {64 vars in 1283 bytes} [Thu Sep 1 05:07:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:07:34.521340 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-a3016d27-fb8f-4438-9fca-185f3436c33c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:34.547192 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-a3016d27-fb8f-4438-9fca-185f3436c33c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029469 Sep 01 05:07:34.547927 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 9/18] 10.222.0.49 () {64 vars in 1336 bytes} [Thu Sep 1 05:07:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:37.061852 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-20aea99f-7fa3-4539-81f8-99e26d8fb99c admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:37.063063 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-20aea99f-7fa3-4539-81f8-99e26d8fb99c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002307 Sep 01 05:07:37.063488 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 10/19] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:07:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:37.521087 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-2fba3682-1d48-413a-88e7-3f34c0ebe34e admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:37.552369 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-2fba3682-1d48-413a-88e7-3f34c0ebe34e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.481069 Sep 01 05:07:37.553036 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 10/20] 10.222.0.49 () {60 vars in 1292 bytes} [Thu Sep 1 05:07:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:40.026421 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-20aea99f-7fa3-4539-81f8-99e26d8fb99c admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:40.027419 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-20aea99f-7fa3-4539-81f8-99e26d8fb99c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 01 05:07:40.027811 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 11/21] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:07:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:07:40.450845 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-54de0b6e-6fbc-4504-9c86-fc8803cd5c30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "ram": 512}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:40.475800 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-54de0b6e-6fbc-4504-9c86-fc8803cd5c30 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.441094 Sep 01 05:07:40.476280 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 11/22] 10.222.0.49 () {64 vars in 1283 bytes} [Thu Sep 1 05:07:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:07:40.488586 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-48434cf4-d362-4779-af9f-3795512279b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:40.512131 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-48434cf4-d362-4779-af9f-3795512279b0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027288 Sep 01 05:07:40.512718 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 12/23] 10.222.0.49 () {64 vars in 1333 bytes} [Thu Sep 1 05:07:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:07:42.873341 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-54de0b6e-6fbc-4504-9c86-fc8803cd5c30 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:42.874415 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-54de0b6e-6fbc-4504-9c86-fc8803cd5c30 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 01 05:07:42.874837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:07:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:43.278530 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-e5c18ec8-8b41-40b5-9f1f-5418cf322149 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "id": "2"}} {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:43.297430 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-e5c18ec8-8b41-40b5-9f1f-5418cf322149 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416259 Sep 01 05:07:43.301719 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 13/25] 10.222.0.49 () {64 vars in 1283 bytes} [Thu Sep 1 05:07:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:07:43.310281 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-6d94281c-75bc-4ef7-98df-d167b37990ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:43.334125 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-6d94281c-75bc-4ef7-98df-d167b37990ac admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027493 Sep 01 05:07:43.334690 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 13/26] 10.222.0.49 () {64 vars in 1333 bytes} [Thu Sep 1 05:07:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:45.719718 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-e5c18ec8-8b41-40b5-9f1f-5418cf322149 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:45.720729 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-e5c18ec8-8b41-40b5-9f1f-5418cf322149 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 01 05:07:45.721161 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 14/27] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:07:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:07:46.121582 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-eb8ab1f1-119c-48c7-9b26-c76232c2dd22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:46.142419 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-eb8ab1f1-119c-48c7-9b26-c76232c2dd22 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.415003 Sep 01 05:07:46.143157 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 14/28] 10.222.0.49 () {64 vars in 1283 bytes} [Thu Sep 1 05:07:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:07:46.155661 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-79f92faf-0c14-4101-94f4-8cde615f74d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:46.182600 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-79f92faf-0c14-4101-94f4-8cde615f74d6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031193 Sep 01 05:07:46.183615 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 15/29] 10.222.0.49 () {64 vars in 1333 bytes} [Thu Sep 1 05:07:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:48.585974 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-eb8ab1f1-119c-48c7-9b26-c76232c2dd22 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:48.587587 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-eb8ab1f1-119c-48c7-9b26-c76232c2dd22 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Sep 01 05:07:48.587982 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 15/30] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:07:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:49.060066 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-f3ca8012-b5b7-4ddf-bca6-26f8d0ad2c3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "swap": 0}} {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:49.068728 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG dbcounter [-] [105677] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:49.081870 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-f3ca8012-b5b7-4ddf-bca6-26f8d0ad2c3d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.484262 Sep 01 05:07:49.088816 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 16/31] 10.222.0.49 () {64 vars in 1283 bytes} [Thu Sep 1 05:07:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:07:49.094804 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-6ba2c73f-55f6-4e9e-8acd-751384f68998 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:49.120726 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-6ba2c73f-55f6-4e9e-8acd-751384f68998 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029669 Sep 01 05:07:49.121253 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 16/32] 10.222.0.49 () {64 vars in 1333 bytes} [Thu Sep 1 05:07:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:51.580631 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-f3ca8012-b5b7-4ddf-bca6-26f8d0ad2c3d admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:51.581679 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-f3ca8012-b5b7-4ddf-bca6-26f8d0ad2c3d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 01 05:07:51.582370 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 17/33] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:07:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:52.052026 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-2be10ebe-3615-429a-8400-e0ea329131b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:52.075247 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-2be10ebe-3615-429a-8400-e0ea329131b4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.486706 Sep 01 05:07:52.086607 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 17/34] 10.222.0.49 () {64 vars in 1283 bytes} [Thu Sep 1 05:07:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:07:52.091690 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-3b90c690-dcaa-4e89-ade1-d075bedffabf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:52.133553 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-3b90c690-dcaa-4e89-ade1-d075bedffabf admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043495 Sep 01 05:07:52.141280 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 18/35] 10.222.0.49 () {64 vars in 1333 bytes} [Thu Sep 1 05:07:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:11.149876 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-2be10ebe-3615-429a-8400-e0ea329131b4 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:11.150880 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-2be10ebe-3615-429a-8400-e0ea329131b4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 01 05:08:11.151275 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 18/36] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:08:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:08:11.162336 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG dbcounter [-] [105677] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:11.539550 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-e165f4ca-df0b-4ee8-a042-87491a825a02 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:11.557943 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-e165f4ca-df0b-4ee8-a042-87491a825a02 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400011 Sep 01 05:08:11.558468 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 19/37] 10.222.0.49 () {60 vars in 1292 bytes} [Thu Sep 1 05:08:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:12.615568 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-2be10ebe-3615-429a-8400-e0ea329131b4 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:12.616575 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-2be10ebe-3615-429a-8400-e0ea329131b4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 01 05:08:12.617028 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 19/38] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Sep 1 05:08:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:08:13.139617 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-fe780712-9fc6-49e8-a1f9-514ab78e6686 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:13.146061 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.wsgi [None req-fe780712-9fc6-49e8-a1f9-514ab78e6686 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-fe780712-9fc6-49e8-a1f9-514ab78e6686 admin admin] Request method failure captured: Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Accept: application/json Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Accept-Encoding: gzip, deflate Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Connection: keep-alive Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Content-Length: 0 Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Host: 10.222.0.49 Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Openstack-Api-Version: compute 2.90 Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Openstack-System-Scope: None Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: User-Agent: python-novaclient Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Auth-Token: gAAAAABjED48V4pkMEzrzr8vkifP4k6dgq6rfojYtmOS1-j2oh6-HD3DyqX6QMG2ru7o5eNeShhJZEfkkbpWxWntZED96cZkOAYyrZI98eUhuK-Vtcu9i4DEpNafuS863qTV3f_2TUIr51KIDPqeHfqwdnUywH1owCwhP6okDblN-COJ4bMETyE Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Domain-Id: None Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Domain-Name: None Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Identity-Status: Confirmed Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Is-Admin-Project: True Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Project-Domain-Id: default Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Project-Domain-Name: Default Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Project-Id: c3028b8b0833461897b733e154e426f1 Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Project-Name: admin Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Role: member,reader,admin Sep 01 05:08:13.149344 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Roles: member,reader,admin Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c3028b8b0833461897b733e154e426f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3028b8b0833461897b733e154e426f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3028b8b0833461897b733e154e426f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c3028b8b0833461897b733e154e426f1"}]}] Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Tenant: admin Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Tenant-Id: c3028b8b0833461897b733e154e426f1 Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Tenant-Name: admin Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User: admin Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User-Domain-Id: default Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User-Domain-Name: Default Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User-Id: daadf35276e746fa8c2621c2ba20df6d Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User-Name: admin Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: method: > Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: exception: Flavor 42 could not be found. Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: action_args: {'id': '42'} Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:13.150984 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:13.152021 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.153465 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-fe780712-9fc6-49e8-a1f9-514ab78e6686 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:13.154732 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-fe780712-9fc6-49e8-a1f9-514ab78e6686 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394976 Sep 01 05:08:13.154732 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 20/39] 10.222.0.49 () {60 vars in 1190 bytes} [Thu Sep 1 05:08:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 05:08:13.160644 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-3d686ec2-49c1-4600-bbc8-4eabc484824c admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:13.164863 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:13.185770 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-3d686ec2-49c1-4600-bbc8-4eabc484824c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028748 Sep 01 05:08:13.186309 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 20/40] 10.222.0.49 () {60 vars in 1210 bytes} [Thu Sep 1 05:08:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:08:13.196504 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-6b9d4027-646c-4a31-a9e4-429643b6a3e3 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:13.221835 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-6b9d4027-646c-4a31-a9e4-429643b6a3e3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028816 Sep 01 05:08:13.222378 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 21/41] 10.222.0.49 () {60 vars in 1210 bytes} [Thu Sep 1 05:08:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:13.231810 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-0e60256e-2637-4d25-a259-1b124c8d2fe0 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:13.239081 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.wsgi [None req-0e60256e-2637-4d25-a259-1b124c8d2fe0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-0e60256e-2637-4d25-a259-1b124c8d2fe0 admin admin] Request method failure captured: Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Accept: application/json Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Accept-Encoding: gzip, deflate Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Connection: keep-alive Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Content-Length: 0 Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Host: 10.222.0.49 Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Openstack-Api-Version: compute 2.90 Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Openstack-System-Scope: None Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: User-Agent: python-novaclient Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Auth-Token: gAAAAABjED48V4pkMEzrzr8vkifP4k6dgq6rfojYtmOS1-j2oh6-HD3DyqX6QMG2ru7o5eNeShhJZEfkkbpWxWntZED96cZkOAYyrZI98eUhuK-Vtcu9i4DEpNafuS863qTV3f_2TUIr51KIDPqeHfqwdnUywH1owCwhP6okDblN-COJ4bMETyE Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Domain-Id: None Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Domain-Name: None Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Identity-Status: Confirmed Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Is-Admin-Project: True Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Project-Domain-Id: default Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Project-Domain-Name: Default Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Project-Id: c3028b8b0833461897b733e154e426f1 Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Project-Name: admin Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Role: member,reader,admin Sep 01 05:08:13.242353 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Roles: member,reader,admin Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c3028b8b0833461897b733e154e426f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3028b8b0833461897b733e154e426f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3028b8b0833461897b733e154e426f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c3028b8b0833461897b733e154e426f1"}]}] Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Tenant: admin Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Tenant-Id: c3028b8b0833461897b733e154e426f1 Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Tenant-Name: admin Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User: admin Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User-Domain-Id: default Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User-Domain-Name: Default Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User-Id: daadf35276e746fa8c2621c2ba20df6d Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User-Name: admin Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: method: > Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: exception: Flavor 42 could not be found. Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: action_args: {'id': '42'} Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:13.243734 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:13.244837 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.246066 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-0e60256e-2637-4d25-a259-1b124c8d2fe0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:13.247089 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-0e60256e-2637-4d25-a259-1b124c8d2fe0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015576 Sep 01 05:08:13.247089 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 21/42] 10.222.0.49 () {60 vars in 1190 bytes} [Thu Sep 1 05:08:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 05:08:14.211887 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-6b9d4027-646c-4a31-a9e4-429643b6a3e3 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:14.212971 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-6b9d4027-646c-4a31-a9e4-429643b6a3e3 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 01 05:08:14.213369 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 22/43] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Sep 1 05:08:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:08:14.732433 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-589cc271-3060-44e9-bd70-8cec68f83c8d admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:14.738516 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.wsgi [None req-589cc271-3060-44e9-bd70-8cec68f83c8d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-589cc271-3060-44e9-bd70-8cec68f83c8d admin admin] Request method failure captured: Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Accept: application/json Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Accept-Encoding: gzip, deflate Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Connection: keep-alive Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Content-Length: 0 Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Host: 10.222.0.49 Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Openstack-Api-Version: compute 2.90 Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Openstack-System-Scope: None Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: User-Agent: python-novaclient Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Auth-Token: gAAAAABjED4-5IFmkdxa2nSNAGQjSbPkP9UAW-SuWfBJEGEA6H5muzcjECdmlK4QV9bI1Jcs0b5n_x0N6MOMy4wh1DP4sZVB2Oq8WkCueY697sSW8VFCiC5-Yeg7NziShSc9yWgmzuf3WISu6n5m0EDkVGmm-OSTtG5FtVFCzr00C2erahnvjlY Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Domain-Id: None Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Domain-Name: None Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Identity-Status: Confirmed Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Is-Admin-Project: True Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Project-Domain-Id: default Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Project-Domain-Name: Default Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Project-Id: c3028b8b0833461897b733e154e426f1 Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Project-Name: admin Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Role: member,reader,admin Sep 01 05:08:14.740012 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Roles: member,reader,admin Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c3028b8b0833461897b733e154e426f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3028b8b0833461897b733e154e426f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3028b8b0833461897b733e154e426f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c3028b8b0833461897b733e154e426f1"}]}] Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Tenant: admin Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Tenant-Id: c3028b8b0833461897b733e154e426f1 Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Tenant-Name: admin Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User: admin Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User-Domain-Id: default Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User-Domain-Name: Default Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User-Id: daadf35276e746fa8c2621c2ba20df6d Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User-Name: admin Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: method: > Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: exception: Flavor 84 could not be found. Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: action_args: {'id': '84'} Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:14.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:14.742499 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.743779 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-589cc271-3060-44e9-bd70-8cec68f83c8d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:14.745118 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-589cc271-3060-44e9-bd70-8cec68f83c8d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.390491 Sep 01 05:08:14.745118 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 22/44] 10.222.0.49 () {60 vars in 1190 bytes} [Thu Sep 1 05:08:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:08:14.751517 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-e2b8a13e-0698-4262-8e7f-bd6e6ae29a84 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:14.767684 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-e2b8a13e-0698-4262-8e7f-bd6e6ae29a84 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020161 Sep 01 05:08:14.768156 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 23/45] 10.222.0.49 () {60 vars in 1210 bytes} [Thu Sep 1 05:08:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:14.778383 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-c2122a28-38a1-4635-ab62-810f8a6fa06a admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:14.793479 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-c2122a28-38a1-4635-ab62-810f8a6fa06a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018621 Sep 01 05:08:14.794022 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1210 bytes} [Thu Sep 1 05:08:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:14.803689 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-efeef67d-53f3-4cf8-bdcd-610cc361cdc3 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:14.809313 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.wsgi [None req-efeef67d-53f3-4cf8-bdcd-610cc361cdc3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-efeef67d-53f3-4cf8-bdcd-610cc361cdc3 admin admin] Request method failure captured: Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Accept: application/json Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Accept-Encoding: gzip, deflate Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Connection: keep-alive Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Content-Length: 0 Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Host: 10.222.0.49 Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Openstack-Api-Version: compute 2.90 Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Openstack-System-Scope: None Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: User-Agent: python-novaclient Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Auth-Token: gAAAAABjED4-5IFmkdxa2nSNAGQjSbPkP9UAW-SuWfBJEGEA6H5muzcjECdmlK4QV9bI1Jcs0b5n_x0N6MOMy4wh1DP4sZVB2Oq8WkCueY697sSW8VFCiC5-Yeg7NziShSc9yWgmzuf3WISu6n5m0EDkVGmm-OSTtG5FtVFCzr00C2erahnvjlY Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Domain-Id: None Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Domain-Name: None Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Identity-Status: Confirmed Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Is-Admin-Project: True Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Project-Domain-Id: default Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Project-Domain-Name: Default Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Project-Id: c3028b8b0833461897b733e154e426f1 Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Project-Name: admin Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Role: member,reader,admin Sep 01 05:08:14.810797 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Roles: member,reader,admin Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c3028b8b0833461897b733e154e426f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3028b8b0833461897b733e154e426f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3028b8b0833461897b733e154e426f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c3028b8b0833461897b733e154e426f1"}]}] Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Tenant: admin Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Tenant-Id: c3028b8b0833461897b733e154e426f1 Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Tenant-Name: admin Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User: admin Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User-Domain-Id: default Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User-Domain-Name: Default Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User-Id: daadf35276e746fa8c2621c2ba20df6d Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User-Name: admin Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: method: > Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: exception: Flavor 84 could not be found. Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: action_args: {'id': '84'} Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:14.813044 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:14.814023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.815555 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-efeef67d-53f3-4cf8-bdcd-610cc361cdc3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:14.816852 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-efeef67d-53f3-4cf8-bdcd-610cc361cdc3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012005 Sep 01 05:08:14.816852 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 24/47] 10.222.0.49 () {60 vars in 1190 bytes} [Thu Sep 1 05:08:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 05:08:15.791773 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-c2122a28-38a1-4635-ab62-810f8a6fa06a admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:15.792796 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-c2122a28-38a1-4635-ab62-810f8a6fa06a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 01 05:08:15.793190 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 24/48] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Sep 1 05:08:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:08:16.320821 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-9d47d4e4-f288-4b6c-92eb-5cf9f70f76e8 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:16.328047 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.wsgi [None req-9d47d4e4-f288-4b6c-92eb-5cf9f70f76e8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-9d47d4e4-f288-4b6c-92eb-5cf9f70f76e8 admin admin] Request method failure captured: Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Accept: application/json Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Accept-Encoding: gzip, deflate Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Connection: keep-alive Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Content-Length: 0 Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Host: 10.222.0.49 Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Openstack-Api-Version: compute 2.90 Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Openstack-System-Scope: None Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: User-Agent: python-novaclient Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Auth-Token: gAAAAABjED4_7IWeO1Z0m9sWqX1DEMLfg0_3I1ApD4mPLtoCcRQ6wZvsqcF9uCk6STVwHgoeN3PrWKupBzzPdgWNvMQqLVbiXewBwHb6Pjf53P73PbhFa6Hnm_-6Qj9jXb7LgYsTsL3B3Vl3xoDNljmBu6dXV3h9z6a4WNbiIub5b88hp0UYmus Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Domain-Id: None Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Domain-Name: None Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Identity-Status: Confirmed Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Is-Admin-Project: True Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Project-Domain-Id: default Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Project-Domain-Name: Default Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Project-Id: c3028b8b0833461897b733e154e426f1 Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Project-Name: admin Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Role: member,reader,admin Sep 01 05:08:16.329585 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Roles: member,reader,admin Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c3028b8b0833461897b733e154e426f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3028b8b0833461897b733e154e426f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3028b8b0833461897b733e154e426f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c3028b8b0833461897b733e154e426f1"}]}] Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Tenant: admin Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Tenant-Id: c3028b8b0833461897b733e154e426f1 Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-Tenant-Name: admin Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User: admin Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User-Domain-Id: default Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User-Domain-Name: Default Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User-Id: daadf35276e746fa8c2621c2ba20df6d Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: X-User-Name: admin Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: method: > Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: exception: Flavor 451 could not be found. Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: action_args: {'id': '451'} Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:16.337456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:16.338476 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: ERROR nova.api.openstack.wsgi Sep 01 05:08:16.339787 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-9d47d4e4-f288-4b6c-92eb-5cf9f70f76e8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:16.341353 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-9d47d4e4-f288-4b6c-92eb-5cf9f70f76e8 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.398401 Sep 01 05:08:16.341353 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 25/49] 10.222.0.49 () {60 vars in 1193 bytes} [Thu Sep 1 05:08:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:08:16.341518 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-10ab047a-3a91-46cc-ac11-5913ea090506 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:16.360293 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-10ab047a-3a91-46cc-ac11-5913ea090506 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023159 Sep 01 05:08:16.361320 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 25/50] 10.222.0.49 () {60 vars in 1210 bytes} [Thu Sep 1 05:08:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:16.372347 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:16.388377 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019645 Sep 01 05:08:16.388947 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 26/51] 10.222.0.49 () {60 vars in 1210 bytes} [Thu Sep 1 05:08:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:16.399173 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-08d2a9cf-6a90-4568-bd13-2bc92a82bdcf admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:16.404580 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.wsgi [None req-08d2a9cf-6a90-4568-bd13-2bc92a82bdcf admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-08d2a9cf-6a90-4568-bd13-2bc92a82bdcf admin admin] Request method failure captured: Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Accept: application/json Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Accept-Encoding: gzip, deflate Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Connection: keep-alive Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Content-Length: 0 Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Host: 10.222.0.49 Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Openstack-Api-Version: compute 2.90 Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Openstack-System-Scope: None Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: User-Agent: python-novaclient Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Auth-Token: gAAAAABjED4_7IWeO1Z0m9sWqX1DEMLfg0_3I1ApD4mPLtoCcRQ6wZvsqcF9uCk6STVwHgoeN3PrWKupBzzPdgWNvMQqLVbiXewBwHb6Pjf53P73PbhFa6Hnm_-6Qj9jXb7LgYsTsL3B3Vl3xoDNljmBu6dXV3h9z6a4WNbiIub5b88hp0UYmus Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Domain-Id: None Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Domain-Name: None Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Identity-Status: Confirmed Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Is-Admin-Project: True Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Project-Domain-Id: default Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Project-Domain-Name: Default Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Project-Id: c3028b8b0833461897b733e154e426f1 Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Project-Name: admin Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Role: member,reader,admin Sep 01 05:08:16.406963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Roles: member,reader,admin Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c3028b8b0833461897b733e154e426f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3028b8b0833461897b733e154e426f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3028b8b0833461897b733e154e426f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c3028b8b0833461897b733e154e426f1"}]}] Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Tenant: admin Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Tenant-Id: c3028b8b0833461897b733e154e426f1 Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-Tenant-Name: admin Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User: admin Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User-Domain-Id: default Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User-Domain-Name: Default Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User-Id: daadf35276e746fa8c2621c2ba20df6d Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: X-User-Name: admin Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: method: > Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: exception: Flavor 451 could not be found. Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: action_args: {'id': '451'} Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:16.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:16.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: ERROR nova.api.openstack.wsgi Sep 01 05:08:16.411010 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-08d2a9cf-6a90-4568-bd13-2bc92a82bdcf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:16.412276 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-08d2a9cf-6a90-4568-bd13-2bc92a82bdcf admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012736 Sep 01 05:08:16.412276 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 26/52] 10.222.0.49 () {60 vars in 1193 bytes} [Thu Sep 1 05:08:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:08:17.373602 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:17.374695 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 01 05:08:17.375120 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Sep 1 05:08:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:08:17.902469 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-b7d1bbea-7dfb-4677-911f-051fcb087d21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:17.923618 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-b7d1bbea-7dfb-4677-911f-051fcb087d21 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.408553 Sep 01 05:08:17.924191 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 27/54] 10.222.0.49 () {64 vars in 1235 bytes} [Thu Sep 1 05:08:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:08:18.903531 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:18.904546 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 01 05:08:18.905107 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Sep 1 05:08:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:08:19.434148 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-7795244e-ecaf-4453-a8b7-c4f7eb1be804 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:19.453979 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-7795244e-ecaf-4453-a8b7-c4f7eb1be804 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.409691 Sep 01 05:08:19.454528 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 28/56] 10.222.0.49 () {64 vars in 1235 bytes} [Thu Sep 1 05:08:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:08:20.431840 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:20.432868 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 01 05:08:20.433267 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Sep 1 05:08:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:08:20.958654 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-a0e3e0ae-8811-4eeb-a347-b2f0b5e28f4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:20.977436 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-a0e3e0ae-8811-4eeb-a347-b2f0b5e28f4b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.407991 Sep 01 05:08:20.977967 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 29/58] 10.222.0.49 () {64 vars in 1235 bytes} [Thu Sep 1 05:08:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:08:21.943843 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:21.944977 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 01 05:08:21.945390 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 30/59] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Sep 1 05:08:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:08:22.472246 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-0bf6958f-7699-439b-a6b3-ba38ea6107e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:22.490781 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-0bf6958f-7699-439b-a6b3-ba38ea6107e2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.407155 Sep 01 05:08:22.491310 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 30/60] 10.222.0.49 () {64 vars in 1235 bytes} [Thu Sep 1 05:08:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:08:23.492544 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:23.493558 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 01 05:08:23.493942 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 31/61] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Sep 1 05:08:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:08:24.022974 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-4757cc46-0237-4cd0-b608-6bb6c40cc347 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:24.043305 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-4757cc46-0237-4cd0-b608-6bb6c40cc347 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410011 Sep 01 05:08:24.043844 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 31/62] 10.222.0.49 () {60 vars in 1202 bytes} [Thu Sep 1 05:08:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:17.357101 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:17.358023 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-015e2d31-cbdf-479c-9089-24156282f9f9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 01 05:09:17.358420 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 32/63] 10.222.0.49 () {54 vars in 931 bytes} [Thu Sep 1 05:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:17.369755 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:17.757231 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-cee920f8-5590-4935-a076-bf3e35185dec admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:17.778168 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-cee920f8-5590-4935-a076-bf3e35185dec admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.412804 Sep 01 05:09:17.778694 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 32/64] 10.222.0.49 () {60 vars in 1292 bytes} [Thu Sep 1 05:09:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:17.799049 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG dbcounter [-] [105677] Writing DB stats nova_api:SELECT=14 {{(pid=105677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:17.803424 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-a4ee2152-1edd-40f1-b050-145bb834fe3f admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:17.811210 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-a4ee2152-1edd-40f1-b050-145bb834fe3f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013550 Sep 01 05:09:17.811720 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 33/65] 10.222.0.49 () {60 vars in 1283 bytes} [Thu Sep 1 05:09:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:17.823712 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-60d6285a-0601-4594-a2e9-86d2ab615291 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:17.831292 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-60d6285a-0601-4594-a2e9-86d2ab615291 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011132 Sep 01 05:09:17.831820 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 33/66] 10.222.0.49 () {60 vars in 1286 bytes} [Thu Sep 1 05:09:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:17.843019 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-a3a0fc61-8b4c-43ef-8010-605c5a4a7188 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:17.850713 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-a3a0fc61-8b4c-43ef-8010-605c5a4a7188 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011156 Sep 01 05:09:17.851242 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 34/67] 10.222.0.49 () {60 vars in 1286 bytes} [Thu Sep 1 05:09:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:17.862569 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-1d7d1b14-1f2e-4691-9af9-aece5f230525 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:17.870671 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-1d7d1b14-1f2e-4691-9af9-aece5f230525 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011604 Sep 01 05:09:17.871177 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 34/68] 10.222.0.49 () {60 vars in 1283 bytes} [Thu Sep 1 05:09:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:18.255121 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-a3a0fc61-8b4c-43ef-8010-605c5a4a7188 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:18.256173 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-a3a0fc61-8b4c-43ef-8010-605c5a4a7188 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 01 05:12:18.256567 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 35/69] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Sep 1 05:12:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:18.402505 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writing DB stats nova_api:SELECT=6 {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:18.564153 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-292c92e8-ac8f-485b-a3ec-b64b36b33739 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:18.567819 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-292c92e8-ac8f-485b-a3ec-b64b36b33739 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:18.568327 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-292c92e8-ac8f-485b-a3ec-b64b36b33739 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:18.568759 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-292c92e8-ac8f-485b-a3ec-b64b36b33739 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:18.569503 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-292c92e8-ac8f-485b-a3ec-b64b36b33739 admin admin] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:18.569952 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-292c92e8-ac8f-485b-a3ec-b64b36b33739 admin admin] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:18.570635 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-292c92e8-ac8f-485b-a3ec-b64b36b33739 admin admin] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:18.604405 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-292c92e8-ac8f-485b-a3ec-b64b36b33739 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.203327 Sep 01 05:12:18.604992 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 35/70] 10.222.0.49 () {60 vars in 1193 bytes} [Thu Sep 1 05:12:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:12:19.433456 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-a3a0fc61-8b4c-43ef-8010-605c5a4a7188 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:19.434454 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-a3a0fc61-8b4c-43ef-8010-605c5a4a7188 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 01 05:12:19.434845 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 36/71] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Sep 1 05:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:19.628983 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-9857a4d7-52b6-49e6-9827-d30a54b0e5d0 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:19.632356 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-9857a4d7-52b6-49e6-9827-d30a54b0e5d0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:19.632854 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-9857a4d7-52b6-49e6-9827-d30a54b0e5d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:19.633285 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-9857a4d7-52b6-49e6-9827-d30a54b0e5d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:19.633999 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-9857a4d7-52b6-49e6-9827-d30a54b0e5d0 admin admin] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:19.634442 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-9857a4d7-52b6-49e6-9827-d30a54b0e5d0 admin admin] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:19.634857 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-9857a4d7-52b6-49e6-9827-d30a54b0e5d0 admin admin] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:19.654524 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-9857a4d7-52b6-49e6-9827-d30a54b0e5d0 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077861 Sep 01 05:12:19.655008 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 36/72] 10.222.0.49 () {60 vars in 1193 bytes} [Thu Sep 1 05:12:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:12:30.918795 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-a3a0fc61-8b4c-43ef-8010-605c5a4a7188 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:30.919780 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-a3a0fc61-8b4c-43ef-8010-605c5a4a7188 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Sep 01 05:12:30.920166 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 37/73] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Sep 1 05:12:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:31.064963 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writing DB stats nova_cell0:SELECT=4 {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:31.065677 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writing DB stats nova_cell1:SELECT=4 {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:31.066288 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG dbcounter [-] [105678] Writing DB stats nova_api:SELECT=8 {{(pid=105678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:31.113841 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-837f3d62-6128-446e-9730-0b9345601c65 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:31.117215 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-837f3d62-6128-446e-9730-0b9345601c65 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:31.117685 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-837f3d62-6128-446e-9730-0b9345601c65 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:31.118109 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-837f3d62-6128-446e-9730-0b9345601c65 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:31.118816 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-837f3d62-6128-446e-9730-0b9345601c65 admin admin] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:31.119252 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-837f3d62-6128-446e-9730-0b9345601c65 admin admin] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:31.119663 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-837f3d62-6128-446e-9730-0b9345601c65 admin admin] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:31.144754 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-837f3d62-6128-446e-9730-0b9345601c65 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084875 Sep 01 05:12:31.145316 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 37/74] 10.222.0.49 () {60 vars in 1193 bytes} [Thu Sep 1 05:12:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:12:31.982148 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: DEBUG nova.api.openstack.wsgi [None req-a3a0fc61-8b4c-43ef-8010-605c5a4a7188 admin admin] Calling method '>' {{(pid=105677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:31.983199 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: INFO nova.api.openstack.requestlog [None req-a3a0fc61-8b4c-43ef-8010-605c5a4a7188 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 01 05:12:31.983626 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: [pid: 105677|app: 0|req: 38/75] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Sep 1 05:12:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:32.175810 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG nova.api.openstack.wsgi [None req-499740a1-2ddf-4aa9-a9b1-af1177c26256 admin admin] Calling method '>' {{(pid=105678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:32.179307 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-499740a1-2ddf-4aa9-a9b1-af1177c26256 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:32.179783 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-499740a1-2ddf-4aa9-a9b1-af1177c26256 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:32.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-499740a1-2ddf-4aa9-a9b1-af1177c26256 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:32.180949 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-499740a1-2ddf-4aa9-a9b1-af1177c26256 admin admin] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:32.181393 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-499740a1-2ddf-4aa9-a9b1-af1177c26256 admin admin] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:32.181810 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: DEBUG oslo_concurrency.lockutils [None req-499740a1-2ddf-4aa9-a9b1-af1177c26256 admin admin] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:32.204150 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: INFO nova.api.openstack.requestlog [None req-499740a1-2ddf-4aa9-a9b1-af1177c26256 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080431 Sep 01 05:12:32.204694 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: [pid: 105678|app: 0|req: 38/76] 10.222.0.49 () {60 vars in 1193 bytes} [Thu Sep 1 05:12:32 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:13:27.502806 dv-cinder-853910-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 05:13:27.503458 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: Thu Sep 1 05:13:27 2022 - graceful shutdown triggered... Sep 01 05:13:27.503893 dv-cinder-853910-6-iscsi devstack@n-api.service[105677]: Gracefully killing worker 1 (pid: 105677)... Sep 01 05:13:27.504256 dv-cinder-853910-6-iscsi devstack@n-api.service[105678]: Gracefully killing worker 2 (pid: 105678)... Sep 01 05:13:28.504290 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: worker 1 buried after 1 seconds Sep 01 05:13:28.504849 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: worker 2 buried after 1 seconds Sep 01 05:13:28.504849 dv-cinder-853910-6-iscsi devstack@n-api.service[105676]: goodbye to uWSGI. Sep 01 05:13:28.505908 dv-cinder-853910-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 05:13:28.506473 dv-cinder-853910-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 05:13:28.509355 dv-cinder-853910-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 05:13:28.519043 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 05:13:28.521052 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 05:13:28 2022] *** Sep 01 05:13:28.521052 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 05:13:28.521052 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 05:13:28.521052 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: nodename: dv-cinder-853910-6-iscsi Sep 01 05:13:28.521052 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: machine: x86_64 Sep 01 05:13:28.521052 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: clock source: unix Sep 01 05:13:28.521052 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: pcre jit disabled Sep 01 05:13:28.521052 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: detected number of CPU cores: 4 Sep 01 05:13:28.521052 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: current working directory: / Sep 01 05:13:28.521052 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: detected binary path: /usr/bin/uwsgi-core Sep 01 05:13:28.521052 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: your processes number limit is 47680 Sep 01 05:13:28.521899 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: your memory page size is 4096 bytes Sep 01 05:13:28.521899 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: detected max file descriptor number: 2048 Sep 01 05:13:28.521899 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: lock engine: pthread robust mutexes Sep 01 05:13:28.521899 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: thunder lock: enabled Sep 01 05:13:28.521899 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 05:13:28.521899 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 05:13:28.561678 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: Python main interpreter initialized at 0x5636fe95b9c0 Sep 01 05:13:28.561678 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: python threads support enabled Sep 01 05:13:28.561678 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: your server socket listen backlog is limited to 100 connections Sep 01 05:13:28.561678 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: your mercy for graceful operations on workers is 90 seconds Sep 01 05:13:28.562124 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 05:13:28.562124 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: *** Operational MODE: preforking *** Sep 01 05:13:28.562361 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: *** uWSGI is running in multiple interpreter mode *** Sep 01 05:13:28.562361 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: spawned uWSGI master process (pid: 120661) Sep 01 05:13:28.562562 dv-cinder-853910-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 05:13:28.563169 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: spawned uWSGI worker 1 (pid: 120673, cores: 1) Sep 01 05:13:28.563526 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: spawned uWSGI worker 2 (pid: 120674, cores: 1) Sep 01 05:13:28.565517 dv-cinder-853910-6-iscsi devstack@n-api.service[120661]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 05:13:29.230917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 05:13:29.247512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 05:13:30.385121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:13:30.385121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: from cryptography.utils import int_from_bytes Sep 01 05:13:30.385758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:13:30.385758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: from cryptography.utils import int_from_bytes Sep 01 05:13:30.412675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:13:30.412675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: from cryptography.utils import int_from_bytes Sep 01 05:13:30.413270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:13:30.413270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: from cryptography.utils import int_from_bytes Sep 01 05:13:32.827745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:13:32.827745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:13:32.829063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:13:32.829063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:13:32.829221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:13:32.829543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.829847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.830172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.830492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.831113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.831423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.831746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.832062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.832390 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.832650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.832992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.833319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-6-iscsi {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.833819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.834129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.834443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.834771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.835076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.835399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.835705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.836211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.837029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.837343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.837761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.838114 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.838524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.838967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.839292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.839593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.839916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.840242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.840650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-6-iscsi {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.841002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.841331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.841629 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.842052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.842359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.842668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.842991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.843319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.843611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.843951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.844278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.844605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.844942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.845249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.845554 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.845865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.846183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.846490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.846799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.847046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.847352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.847673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.847989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.848312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.848570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.848844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.849169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.849490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.849795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.850101 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.850404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.850708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.851011 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.851332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.851666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.851921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.852237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.852551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.852900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.853207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.853524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.853933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.854752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.855047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.855359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.855679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.855987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.856306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.856628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.856970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.857273 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.857579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.857898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.858240 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.858545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.858792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.859090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.859398 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.859713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.860018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.860320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.860624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.860957 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.861255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.861556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.861859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.862163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.862466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.862768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.863073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.863377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.863679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.864000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.864320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.864689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.865045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.865266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.865575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.865889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.866191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.866496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.866815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.867121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.867421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.867737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.868044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.868347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.868665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.868990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.869299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.869656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.870503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.870810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.871113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.871417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.871718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.872020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.872321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.872621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.872947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.873266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.873593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.873902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.874207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.874517 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.874836 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.875175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.875505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.875850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.876164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.876497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.876851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.877172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.877486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.877798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.878125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.878437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.878746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.879056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.879409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.879678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.880011 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.880329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.880644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.880986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.881299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.881616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.881943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.882268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.882579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.882920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.883266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.883579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.883900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.884220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.884538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.884872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.885183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.885552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.885887 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.886197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.886526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.886832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.887150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.887466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.887771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.888080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.888394 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.888701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.889132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.889389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.889712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.890027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.890339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.894833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.895307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.895618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.895779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.896027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.896327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.896630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.896974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.897284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.897587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.897908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.898213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.898514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.898831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.899141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.899450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.899760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.900068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.900401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.900702 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.901214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.901575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.901911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.902213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.902452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:13:32.903002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.903170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:13:32.903334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.903334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.903620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:13:32.903774 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.903922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:13:32.904075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.904234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:13:32.904388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.904534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.904687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.904882 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.905055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.905211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.905369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.905522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.905668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.905813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.905973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.906119 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.906272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.906419 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.906564 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.906716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.906885 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.907072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.907220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.907386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.907541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.907687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.907841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.908020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-6-iscsi {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.908188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.908188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.908485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.908631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.908814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.908979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.909138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.909292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.909447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.909674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.909840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.909990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.910144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.910297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.910471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.910637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.910791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.910980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.911133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.911279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.911434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.911580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.911743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.912887 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.912887 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.913822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.913977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.914123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.914277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.914436 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.914583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.914741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.917220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.921064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.921257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.921422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.921588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.921761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.921911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.922103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-6-iscsi {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.922311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.922491 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.922675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.922824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.922977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.923182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.923334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.923494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.923643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.923797 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.923952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.924109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.924268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.924422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.924587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.924743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.924993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.925169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.925327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.925482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.925638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.925792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.925947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.926092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.926250 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.926250 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.926547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.926547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.926842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.929732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.929922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.930085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.930252 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.930414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.930572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.930728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.930883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.931039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.931207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.931356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.931534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.931686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.931839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.932000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.932148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.932432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.932582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.932728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.932932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.933090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.933302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.933465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.933633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.933788 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.933949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.934095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.934253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.934398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.934543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.934688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.934842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.934999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.935145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.935291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.935448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.936112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.936283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.936440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.936586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.936730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.936903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.937068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.937269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.937838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.938005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.938152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.938298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.938471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.938618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.938772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.938917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.939061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.939466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.939638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.939793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.939938 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.940091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.940236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.940381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.940540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.940697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.941066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.941237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.941392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.941561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.941723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.941869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.942014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.942166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.942311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.942469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.942623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.942782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.942936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.943082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.943227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.943436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.943595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.943742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.943896 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.944048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.944194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.944354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.944507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.944651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.944840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.945151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.945327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.945487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.945633 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.945990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.946171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.946423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.946586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.946740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.950116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.950304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.950476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.950652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.950815 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.950970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.951126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.951273 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.951427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.951593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.951828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.951988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.952135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.952292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.952438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.952582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.952749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.952990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.953151 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.953297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.953490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.953647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.953806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.953952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.954107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.954107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.954392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.954546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.954710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.954864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.955019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.955172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.955326 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.955471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.955631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.955778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.956147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.956306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.956587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.956747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.956956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.957123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.957270 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.957417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.957561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.957716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.957869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.958023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.958169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.958314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.958466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.958626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.958779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.958933 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.959089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.959235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.959381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.959536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.959681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.960265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.960426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.960583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.960737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.960924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.961072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.961217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.961374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.961543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.961698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.961854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.961999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.962143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.962295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.962447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.962604 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.962751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.962904 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.963057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.963210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.963380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.963619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.963779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.963935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.964081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.964226 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.964379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:13:32.964539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.964685 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.964849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.965012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.965158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.965318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.965491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.965639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.965798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.965962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.966314 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.966492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.966747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.966922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.967076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.967227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.967227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.967530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.967530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.967851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.968004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.968165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.968318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.968479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.968632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.968816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.968988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.969158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.969322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.969483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.969643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.969807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.970180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.970380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.970493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.970592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.970689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.970778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.970866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.970953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.971054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.971150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.971247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.971343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.971441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.971890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.972007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.972098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.972186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.972272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.972359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.972460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.972558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.972646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.972733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.972848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.972947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.973049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.973145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.973234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.973330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.973424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.973513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.973661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.973773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.973871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.973967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.973967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.974143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.974241 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.974329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.974415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.974509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.974603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.974700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.974789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.974875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.974968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.975063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.975158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.975255 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.975349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.975436 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.975522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.975607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.975693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.975792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.975887 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.975982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.976070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.976259 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.976464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.976567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.976664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.976886 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.976983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.977080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.977245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.977336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.977423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.977509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.977602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.977697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.977795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.977883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.977970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.978064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.978152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.978247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.978344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.978439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.978527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.978614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.978701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.978795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.978896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.979531 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.979692 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.979861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.980083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.980369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.980466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.980562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.980659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.980755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.980971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.981180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.981287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.981384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.981472 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.981567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.981567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.981745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.981745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.981917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.981992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.982077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.982077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.982244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.982244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.982402 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.982488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.982580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.982580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.982755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.982755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.982922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.983008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.983094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.983094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.983094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.983094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.983094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.983094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.983592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.983741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.983741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.983741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.983989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.984083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.984083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.984083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.984083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.984399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.984487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.984487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.984487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.984487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.984487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.984906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985004 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985004 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985004 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985004 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.985749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.986158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.986262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.986262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.986262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.986674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.986780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.986780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.986780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.986780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.986780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.986780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.987929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.988400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.988488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.988488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.988488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.988488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.988832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.988931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.988931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.988931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.988931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.988931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.988931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.989398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.989492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.989580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.989580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.989889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.990184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.990448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.990550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.990807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.991075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.991173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.991420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.991528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.991724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.992007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.992116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.992352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.992691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.993031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.993340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.993455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.993660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.993935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.994035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.994266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.994519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.994649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.995486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.995663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.995795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.996109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.996221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.996426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.996737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.996878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.997088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.997340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.997447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.997702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.997917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.998021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.998306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.998612 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.998925 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.999248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.999350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.999560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.999832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:32.999941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.000260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.000578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.000832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.000947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.001140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.001432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.001541 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.001736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.002013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.002109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.002333 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.002593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.002703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.002982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.003170 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.003275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.003589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.003903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.004006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.004211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.004486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.004589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.004853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.005104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.005219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.005473 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.005679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.005775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.006081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.006259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.006391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.006724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.007008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.007316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.007559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.007667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.007933 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.008177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.008298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.008541 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.008765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.008939 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.009175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.009473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.009577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.010055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.010158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.011497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.011497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.011698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.011787 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.011882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.011985 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.012076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.012163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.012163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.012342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.012457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.012618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.012949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.013061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.013262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.013543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.013645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.013859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.014138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.014235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.014460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.014719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.014823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.015049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.015295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.015390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.015647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.015864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.015961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.016238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.016460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.016580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.016871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.017082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.017240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.017465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.017764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.017874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.018107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.018416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.018542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.018718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.019020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.019129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.019323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.019608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.019704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.019956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.020297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.020405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.020626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.021553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.021659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.021750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.021870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.021961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.021961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.022213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.022321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.022479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.022816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.022928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.023084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.023394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.023497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.023747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.024021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.024134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.024359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.024627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.024746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.024997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.025204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.025308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.025594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.025795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.026005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.026347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.026463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.026717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.026998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.027179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.027289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.027589 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.027699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.027893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.028162 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.028267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.028493 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.028756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.028895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.029124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.029371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.029467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.029721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.029947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.030047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.030322 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.030556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.030666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.030956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.031240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.031642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.031770 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.031863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.032052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.032156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.032427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.032639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.032738 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.033048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.033249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.033354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.033720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.033982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.034371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.034692 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.035014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.035168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.035466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.035580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.035683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.035880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.036089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.036205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.036410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.036514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.036732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.036873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.037073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.037162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.037388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.037494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.037698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.037791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.038008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.038108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.038336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.038429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.038643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.038735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.038965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.039065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.039277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.039377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.039584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.039677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.039890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.039978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.040194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.040277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.040518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.040617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.040853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.040965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.041193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.041388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.042275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.042464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.042464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.042897 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.043086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.043244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.043399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.043553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.043713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.043879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.044041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.044248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.044410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.044410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.044708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.044982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.045193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.045363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.045530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.045686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.045847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.046015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.046177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.046331 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.046484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.046645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.046813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.046968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.047161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.047406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.047577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.047759 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.048001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.048168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.048330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.048485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.048648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.048893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.049056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.049210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.049363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.049528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.049695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.049852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.050012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.050175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.050346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.050513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.050678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.050832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.050993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.051166 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.051404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.051574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.051739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.051907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.052062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.052417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.052588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.052796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.052970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.053125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.053278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.053432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.053596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.053765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.053931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.054092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.054246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.054452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.054606 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.054770 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.054949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.055181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.055349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.055511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.055664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.055833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.055988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.056153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.056315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.056470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.056632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.056813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.056986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.057762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.058025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.058270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.058440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.058595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.058749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.058903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.059069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.059223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.059389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.059545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.059706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.059860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.060013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.060250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.060427 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.060427 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.060742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.061040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.061217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.061405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.061640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.061807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.061961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.062113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.062285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.062651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.062821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.062976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.063130 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.063285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.063438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.063613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.063776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.063931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.064092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.064545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.064716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.064716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.065051 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.065291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.065478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.065637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.065806 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.065972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.066125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.066125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.066428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.066581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.066749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.066910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.067063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.067215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.067367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.067534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.067689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.067858 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.068029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.068286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.068535 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.068704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.068926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.069085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.069246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.069399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.069561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.069725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.069880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.070032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.070197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.070370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.070526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.070700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.070863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.071024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.071177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.071337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.071510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.071751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.071926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.072087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.072254 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.072422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.072833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.073000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.073162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.073162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.073463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.073625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.073793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.073948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.074108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.074270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.074423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.074691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.074861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.075015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.075168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.075404 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.075574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.075738 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.075901 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.076063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.076217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.076370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.076523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.076523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.076858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.076858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.077155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.077307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.077470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.077638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.077791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.077951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.078104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.078282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.078536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.078788 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.078960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.079113 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.079266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.079426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.079590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.079752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.079752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.080042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.080194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.080358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.080521 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.080675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.080846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.081019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.081183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.081416 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.081589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.081770 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.081999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.082166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.082326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.082563 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.082919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.083079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.083242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.083396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.083569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.083737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.083905 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.084065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.084227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.084391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.084544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.084753 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.084753 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.085094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.085248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.085418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.085418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.085816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.085978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.086140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.086302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.086463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.086626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.086787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.086941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.087094 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.087245 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.087398 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.087565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.087743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.087897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.088049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.088202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.088959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.089143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.089299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.089461 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.089615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.089776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.090086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.090265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.090433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.090606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.090759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.090912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.091141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.091297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.091457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.091619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.091779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.092012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.092255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.092430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.092594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.092755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.093090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.093243 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.093413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.093574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.093728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.093880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.094032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.094184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.094352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.094513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.094675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.094871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.094871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.095195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.095356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.095509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.095679 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.095913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.096073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.096235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.096397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.096557 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.096711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.096711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.097040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.097214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.097375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.097528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.097687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.097687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.097985 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.098148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.098301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.098460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.098615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.098767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.098935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.099089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.099254 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.099406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.099567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.099730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.099898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.100059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.100227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.100431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.100593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.100746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.100978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.101133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.101297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.101458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.101458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.101763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.101925 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.102079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.102258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.102486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.102656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.102824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.102998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.103164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.103337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.103492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.103644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.103806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.103982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.104670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.104880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.105048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.105218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.105372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.105524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.105676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.105855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.106098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.106268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.106428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.106581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.106733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.106893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.107055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.107209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.107363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.107514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.107674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.107827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.108000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.108000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.108292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.108456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.108610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.108761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.108962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.109124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.109285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.109439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.109591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.109754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.109926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.110079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.110249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.110405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.110557 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.110720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.110873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.111035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.111198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.111198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.111489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.111652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.111816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.111968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.112129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.112283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.112435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.112623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.112802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.112963 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.113130 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.113291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.113453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.113607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.113759 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.113930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.114091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.114244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.114406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.114569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.114730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.114892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.115092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.115259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.115422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.115583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.115737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.115897 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.116086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.116312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.116481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.116649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.116847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.117010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.117174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.117379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.117379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.117672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.117826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.117978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.118140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.118308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.118469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.118632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.118787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.118940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.119100 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.119267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.119420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.119623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.119850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.119850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.120177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.120351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.120515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.120669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.120853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.121023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.121186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.121348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.121502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.121655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.121816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.121978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.122222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.122379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.122552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.122714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.122875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.123037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.123200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.123362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.123523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.123677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.123829 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.123992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.124146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.124300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.124452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.124615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.124805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.124984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.125181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.125339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.125499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.125499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.125789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.125956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.126117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.126286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.126524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.126695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.126855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.127020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.127182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.127182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.127480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.127480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.127792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.127792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.128091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.128252 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.128406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.128566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.128743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.128973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.129134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.129288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.129442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.129596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.129766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.129920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.130112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.130283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.130445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.130598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.130766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.130933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.131085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.131237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.131391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.131558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.131712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.131871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.132024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.132178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.132339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.132503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.132664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.132885 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.132885 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.133193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.133355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.133520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.133680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.133833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.133993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.134145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.134312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.134465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.134632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.134795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.134965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.135118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.135351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.135518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.135672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.135831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.135993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.136148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.136311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.136465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.136711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.136897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:13:33.137993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.137993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.139196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.139196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.139196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.139196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.139196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.139196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.139196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.139196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.140386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.140386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.140386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.140386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.140386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.140386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.140386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.140386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.141610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.141610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.141610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.141610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.141610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.141610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.141610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.141610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.142775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.142775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.142775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.142775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.142775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.142775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.142775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.142775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.143589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.143589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.143589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.143589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.143589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.143589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.144042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.144042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.144357 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.144660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.144996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.145299 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.145601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.145903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.146205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.146506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.146810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.147118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.147420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.147721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.148023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.148324 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.148625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.148979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.149315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.149630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.149952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.150263 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.150586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.151449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.151876 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.152197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.152517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.152857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.153196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.153507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.153821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.154133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.154449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.154759 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.155071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.155431 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.155722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.156028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.156352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.156668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.157011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.157458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.157639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.157954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.158264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.158574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.158883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.159205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.159500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.159815 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.160123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.160432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.160749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.161086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.161413 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.161740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.162049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.162373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.162699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.163052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.163364 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.163706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.164034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.164348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.164659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.164988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:13:33.165232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:13:33.192876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO dbcounter [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Registered counter for database nova_api Sep 01 05:13:33.219567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_db.sqlalchemy.engines [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:13:33.226291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writer thread running {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:13:33.230859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO dbcounter [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Registered counter for database nova_api Sep 01 05:13:33.251503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_db.sqlalchemy.engines [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:13:33.258011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writer thread running {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:13:33.282874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.context [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a090075-45e2-480a-a3b7-44373d134320(cell1) {{(pid=120673) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 05:13:33.286893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:33.287362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:33.288952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:33.289684 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:33.290123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:33.292147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:33.294139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO dbcounter [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Registered counter for database nova_cell0 Sep 01 05:13:33.298173 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO dbcounter [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Registered counter for database nova_cell1 Sep 01 05:13:33.305529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_db.sqlalchemy.engines [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:13:33.307886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_db.sqlalchemy.engines [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:13:33.313906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writer thread running {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:13:33.315316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.context [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a090075-45e2-480a-a3b7-44373d134320(cell1) {{(pid=120674) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 05:13:33.316306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writer thread running {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:13:33.319434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:33.319910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:33.321521 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:33.322251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:33.322704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:33.325282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:33.327259 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO dbcounter [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Registered counter for database nova_cell0 Sep 01 05:13:33.331303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO dbcounter [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Registered counter for database nova_cell1 Sep 01 05:13:33.338574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_db.sqlalchemy.engines [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:13:33.340399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_db.sqlalchemy.engines [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:13:33.346732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writer thread running {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:13:33.348001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writer thread running {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:13:33.464230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO dbcounter [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Registered counter for database nova_cell0 Sep 01 05:13:33.470729 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_db.sqlalchemy.engines [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:13:33.475068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writer thread running {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:13:33.495727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO dbcounter [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Registered counter for database nova_cell0 Sep 01 05:13:33.502954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_db.sqlalchemy.engines [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:13:33.507374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writer thread running {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:13:33.799550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: WARNING keystonemiddleware.auth_token [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:13:33.807699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: WARNING keystonemiddleware.auth_token [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:13:33.831995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: WARNING keystonemiddleware.auth_token [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:13:33.839916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: WARNING keystonemiddleware.auth_token [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:13:34.164064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: WARNING keystonemiddleware.auth_token [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:13:34.170727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: WARNING keystonemiddleware.auth_token [None req-89da359d-9268-4965-b142-2edd43a800a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:13:34.176061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636fe95b9c0 pid: 120673 (default app) Sep 01 05:13:34.194190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: WARNING keystonemiddleware.auth_token [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:13:34.201063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: WARNING keystonemiddleware.auth_token [None req-9df3534d-6cb1-45c8-a487-04c104c0589b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:13:34.206452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636fe95b9c0 pid: 120674 (default app) Sep 01 05:14:09.896738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=3 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:09.898062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=3 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:09.899335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=3 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:09.900205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=3 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:11.830671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e741f74d-e221-4f62-b96c-602abef9ecf3 tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] Action: 'create', calling method: .version_select at 0x7f9625c1e160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1784112510", "metadata": {"Type": "work"}}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:14.182994 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e741f74d-e221-4f62-b96c-602abef9ecf3 tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.317359 Sep 01 05:14:14.183944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1156 bytes} [Thu Sep 1 05:14:09 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4321 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 05:14:14.781700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-57734b3e-54ea-4239-b505-e4dc89f745ce tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] Calling method '.version_select at 0x7f9625ccb1f0>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:14.858498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:14.860789 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:14.864269 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:14.865439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:15.656916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-57734b3e-54ea-4239-b505-e4dc89f745ce tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2d645050-3f75-4d0e-8ad4-f48f6c76a9d0" status: 200 len: 354 microversion: 2.1 time: 1.461565 Sep 01 05:14:15.665068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1/2] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:14:14 2022] GET /compute/v2.1/os-volumes/2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 => generated 354 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:15.671661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0bc7fe81-89ec-4627-a805-c5992869e43d tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] Calling method '.version_select at 0x7f9625b00040>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:15.954304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0bc7fe81-89ec-4627-a805-c5992869e43d tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2d645050-3f75-4d0e-8ad4-f48f6c76a9d0" status: 200 len: 354 microversion: 2.1 time: 0.223446 Sep 01 05:14:15.954304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:14:15 2022] GET /compute/v2.1/os-volumes/2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 => generated 354 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:15.955326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a163de4b-f345-40f7-bad1-ebaacadca80b tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] Calling method '.version_select at 0x7f9625ae7040>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:16.454933 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a163de4b-f345-40f7-bad1-ebaacadca80b tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/2d645050-3f75-4d0e-8ad4-f48f6c76a9d0" status: 202 len: 0 microversion: 2.1 time: 0.551332 Sep 01 05:14:16.455628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1248 bytes} [Thu Sep 1 05:14:15 2022] DELETE /compute/v2.1/os-volumes/2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:14:16.465946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9042f21c-af0b-420a-9b91-6b7a7ddbc1c8 tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] Calling method '.version_select at 0x7f9625b00700>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:16.564758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9042f21c-af0b-420a-9b91-6b7a7ddbc1c8 tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2d645050-3f75-4d0e-8ad4-f48f6c76a9d0" status: 200 len: 353 microversion: 2.1 time: 0.104642 Sep 01 05:14:16.565381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:14:16 2022] GET /compute/v2.1/os-volumes/2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:17.586197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e9f693a0-f5f9-4101-8e41-75a0d776203a tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] Calling method '.version_select at 0x7f9625ae73a0>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:17.659644 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-e9f693a0-f5f9-4101-8e41-75a0d776203a tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] HTTP exception thrown: Volume 2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 could not be found. Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e9f693a0-f5f9-4101-8e41-75a0d776203a tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] Request method failure captured: Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/os-volumes/2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 HTTP/1.1 Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED-h0yC29Kmz778gJgrdyQKvlrVUvEqtvdUsMDWKP3DiOa07ab8W6j2YGxIm-AFIg92r-K1u8wnjPGqySywh4wiW9OwcAZ-wrQOEGuVUjAWdWusupgI0xPIrQJmITSlyy3edI3MTFddJYfsRj86pdG4xhrgqq_MM0n5pd-I6pBYfTdg Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 82c051ae37c7428990a79781587ad3cd Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-VolumesGetTestJSON-94045984 Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:14:17.672534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_82c051ae37c7428990a79781587ad3cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82c051ae37c7428990a79781587ad3cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82c051ae37c7428990a79781587ad3cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/82c051ae37c7428990a79781587ad3cd"}]}] Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-VolumesGetTestJSON-94045984 Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 82c051ae37c7428990a79781587ad3cd Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-VolumesGetTestJSON-94045984 Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-VolumesGetTestJSON-94045984-project Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: bbc897a686e3475ca3d09ed62a8f4020 Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-VolumesGetTestJSON-94045984-project Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Volume 2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 could not be found. Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '2d645050-3f75-4d0e-8ad4-f48f6c76a9d0'} Sep 01 05:14:17.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 could not be found. (HTTP 404) (Request-ID: req-22a87247-8eb0-437e-b2b7-d7bd2a668d31) Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:17.674614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:14:17.675706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 could not be found. Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:14:17.676689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:14:17.677610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 could not be found. Sep 01 05:14:17.677610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:17.677610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:17.677610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:17.677610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:17.677610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:17.677610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:17.677610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:14:17.677610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:14:17.677610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 could not be found. Sep 01 05:14:17.677610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:17.682005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e9f693a0-f5f9-4101-8e41-75a0d776203a tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] Returning 404 to user: Volume 2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:14:17.697087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e9f693a0-f5f9-4101-8e41-75a0d776203a tempest-VolumesGetTestJSON-94045984 tempest-VolumesGetTestJSON-94045984-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2d645050-3f75-4d0e-8ad4-f48f6c76a9d0" status: 404 len: 109 microversion: 2.1 time: 0.113420 Sep 01 05:14:17.699536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:14:17 2022] GET /compute/v2.1/os-volumes/2d645050-3f75-4d0e-8ad4-f48f6c76a9d0 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:14:23.291763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2102226776", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "networks": [{"uuid": "1876b76a-c6df-45ae-859d-9e6ea22a92e1"}]}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:23.403180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-45c1e469-5faf-4236-bec5-d9ae877cc7e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Action: 'create', calling method: .version_select at 0x7f9626341af0>, body: {"keypair": {"name": "tempest-keypair-511127826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtUphZFhvcfLJ1z8SEjQuCdqfopkg/yG5b7/tFAsOq+XX+N7GoFCnh+OFuTT/nAB0luP5cWm4xCvhE8iWLpgUMSINPJ55qu1jAc8R8qMXxa64zcAxdvjKMRxkAYNL7KAw=="}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:23.534188 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-45c1e469-5faf-4236-bec5-d9ae877cc7e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Getting quotas for project 3a33ba1fe1ff4325b80a02053b1db739. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:14:23.554000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-45c1e469-5faf-4236-bec5-d9ae877cc7e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Getting quotas for user d0b6981c4d53405fbe0395ccbcb9f015 and project 3a33ba1fe1ff4325b80a02053b1db739. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:14:23.596228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.network.neutron [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] validate_networks() for [('1876b76a-c6df-45ae-859d-9e6ea22a92e1', None, None, None, None, None)] {{(pid=120673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:14:23.672764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-45c1e469-5faf-4236-bec5-d9ae877cc7e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.483979 Sep 01 05:14:23.681392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 4/7] 10.222.0.49 () {62 vars in 1200 bytes} [Thu Sep 1 05:14:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 496 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 05:14:26.513804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Flavor limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:14:26.514325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Image limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:14:26.514910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Flavor pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:14:26.515432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Image pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:14:26.515952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:14:26.560516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:26.563128 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:26.565833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:26.566869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:26.569294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:26.572030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:26.708434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Getting quotas for project a8ac233deaa84df29af6140ec35f168e. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:14:26.745616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-52f1c40f-8058-4dfc-9903-9c380ef1a1a0 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] Calling method '.version_select at 0x7f9625a3e550>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:26.758940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Getting quotas for user 4bd370790538405c9e95f79126b5ea6b and project a8ac233deaa84df29af6140ec35f168e. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:14:26.810359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Going to run 1 instances... {{(pid=120673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:14:26.828795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:14:27.022041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-52f1c40f-8058-4dfc-9903-9c380ef1a1a0 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ca78ff3d-2386-417f-9f4a-be6c24be04f8" status: 200 len: 350 microversion: 2.1 time: 0.281007 Sep 01 05:14:27.029547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 5/8] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:14:26 2022] GET /compute/v2.1/os-volumes/ca78ff3d-2386-417f-9f4a-be6c24be04f8 => generated 350 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:27.088118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-861cc75e-f43c-4392-8485-4741c24a1262 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.752152 Sep 01 05:14:27.093438 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 4/9] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:14:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 4759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:14:27.101734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-33a24549-aa4e-4ab9-9817-3120920eafb1 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:27.102498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-33a24549-aa4e-4ab9-9817-3120920eafb1 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:27.451273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-33a24549-aa4e-4ab9-9817-3120920eafb1 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:27.488214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-33a24549-aa4e-4ab9-9817-3120920eafb1 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1215 microversion: 2.1 time: 0.391279 Sep 01 05:14:27.488805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 6/10] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:27 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1215 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:28.510977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ef160283-61cd-4a02-b830-36285ea59564 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:28.511674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ef160283-61cd-4a02-b830-36285ea59564 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:28.862428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ef160283-61cd-4a02-b830-36285ea59564 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:28.907807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ef160283-61cd-4a02-b830-36285ea59564 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1215 microversion: 2.1 time: 0.401564 Sep 01 05:14:28.927408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 5/11] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:28 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1215 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:29.165904 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1851a061-fbb6-4191-830b-b0b2fd392516 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] Calling method '.version_select at 0x7f96259ab430>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:29.300660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1851a061-fbb6-4191-830b-b0b2fd392516 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/a048f63a-2bc4-4818-a73f-13cf0fe25f0d" status: 200 len: 350 microversion: 2.1 time: 0.140441 Sep 01 05:14:29.301588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 7/12] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:14:29 2022] GET /compute/v2.1/os-volumes/a048f63a-2bc4-4818-a73f-13cf0fe25f0d => generated 350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:29.936953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-431138ca-9961-449c-a963-6b87fad8076e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:29.937595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-431138ca-9961-449c-a963-6b87fad8076e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:29.952160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-431138ca-9961-449c-a963-6b87fad8076e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:29.952851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-431138ca-9961-449c-a963-6b87fad8076e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:29.953283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-431138ca-9961-449c-a963-6b87fad8076e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:29.955586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-431138ca-9961-449c-a963-6b87fad8076e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:29.956303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-431138ca-9961-449c-a963-6b87fad8076e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:29.958390 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-431138ca-9961-449c-a963-6b87fad8076e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:30.358813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-431138ca-9961-449c-a963-6b87fad8076e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:30.379594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-431138ca-9961-449c-a963-6b87fad8076e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1211 microversion: 2.1 time: 0.448231 Sep 01 05:14:30.380209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 6/13] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:29 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1211 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:30.390146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ee89c9a5-a240-495b-b0f8-78ae5a8f295d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Action: 'create', calling method: .version_select at 0x7f96259b8040>, body: {"keypair": {"name": "tempest-keypair-466784186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwIzv+vJS/8W+dzbRgo1I+qbSEjt+sVZuWst5rRBw8/vb/k0Emvgux/bJ8CTibR2ttucNfz9eDMx5y/tPeTawwOo0KWfMAy1trfTa9E4Dpb4UYfeKrYgqKlTazk+X38BQ=="}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:30.441112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-ee89c9a5-a240-495b-b0f8-78ae5a8f295d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Getting quotas for project 6c302f5c44be49e5ae6e7e6b8b1f6c1c. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:14:30.459453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-ee89c9a5-a240-495b-b0f8-78ae5a8f295d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Getting quotas for user 11f90807029244ecb6ad7cf6e4d2ad80 and project 6c302f5c44be49e5ae6e7e6b8b1f6c1c. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:14:30.524379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ee89c9a5-a240-495b-b0f8-78ae5a8f295d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.504318 Sep 01 05:14:30.525371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 8/14] 10.222.0.49 () {60 vars in 1159 bytes} [Thu Sep 1 05:14:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:14:31.373610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-98b84345-fd18-4dc7-8a7b-2ef78c378917 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] Calling method '.version_select at 0x7f9625139f70>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:31.401556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5d8d8bf1-b49f-46cb-8a21-503d32ba258f tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:31.402172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5d8d8bf1-b49f-46cb-8a21-503d32ba258f tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:31.417338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d8d8bf1-b49f-46cb-8a21-503d32ba258f tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:31.417838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d8d8bf1-b49f-46cb-8a21-503d32ba258f tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:31.419778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d8d8bf1-b49f-46cb-8a21-503d32ba258f tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:31.420532 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d8d8bf1-b49f-46cb-8a21-503d32ba258f tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:31.421015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d8d8bf1-b49f-46cb-8a21-503d32ba258f tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:31.430122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d8d8bf1-b49f-46cb-8a21-503d32ba258f tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:31.479475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-98b84345-fd18-4dc7-8a7b-2ef78c378917 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d814dc99-eab7-40cb-a788-3722752e9588" status: 200 len: 351 microversion: 2.1 time: 0.109561 Sep 01 05:14:31.480054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 7/15] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:14:31 2022] GET /compute/v2.1/os-volumes/d814dc99-eab7-40cb-a788-3722752e9588 => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:31.492500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6e18703e-3083-444a-8652-134c392ba2d4 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] Calling method '.version_select at 0x7f96251bff70>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:31.696704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6e18703e-3083-444a-8652-134c392ba2d4 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.208141 Sep 01 05:14:31.697369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1134 bytes} [Thu Sep 1 05:14:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:31.800313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-207533895", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:31.913321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.network.neutron [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] validate_networks() for [('d1b53602-ae6c-4f58-9a76-532a80bdb8eb', None, None, None, None, None)] {{(pid=120673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:14:31.951368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5d8d8bf1-b49f-46cb-8a21-503d32ba258f tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:31.974016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5d8d8bf1-b49f-46cb-8a21-503d32ba258f tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1285 microversion: 2.1 time: 0.576124 Sep 01 05:14:31.992217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 9/17] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:31 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1285 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:32.009502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a5b6e373-9688-4fe8-b02c-85d78a0e0000 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] Calling method '.version_select at 0x7f96259ba8b0>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:32.261934 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a5b6e373-9688-4fe8-b02c-85d78a0e0000 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.266744 Sep 01 05:14:32.262402 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 10/18] 10.222.0.49 () {58 vars in 1149 bytes} [Thu Sep 1 05:14:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:32.269979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-238100282", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24d1646c-1d66-4fb4-a02e-ad0f17f6eef3"}], "security_groups": [{"name": "tempest-securitygroup--1101650041"}], "key_name": "tempest-keypair-511127826", "user_data": "}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:32.684895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.network.neutron [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] validate_networks() for [('24d1646c-1d66-4fb4-a02e-ad0f17f6eef3', None, None, None, None, None)] {{(pid=120674) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:14:34.177765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Flavor limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:14:34.178530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Image limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:14:34.178856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Flavor pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:14:34.179339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Image pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:14:34.179838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:14:34.202679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:34.207123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:34.209602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:34.217562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:34.217562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:34.217562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:34.294753 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Getting quotas for project db6e336d82254a9bafb2443958923d3d. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:14:34.314012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Getting quotas for user 3f7ca41b422f45a0a62af9fba781a796 and project db6e336d82254a9bafb2443958923d3d. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:14:34.360353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Going to run 1 instances... {{(pid=120673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:14:34.369362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:14:34.547172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8da3d4d7-f275-47b6-8e94-328f52cc84ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.848579 Sep 01 05:14:34.550037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 9/19] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:14:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:14:34.557134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3db927bd-2d05-4cbc-8277-264c9f9b6a5e tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] Calling method '.version_select at 0x7f962513f790>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:34.845686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3db927bd-2d05-4cbc-8277-264c9f9b6a5e tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.294181 Sep 01 05:14:34.847493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 10/20] 10.222.0.49 () {58 vars in 1134 bytes} [Thu Sep 1 05:14:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:34.861317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b77b9aef-337a-41a4-8dfa-96260f2469be tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:34.863426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b77b9aef-337a-41a4-8dfa-96260f2469be tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:34.878734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b77b9aef-337a-41a4-8dfa-96260f2469be tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:34.881350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b77b9aef-337a-41a4-8dfa-96260f2469be tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:34.883852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b77b9aef-337a-41a4-8dfa-96260f2469be tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:34.887253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b77b9aef-337a-41a4-8dfa-96260f2469be tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:34.888409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b77b9aef-337a-41a4-8dfa-96260f2469be tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:34.891958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b77b9aef-337a-41a4-8dfa-96260f2469be tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:35.586363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Flavor limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:14:35.587507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Image limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:14:35.588126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Flavor pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:14:35.588884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Image pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:14:35.589500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:14:35.630411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:35.631444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:35.633313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:35.636673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:35.637362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:35.637950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:35.711258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Getting quotas for project 3a33ba1fe1ff4325b80a02053b1db739. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:14:35.735434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Getting quotas for user d0b6981c4d53405fbe0395ccbcb9f015 and project 3a33ba1fe1ff4325b80a02053b1db739. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:14:35.766476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Going to run 1 instances... {{(pid=120674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:14:35.778245 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:14:35.953058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c83ad63a-a074-46a7-b009-3f636d254e6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.689344 Sep 01 05:14:35.953883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 11/21] 10.222.0.49 () {62 vars in 1188 bytes} [Thu Sep 1 05:14:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 3691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 05:14:35.967049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-016de3d7-162c-4e5b-a386-593e4e77d00d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:35.967742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-016de3d7-162c-4e5b-a386-593e4e77d00d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:36.303492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b77b9aef-337a-41a4-8dfa-96260f2469be tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:36.333553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b77b9aef-337a-41a4-8dfa-96260f2469be tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 1.484449 Sep 01 05:14:36.355496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 11/22] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:34 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:36.371197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-320f269f-b541-451d-830e-ec56c5f3037f tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] Calling method '.version_select at 0x7f96250ca4c0>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:36.467191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-016de3d7-162c-4e5b-a386-593e4e77d00d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:36.476746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-016de3d7-162c-4e5b-a386-593e4e77d00d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1221 microversion: 2.1 time: 0.521643 Sep 01 05:14:36.543307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 12/23] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:35 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1221 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:36.562899 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-73f29809-6718-46a7-8f12-980d615f5813 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:36.565145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-73f29809-6718-46a7-8f12-980d615f5813 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:36.709142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-320f269f-b541-451d-830e-ec56c5f3037f tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.351948 Sep 01 05:14:36.710883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 12/24] 10.222.0.49 () {58 vars in 1167 bytes} [Thu Sep 1 05:14:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:36.738949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-172e5b17-e9d9-45dd-81d5-a137a8cd2757 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] Calling method '.version_select at 0x7f9625098820>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:37.117420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-73f29809-6718-46a7-8f12-980d615f5813 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:37.121632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-172e5b17-e9d9-45dd-81d5-a137a8cd2757 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.400324 Sep 01 05:14:37.123036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 13/25] 10.222.0.49 () {58 vars in 1170 bytes} [Thu Sep 1 05:14:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:37.128270 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1719256028", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:37.135861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-73f29809-6718-46a7-8f12-980d615f5813 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:37.155630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-73f29809-6718-46a7-8f12-980d615f5813 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:37.164366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-73f29809-6718-46a7-8f12-980d615f5813 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1280 microversion: 2.20 time: 0.619504 Sep 01 05:14:37.200796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 13/26] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1280 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:14:37.220272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b18a3814-84f6-44b6-a259-ba038d0018c9 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] Calling method '.version_select at 0x7f962580f3a0>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:37.386642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.network.neutron [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] validate_networks() for [('d1b53602-ae6c-4f58-9a76-532a80bdb8eb', None, None, None, None, None)] {{(pid=120673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:14:37.519169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b18a3814-84f6-44b6-a259-ba038d0018c9 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.316641 Sep 01 05:14:37.520293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 14/27] 10.222.0.49 () {58 vars in 1155 bytes} [Thu Sep 1 05:14:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:37.525408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-85047161-7d74-4a63-801a-f46dbd925bef tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:37.526122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-85047161-7d74-4a63-801a-f46dbd925bef tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:37.560514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-85047161-7d74-4a63-801a-f46dbd925bef tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:37.561537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-85047161-7d74-4a63-801a-f46dbd925bef tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:37.563305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-85047161-7d74-4a63-801a-f46dbd925bef tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:37.564710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-85047161-7d74-4a63-801a-f46dbd925bef tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:37.569014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-85047161-7d74-4a63-801a-f46dbd925bef tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:37.574593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-85047161-7d74-4a63-801a-f46dbd925bef tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:38.244852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-85047161-7d74-4a63-801a-f46dbd925bef tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:38.257701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-85047161-7d74-4a63-801a-f46dbd925bef tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.732639 Sep 01 05:14:38.258445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 15/28] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:37 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:38.285566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-142b5496-6326-4ea7-81ed-b268218a4dbb tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] Calling method '.version_select at 0x7f9625818b80>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:38.567111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-142b5496-6326-4ea7-81ed-b268218a4dbb tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.307703 Sep 01 05:14:38.569260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 16/29] 10.222.0.49 () {58 vars in 1188 bytes} [Thu Sep 1 05:14:38 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:38.574736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9c2210a3-990e-440e-9e04-724ed3e51ba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:38.575647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9c2210a3-990e-440e-9e04-724ed3e51ba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:38.594712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c2210a3-990e-440e-9e04-724ed3e51ba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:38.595600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c2210a3-990e-440e-9e04-724ed3e51ba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:38.596255 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c2210a3-990e-440e-9e04-724ed3e51ba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:38.597271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c2210a3-990e-440e-9e04-724ed3e51ba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:38.597996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c2210a3-990e-440e-9e04-724ed3e51ba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:38.601839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c2210a3-990e-440e-9e04-724ed3e51ba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:38.805229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9c2210a3-990e-440e-9e04-724ed3e51ba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:38.826642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9c2210a3-990e-440e-9e04-724ed3e51ba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:38.828751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9c2210a3-990e-440e-9e04-724ed3e51ba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:38.830178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9c2210a3-990e-440e-9e04-724ed3e51ba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1276 microversion: 2.20 time: 0.259574 Sep 01 05:14:38.845368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 17/30] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:38 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1276 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:14:38.852634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1680792319", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28dd87ae-b139-4a92-8df3-d269621d39cb"}], "security_groups": [{"name": "tempest-securitygroup--1065899429"}], "key_name": "tempest-keypair-466784186", "user_data": "}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:39.260301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.network.neutron [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] validate_networks() for [('28dd87ae-b139-4a92-8df3-d269621d39cb', None, None, None, None, None)] {{(pid=120674) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:14:41.531125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Flavor limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:14:41.531772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Image limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:14:41.532385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Flavor pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:14:41.533365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Image pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:14:41.540971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:14:41.553955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:41.554797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:41.555499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:41.556690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:41.557404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:41.558064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:41.617054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Getting quotas for project db6e336d82254a9bafb2443958923d3d. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:14:41.622812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Getting quotas for user 3f7ca41b422f45a0a62af9fba781a796 and project db6e336d82254a9bafb2443958923d3d. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:14:41.643812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Going to run 1 instances... {{(pid=120673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:14:41.648245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:14:41.789699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Flavor limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:14:41.791877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Image limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:14:41.792677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Flavor pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:14:41.793421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Image pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:14:41.794058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:14:41.821640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:41.823280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:41.830614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:41.834266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:41.835222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:41.840793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:41.854646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-953bb0d2-46ef-40db-92e7-96e89344b977 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.730253 Sep 01 05:14:41.855289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 14/31] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:14:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 4732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:14:41.882632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-90645c18-18d9-4e98-93cc-794861db6a34 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] Calling method '.version_select at 0x7f9625098040>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:41.936828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Getting quotas for project 6c302f5c44be49e5ae6e7e6b8b1f6c1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:14:41.973734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Getting quotas for user 11f90807029244ecb6ad7cf6e4d2ad80 and project 6c302f5c44be49e5ae6e7e6b8b1f6c1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:14:42.024598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Going to run 1 instances... {{(pid=120674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:14:42.053503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:14:42.286680 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-93f10e26-f8c6-4a68-b868-64a21b10ec59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.439841 Sep 01 05:14:42.292474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 18/32] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:14:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 3446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:14:42.314853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6bab8754-7498-49e5-9a93-531af3c6cd99 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:42.315862 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6bab8754-7498-49e5-9a93-531af3c6cd99 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:42.323159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-90645c18-18d9-4e98-93cc-794861db6a34 tempest-VolumesTestJSON-1047759467 tempest-VolumesTestJSON-1047759467-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.454744 Sep 01 05:14:42.327112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6bab8754-7498-49e5-9a93-531af3c6cd99 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:42.329464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6bab8754-7498-49e5-9a93-531af3c6cd99 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:42.330251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6bab8754-7498-49e5-9a93-531af3c6cd99 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:42.332510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 15/33] 10.222.0.49 () {58 vars in 1155 bytes} [Thu Sep 1 05:14:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:42.338461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6276358b-aa78-45c0-9a9e-8fed8efb7058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:42.339075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6276358b-aa78-45c0-9a9e-8fed8efb7058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:42.348871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6bab8754-7498-49e5-9a93-531af3c6cd99 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:42.349732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6bab8754-7498-49e5-9a93-531af3c6cd99 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:42.353949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6bab8754-7498-49e5-9a93-531af3c6cd99 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:42.370546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6276358b-aa78-45c0-9a9e-8fed8efb7058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:42.392172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6276358b-aa78-45c0-9a9e-8fed8efb7058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:42.403530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6276358b-aa78-45c0-9a9e-8fed8efb7058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:42.404463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6276358b-aa78-45c0-9a9e-8fed8efb7058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:42.404978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6276358b-aa78-45c0-9a9e-8fed8efb7058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:42.405421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6276358b-aa78-45c0-9a9e-8fed8efb7058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:42.715794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6276358b-aa78-45c0-9a9e-8fed8efb7058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:42.755577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6276358b-aa78-45c0-9a9e-8fed8efb7058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:42.765033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6276358b-aa78-45c0-9a9e-8fed8efb7058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:42.772906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6276358b-aa78-45c0-9a9e-8fed8efb7058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1338 microversion: 2.20 time: 0.433594 Sep 01 05:14:42.804969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 16/34] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1338 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:14:42.820663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6cc187d2-c0ce-4899-9fd0-51742d251f6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:42.823409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6cc187d2-c0ce-4899-9fd0-51742d251f6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:43.275221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6cc187d2-c0ce-4899-9fd0-51742d251f6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:43.286720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6cc187d2-c0ce-4899-9fd0-51742d251f6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1222 microversion: 2.1 time: 0.479793 Sep 01 05:14:43.294462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 17/35] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:42 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1222 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:43.328059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0995213e-8a5f-4011-b69f-f9f7963ada11 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:43.328767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0995213e-8a5f-4011-b69f-f9f7963ada11 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:43.897331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0995213e-8a5f-4011-b69f-f9f7963ada11 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:43.912016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0995213e-8a5f-4011-b69f-f9f7963ada11 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1237 microversion: 2.1 time: 0.612716 Sep 01 05:14:43.914113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 18/36] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:43 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1237 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:44.401199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-37e891ab-ecfc-46c6-9ea0-ca650b0751c8 req-892e2c90-7c8a-408a-9338-b078370c5003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52140d99-84e5-4f90-bc00-1b9d431b8c52", "tag": "b4770713-261c-4b2a-9e65-3bb6e7b77741"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:44.448387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-37e891ab-ecfc-46c6-9ea0-ca650b0751c8 req-892e2c90-7c8a-408a-9338-b078370c5003 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.460652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-37e891ab-ecfc-46c6-9ea0-ca650b0751c8 req-892e2c90-7c8a-408a-9338-b078370c5003 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.461269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-37e891ab-ecfc-46c6-9ea0-ca650b0751c8 req-892e2c90-7c8a-408a-9338-b078370c5003 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:44.513078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-37e891ab-ecfc-46c6-9ea0-ca650b0751c8 req-892e2c90-7c8a-408a-9338-b078370c5003 service nova] Creating event network-changed:b4770713-261c-4b2a-9e65-3bb6e7b77741 for instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 on hv-cinder-85391 Sep 01 05:14:44.514011 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-37e891ab-ecfc-46c6-9ea0-ca650b0751c8 req-892e2c90-7c8a-408a-9338-b078370c5003 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 05:14:44.515957 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-37e891ab-ecfc-46c6-9ea0-ca650b0751c8 req-892e2c90-7c8a-408a-9338-b078370c5003 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 05:14:44.519139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d42b0e-59e4-4672-9a0b-ad481351804c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.522410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d42b0e-59e4-4672-9a0b-ad481351804c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.523216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d42b0e-59e4-4672-9a0b-ad481351804c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:44.524310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d42b0e-59e4-4672-9a0b-ad481351804c None None] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.527817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d42b0e-59e4-4672-9a0b-ad481351804c None None] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.528573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d42b0e-59e4-4672-9a0b-ad481351804c None None] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:44.559341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.compute.rpcapi [None req-46d42b0e-59e4-4672-9a0b-ad481351804c None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Sep 01 05:14:44.559341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d42b0e-59e4-4672-9a0b-ad481351804c None None] Releasing lock "compute-rpcapi-router" {{(pid=120673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 05:14:44.586183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-46d42b0e-59e4-4672-9a0b-ad481351804c None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.665928 Sep 01 05:14:44.587276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 19/37] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:44.596311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-847bf528-5f5d-4dcd-b7ec-8b379e9b9ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:44.597116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-847bf528-5f5d-4dcd-b7ec-8b379e9b9ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:44.616926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-847bf528-5f5d-4dcd-b7ec-8b379e9b9ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.617428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-847bf528-5f5d-4dcd-b7ec-8b379e9b9ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.617871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-847bf528-5f5d-4dcd-b7ec-8b379e9b9ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:44.618645 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-847bf528-5f5d-4dcd-b7ec-8b379e9b9ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.619105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-847bf528-5f5d-4dcd-b7ec-8b379e9b9ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.619533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-847bf528-5f5d-4dcd-b7ec-8b379e9b9ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:44.931746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6bab8754-7498-49e5-9a93-531af3c6cd99 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:44.944263 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6bab8754-7498-49e5-9a93-531af3c6cd99 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 2.650335 Sep 01 05:14:44.963646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 19/38] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:42 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 2670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:44.982596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fddb6c66-4667-4d97-b0ab-c6397d1d5e8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:44.993006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fddb6c66-4667-4d97-b0ab-c6397d1d5e8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:45.005302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=8 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:45.018558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fddb6c66-4667-4d97-b0ab-c6397d1d5e8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.019091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fddb6c66-4667-4d97-b0ab-c6397d1d5e8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.019542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fddb6c66-4667-4d97-b0ab-c6397d1d5e8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.021017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fddb6c66-4667-4d97-b0ab-c6397d1d5e8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.021759 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fddb6c66-4667-4d97-b0ab-c6397d1d5e8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.022207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fddb6c66-4667-4d97-b0ab-c6397d1d5e8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.043023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-847bf528-5f5d-4dcd-b7ec-8b379e9b9ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:45.066614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-847bf528-5f5d-4dcd-b7ec-8b379e9b9ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:45.090585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-847bf528-5f5d-4dcd-b7ec-8b379e9b9ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:45.094258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-847bf528-5f5d-4dcd-b7ec-8b379e9b9ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1338 microversion: 2.20 time: 0.505420 Sep 01 05:14:45.097083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 20/39] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1338 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:14:45.105580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9f1653ab-7c7b-4248-8940-657a9250f98d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:45.137467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9f1653ab-7c7b-4248-8940-657a9250f98d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:45.179146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f1653ab-7c7b-4248-8940-657a9250f98d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.180408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f1653ab-7c7b-4248-8940-657a9250f98d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.181637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f1653ab-7c7b-4248-8940-657a9250f98d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.186617 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f1653ab-7c7b-4248-8940-657a9250f98d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.190791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f1653ab-7c7b-4248-8940-657a9250f98d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.193869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f1653ab-7c7b-4248-8940-657a9250f98d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.449777 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fddb6c66-4667-4d97-b0ab-c6397d1d5e8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:45.465022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fddb6c66-4667-4d97-b0ab-c6397d1d5e8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1274 microversion: 2.1 time: 0.483700 Sep 01 05:14:45.466852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 20/40] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:44 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1274 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:45.670171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9f1653ab-7c7b-4248-8940-657a9250f98d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:45.701450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9f1653ab-7c7b-4248-8940-657a9250f98d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1289 microversion: 2.1 time: 0.591729 Sep 01 05:14:45.715527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 21/41] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:45 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1289 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:45.979259 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-82a601a3-224e-4c95-bf1b-e578700b6c7d tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:45.979259 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-82a601a3-224e-4c95-bf1b-e578700b6c7d tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:45.986594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-82a601a3-224e-4c95-bf1b-e578700b6c7d tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.996647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-82a601a3-224e-4c95-bf1b-e578700b6c7d tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.997261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-82a601a3-224e-4c95-bf1b-e578700b6c7d tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.998178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-82a601a3-224e-4c95-bf1b-e578700b6c7d tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.998785 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-82a601a3-224e-4c95-bf1b-e578700b6c7d tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.999383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-82a601a3-224e-4c95-bf1b-e578700b6c7d tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:46.125837 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3057333a-e923-4420-8978-d42f52af763f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:46.128061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3057333a-e923-4420-8978-d42f52af763f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:46.150222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3057333a-e923-4420-8978-d42f52af763f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:46.158636 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3057333a-e923-4420-8978-d42f52af763f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:46.159275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3057333a-e923-4420-8978-d42f52af763f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:46.160140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3057333a-e923-4420-8978-d42f52af763f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:46.163361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3057333a-e923-4420-8978-d42f52af763f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:46.169392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3057333a-e923-4420-8978-d42f52af763f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:46.937294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-82a601a3-224e-4c95-bf1b-e578700b6c7d tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:46.952260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-82a601a3-224e-4c95-bf1b-e578700b6c7d tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.982329 Sep 01 05:14:46.956048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 21/42] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:45 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:46.967102 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f7033c1a-dbee-471f-b5fe-66f2d96511b1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:46.970019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f7033c1a-dbee-471f-b5fe-66f2d96511b1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:46.987062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7033c1a-dbee-471f-b5fe-66f2d96511b1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:46.992160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7033c1a-dbee-471f-b5fe-66f2d96511b1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:46.993028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7033c1a-dbee-471f-b5fe-66f2d96511b1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:46.994142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7033c1a-dbee-471f-b5fe-66f2d96511b1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:46.995634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7033c1a-dbee-471f-b5fe-66f2d96511b1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:46.997264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7033c1a-dbee-471f-b5fe-66f2d96511b1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:47.341415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f7033c1a-dbee-471f-b5fe-66f2d96511b1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:47.351338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f7033c1a-dbee-471f-b5fe-66f2d96511b1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1280 microversion: 2.1 time: 0.393836 Sep 01 05:14:47.355373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 22/43] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:46 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1280 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:47.373797 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ff9741cd-d87b-4e1c-ba5e-f2bf353f5c02 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:47.374576 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ff9741cd-d87b-4e1c-ba5e-f2bf353f5c02 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:47.384241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff9741cd-d87b-4e1c-ba5e-f2bf353f5c02 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:47.387689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff9741cd-d87b-4e1c-ba5e-f2bf353f5c02 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:47.389200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff9741cd-d87b-4e1c-ba5e-f2bf353f5c02 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:47.391487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff9741cd-d87b-4e1c-ba5e-f2bf353f5c02 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:47.392112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff9741cd-d87b-4e1c-ba5e-f2bf353f5c02 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:47.394077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff9741cd-d87b-4e1c-ba5e-f2bf353f5c02 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:47.533445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3057333a-e923-4420-8978-d42f52af763f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:47.544765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3057333a-e923-4420-8978-d42f52af763f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:47.547066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3057333a-e923-4420-8978-d42f52af763f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:47.548222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3057333a-e923-4420-8978-d42f52af763f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 1.428672 Sep 01 05:14:47.550332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 22/44] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:14:47.566469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ff9741cd-d87b-4e1c-ba5e-f2bf353f5c02 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:47.580304 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ff9741cd-d87b-4e1c-ba5e-f2bf353f5c02 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1295 microversion: 2.1 time: 0.216336 Sep 01 05:14:47.581949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 23/45] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:47 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1295 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:47.981978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4eb4121b-2b2b-4615-9449-da05018b775e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:47.982821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4eb4121b-2b2b-4615-9449-da05018b775e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:47.998134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4eb4121b-2b2b-4615-9449-da05018b775e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:47.998695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4eb4121b-2b2b-4615-9449-da05018b775e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:47.999150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4eb4121b-2b2b-4615-9449-da05018b775e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:48.000047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4eb4121b-2b2b-4615-9449-da05018b775e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:48.000673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4eb4121b-2b2b-4615-9449-da05018b775e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:48.001235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4eb4121b-2b2b-4615-9449-da05018b775e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:48.385979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c41c6696-8b5f-4656-b6cc-527cffc460f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:48.387701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c41c6696-8b5f-4656-b6cc-527cffc460f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:48.400686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c41c6696-8b5f-4656-b6cc-527cffc460f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:48.401778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c41c6696-8b5f-4656-b6cc-527cffc460f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:48.403396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c41c6696-8b5f-4656-b6cc-527cffc460f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:48.404887 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c41c6696-8b5f-4656-b6cc-527cffc460f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:48.405628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c41c6696-8b5f-4656-b6cc-527cffc460f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:48.407467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c41c6696-8b5f-4656-b6cc-527cffc460f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:48.550251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4eb4121b-2b2b-4615-9449-da05018b775e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:48.560333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4eb4121b-2b2b-4615-9449-da05018b775e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.582531 Sep 01 05:14:48.576129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 23/46] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:47 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:48.581746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0364c2db-c106-470c-8cb7-c8f4949d221a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:48.582655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0364c2db-c106-470c-8cb7-c8f4949d221a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:48.588819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0364c2db-c106-470c-8cb7-c8f4949d221a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:48.589590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0364c2db-c106-470c-8cb7-c8f4949d221a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:48.590221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0364c2db-c106-470c-8cb7-c8f4949d221a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:48.591123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0364c2db-c106-470c-8cb7-c8f4949d221a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:48.591766 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0364c2db-c106-470c-8cb7-c8f4949d221a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:48.592393 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0364c2db-c106-470c-8cb7-c8f4949d221a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:48.604756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c41c6696-8b5f-4656-b6cc-527cffc460f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:48.615106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c41c6696-8b5f-4656-b6cc-527cffc460f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1280 microversion: 2.1 time: 0.237391 Sep 01 05:14:48.615717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 24/47] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:48 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:48.637327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-03215fa5-c6f0-4c72-8292-90f90b22a9bb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:48.638196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-03215fa5-c6f0-4c72-8292-90f90b22a9bb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:48.646122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03215fa5-c6f0-4c72-8292-90f90b22a9bb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:48.646907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03215fa5-c6f0-4c72-8292-90f90b22a9bb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:48.647540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03215fa5-c6f0-4c72-8292-90f90b22a9bb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:48.648445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03215fa5-c6f0-4c72-8292-90f90b22a9bb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:48.649092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03215fa5-c6f0-4c72-8292-90f90b22a9bb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:48.649715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03215fa5-c6f0-4c72-8292-90f90b22a9bb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:48.795655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-03215fa5-c6f0-4c72-8292-90f90b22a9bb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:48.806133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-03215fa5-c6f0-4c72-8292-90f90b22a9bb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1295 microversion: 2.1 time: 0.172430 Sep 01 05:14:48.807698 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 25/48] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:48 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1295 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:49.279115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-9150cbb6-3dbf-4ffc-bdbb-ce79213ca62e req-4e67f630-a875-4e17-9c70-4450ef654047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9edb178-d264-4269-ae85-e2b524170b64", "tag": "fe7dc8dd-0874-4433-84e8-a98124ba174e"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:49.295052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9150cbb6-3dbf-4ffc-bdbb-ce79213ca62e req-4e67f630-a875-4e17-9c70-4450ef654047 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:49.295817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9150cbb6-3dbf-4ffc-bdbb-ce79213ca62e req-4e67f630-a875-4e17-9c70-4450ef654047 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:49.296625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9150cbb6-3dbf-4ffc-bdbb-ce79213ca62e req-4e67f630-a875-4e17-9c70-4450ef654047 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:49.318722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-9150cbb6-3dbf-4ffc-bdbb-ce79213ca62e req-4e67f630-a875-4e17-9c70-4450ef654047 service nova] Creating event network-changed:fe7dc8dd-0874-4433-84e8-a98124ba174e for instance f9edb178-d264-4269-ae85-e2b524170b64 on hv-cinder-85391 Sep 01 05:14:49.320132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9150cbb6-3dbf-4ffc-bdbb-ce79213ca62e req-4e67f630-a875-4e17-9c70-4450ef654047 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120674) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 05:14:49.320526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9150cbb6-3dbf-4ffc-bdbb-ce79213ca62e req-4e67f630-a875-4e17-9c70-4450ef654047 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120674) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 05:14:49.321613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b797de5-2e50-4bb1-aa94-e3703199ab46 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:49.322069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b797de5-2e50-4bb1-aa94-e3703199ab46 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:49.322494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b797de5-2e50-4bb1-aa94-e3703199ab46 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:49.323208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b797de5-2e50-4bb1-aa94-e3703199ab46 None None] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:49.323830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b797de5-2e50-4bb1-aa94-e3703199ab46 None None] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:49.324319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b797de5-2e50-4bb1-aa94-e3703199ab46 None None] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:49.334355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.compute.rpcapi [None req-8b797de5-2e50-4bb1-aa94-e3703199ab46 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Sep 01 05:14:49.335253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b797de5-2e50-4bb1-aa94-e3703199ab46 None None] Releasing lock "compute-rpcapi-router" {{(pid=120674) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 05:14:49.353172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8b797de5-2e50-4bb1-aa94-e3703199ab46 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154840 Sep 01 05:14:49.353816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 26/49] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:49.386097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0364c2db-c106-470c-8cb7-c8f4949d221a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:49.398021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0364c2db-c106-470c-8cb7-c8f4949d221a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:49.400084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0364c2db-c106-470c-8cb7-c8f4949d221a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:49.401561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0364c2db-c106-470c-8cb7-c8f4949d221a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.823889 Sep 01 05:14:49.402421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 24/50] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:14:49.595183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-968cb29a-1bd9-4abb-a808-f4c48489a841 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:49.603391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-968cb29a-1bd9-4abb-a808-f4c48489a841 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:49.614401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-968cb29a-1bd9-4abb-a808-f4c48489a841 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:49.618327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-968cb29a-1bd9-4abb-a808-f4c48489a841 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:49.621894 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-968cb29a-1bd9-4abb-a808-f4c48489a841 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:49.624468 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-968cb29a-1bd9-4abb-a808-f4c48489a841 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:49.625974 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-968cb29a-1bd9-4abb-a808-f4c48489a841 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:49.627937 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-968cb29a-1bd9-4abb-a808-f4c48489a841 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:49.647605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dcbcf527-34ef-4be7-aae4-e4f21a634ff7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:49.649710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dcbcf527-34ef-4be7-aae4-e4f21a634ff7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:49.671621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dcbcf527-34ef-4be7-aae4-e4f21a634ff7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:49.673111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dcbcf527-34ef-4be7-aae4-e4f21a634ff7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:49.677075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dcbcf527-34ef-4be7-aae4-e4f21a634ff7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:49.678252 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dcbcf527-34ef-4be7-aae4-e4f21a634ff7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:49.678935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dcbcf527-34ef-4be7-aae4-e4f21a634ff7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:49.679580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dcbcf527-34ef-4be7-aae4-e4f21a634ff7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:50.291387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-968cb29a-1bd9-4abb-a808-f4c48489a841 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:50.299325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-968cb29a-1bd9-4abb-a808-f4c48489a841 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.717250 Sep 01 05:14:50.308290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 27/51] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:49 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:50.327376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6f21f7e6-b26e-44c3-9b7e-3eda75a8c79f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:50.328332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6f21f7e6-b26e-44c3-9b7e-3eda75a8c79f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:50.336118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f21f7e6-b26e-44c3-9b7e-3eda75a8c79f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:50.343734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f21f7e6-b26e-44c3-9b7e-3eda75a8c79f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:50.344525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f21f7e6-b26e-44c3-9b7e-3eda75a8c79f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:50.345808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f21f7e6-b26e-44c3-9b7e-3eda75a8c79f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:50.347672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f21f7e6-b26e-44c3-9b7e-3eda75a8c79f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:50.354199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f21f7e6-b26e-44c3-9b7e-3eda75a8c79f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:50.375110 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-dcbcf527-34ef-4be7-aae4-e4f21a634ff7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:50.387395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dcbcf527-34ef-4be7-aae4-e4f21a634ff7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.748202 Sep 01 05:14:50.388278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 25/52] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:49 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:50.424951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c6a54933-097f-4fd2-bd71-50cd6bfe19f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:50.425846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c6a54933-097f-4fd2-bd71-50cd6bfe19f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:50.436040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6a54933-097f-4fd2-bd71-50cd6bfe19f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:50.437920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6a54933-097f-4fd2-bd71-50cd6bfe19f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:50.438556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6a54933-097f-4fd2-bd71-50cd6bfe19f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:50.440050 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6a54933-097f-4fd2-bd71-50cd6bfe19f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:50.441806 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6a54933-097f-4fd2-bd71-50cd6bfe19f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:50.443413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6a54933-097f-4fd2-bd71-50cd6bfe19f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:50.880549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6f21f7e6-b26e-44c3-9b7e-3eda75a8c79f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:50.898104 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6f21f7e6-b26e-44c3-9b7e-3eda75a8c79f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.575506 Sep 01 05:14:50.898872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 28/53] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:50 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:50.980368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c6a54933-097f-4fd2-bd71-50cd6bfe19f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:50.992242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c6a54933-097f-4fd2-bd71-50cd6bfe19f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:50.995729 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c6a54933-097f-4fd2-bd71-50cd6bfe19f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:50.997495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c6a54933-097f-4fd2-bd71-50cd6bfe19f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.576519 Sep 01 05:14:50.999735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 26/54] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:14:51.335044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3e826b68-576f-44c4-9be9-e0ca1a8f47aa tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:51.335731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3e826b68-576f-44c4-9be9-e0ca1a8f47aa tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:51.346803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3e826b68-576f-44c4-9be9-e0ca1a8f47aa tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:51.349352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3e826b68-576f-44c4-9be9-e0ca1a8f47aa tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:51.350583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3e826b68-576f-44c4-9be9-e0ca1a8f47aa tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:51.353701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3e826b68-576f-44c4-9be9-e0ca1a8f47aa tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:51.355000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3e826b68-576f-44c4-9be9-e0ca1a8f47aa tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:51.355655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3e826b68-576f-44c4-9be9-e0ca1a8f47aa tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:51.410290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5a7c1e2b-6350-4133-b138-ac9cdf176ed8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:51.411904 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5a7c1e2b-6350-4133-b138-ac9cdf176ed8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:51.427333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a7c1e2b-6350-4133-b138-ac9cdf176ed8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:51.429715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a7c1e2b-6350-4133-b138-ac9cdf176ed8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:51.432370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a7c1e2b-6350-4133-b138-ac9cdf176ed8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:51.434995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a7c1e2b-6350-4133-b138-ac9cdf176ed8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:51.435671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a7c1e2b-6350-4133-b138-ac9cdf176ed8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:51.437142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a7c1e2b-6350-4133-b138-ac9cdf176ed8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:51.674374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3e826b68-576f-44c4-9be9-e0ca1a8f47aa tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:51.684503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3e826b68-576f-44c4-9be9-e0ca1a8f47aa tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.355037 Sep 01 05:14:51.685137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 29/55] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:51 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:51.690679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5a7c1e2b-6350-4133-b138-ac9cdf176ed8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:51.703919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-f9513ce0-fc30-457d-aca1-6bc08ba8ade8 req-bb2b74bc-1467-49dc-ad42-baf2a3ae1509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a582556-d184-4047-ac19-285c0edd2fdf", "tag": "6e571bd8-c64a-432f-894b-026d58cce109"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:51.706803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5a7c1e2b-6350-4133-b138-ac9cdf176ed8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.301146 Sep 01 05:14:51.724437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-f9513ce0-fc30-457d-aca1-6bc08ba8ade8 req-bb2b74bc-1467-49dc-ad42-baf2a3ae1509 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:51.724437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-f9513ce0-fc30-457d-aca1-6bc08ba8ade8 req-bb2b74bc-1467-49dc-ad42-baf2a3ae1509 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:51.724752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 27/56] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:51 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:51.724863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-f9513ce0-fc30-457d-aca1-6bc08ba8ade8 req-bb2b74bc-1467-49dc-ad42-baf2a3ae1509 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:51.731664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-91e5c058-6813-4d80-aeba-cca8048b8230 req-4f5a5daf-9307-4add-820c-aaaf2dbd0c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "266d4ced-afe8-4d91-a857-192e9315a28e", "tag": "0d853372-0a5c-486f-98d3-6a3c853acda7"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:51.745480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-f9513ce0-fc30-457d-aca1-6bc08ba8ade8 req-bb2b74bc-1467-49dc-ad42-baf2a3ae1509 service nova] Creating event network-changed:6e571bd8-c64a-432f-894b-026d58cce109 for instance 2a582556-d184-4047-ac19-285c0edd2fdf on hv-cinder-85391 Sep 01 05:14:51.747624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-91e5c058-6813-4d80-aeba-cca8048b8230 req-4f5a5daf-9307-4add-820c-aaaf2dbd0c16 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:51.748266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-91e5c058-6813-4d80-aeba-cca8048b8230 req-4f5a5daf-9307-4add-820c-aaaf2dbd0c16 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:51.752034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-91e5c058-6813-4d80-aeba-cca8048b8230 req-4f5a5daf-9307-4add-820c-aaaf2dbd0c16 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:51.758546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-f9513ce0-fc30-457d-aca1-6bc08ba8ade8 req-bb2b74bc-1467-49dc-ad42-baf2a3ae1509 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058173 Sep 01 05:14:51.759383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 30/57] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:51.766772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-91e5c058-6813-4d80-aeba-cca8048b8230 req-4f5a5daf-9307-4add-820c-aaaf2dbd0c16 service nova] Creating event network-changed:0d853372-0a5c-486f-98d3-6a3c853acda7 for instance 266d4ced-afe8-4d91-a857-192e9315a28e on hv-cinder-85391 Sep 01 05:14:51.774301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-91e5c058-6813-4d80-aeba-cca8048b8230 req-4f5a5daf-9307-4add-820c-aaaf2dbd0c16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054181 Sep 01 05:14:51.774931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 28/58] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:51.921706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4c6d1aac-0446-45aa-a0a0-9f7c4c1c84e1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:51.922665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4c6d1aac-0446-45aa-a0a0-9f7c4c1c84e1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:51.935962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4c6d1aac-0446-45aa-a0a0-9f7c4c1c84e1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:51.936486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4c6d1aac-0446-45aa-a0a0-9f7c4c1c84e1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:51.938316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4c6d1aac-0446-45aa-a0a0-9f7c4c1c84e1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:51.940282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4c6d1aac-0446-45aa-a0a0-9f7c4c1c84e1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:51.941115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4c6d1aac-0446-45aa-a0a0-9f7c4c1c84e1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:51.942602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4c6d1aac-0446-45aa-a0a0-9f7c4c1c84e1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:51.986016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=26 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:52.126534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-acdf9fc4-2368-4926-b9f7-dc39978ac053 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Action: 'create', calling method: .version_select at 0x7f9625825700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1674492865", "metadata": {"Type": "work"}}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-acdf9fc4-2368-4926-b9f7-dc39978ac053 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Request method failure captured: Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 122 Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED_LTndJIpGLGqhx0GLQqGiCMy4PpScHyyD6rfJ5O1PNF_VvQRMjnymiOOI0EwVLeZTPql-LV4qF34Asli5lJiXVwa_V8ipTFhZtF0JhsXbWMuVjrp4xurUkPd9QwBn6SBf0kPnPIK3xHZHl1MVIxFJkk5sjzm5xEXCW3dp5uyBb6LA Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 6cd5b34bd05c40548678f761b5db1775 Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:14:52.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cd5b34bd05c40548678f761b5db1775", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd5b34bd05c40548678f761b5db1775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd5b34bd05c40548678f761b5db1775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cd5b34bd05c40548678f761b5db1775"}]}] Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 6cd5b34bd05c40548678f761b5db1775 Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-VolumesNegativeTest-598999722-project Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 30737e610b68429c91aed639104e59a3 Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-VolumesNegativeTest-598999722-project Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1674492865", "metadata": {"Type": "work"}}} Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: Sep 01 05:14:52.146234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1674492865', 'metadata': {'Type': 'work'}}}} Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:14:52.147129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:14:52.148552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:14:52.150629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 05:14:52.150629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.150629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-acdf9fc4-2368-4926-b9f7-dc39978ac053 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:14:52.151644 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-acdf9fc4-2368-4926-b9f7-dc39978ac053 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.342247 Sep 01 05:14:52.152530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 31/59] 10.222.0.49 () {60 vars in 1156 bytes} [Thu Sep 1 05:14:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 344 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:14:52.158329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-39da83a0-24bc-48b2-af57-e4c8cf3f6b59 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:52.159620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-39da83a0-24bc-48b2-af57-e4c8cf3f6b59 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:52.169896 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39da83a0-24bc-48b2-af57-e4c8cf3f6b59 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:52.170802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39da83a0-24bc-48b2-af57-e4c8cf3f6b59 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:52.171739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39da83a0-24bc-48b2-af57-e4c8cf3f6b59 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:52.172672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39da83a0-24bc-48b2-af57-e4c8cf3f6b59 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:52.174888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39da83a0-24bc-48b2-af57-e4c8cf3f6b59 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:52.175652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39da83a0-24bc-48b2-af57-e4c8cf3f6b59 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:52.588439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-39da83a0-24bc-48b2-af57-e4c8cf3f6b59 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:52.596751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-39da83a0-24bc-48b2-af57-e4c8cf3f6b59 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:52.598821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-39da83a0-24bc-48b2-af57-e4c8cf3f6b59 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:52.604850 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-39da83a0-24bc-48b2-af57-e4c8cf3f6b59 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.450893 Sep 01 05:14:52.621952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 32/60] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:14:52.632296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-34b48b2c-e688-476b-a3da-228eb95b380f tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Action: 'create', calling method: .version_select at 0x7f9625825550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-715698108", "metadata": {"Type": "work"}}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-34b48b2c-e688-476b-a3da-228eb95b380f tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Request method failure captured: Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 119 Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED_LTndJIpGLGqhx0GLQqGiCMy4PpScHyyD6rfJ5O1PNF_VvQRMjnymiOOI0EwVLeZTPql-LV4qF34Asli5lJiXVwa_V8ipTFhZtF0JhsXbWMuVjrp4xurUkPd9QwBn6SBf0kPnPIK3xHZHl1MVIxFJkk5sjzm5xEXCW3dp5uyBb6LA Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 6cd5b34bd05c40548678f761b5db1775 Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:14:52.654845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cd5b34bd05c40548678f761b5db1775", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd5b34bd05c40548678f761b5db1775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd5b34bd05c40548678f761b5db1775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cd5b34bd05c40548678f761b5db1775"}]}] Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 6cd5b34bd05c40548678f761b5db1775 Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-VolumesNegativeTest-598999722-project Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 30737e610b68429c91aed639104e59a3 Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-VolumesNegativeTest-598999722-project Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-715698108", "metadata": {"Type": "work"}}} Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: Sep 01 05:14:52.656218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-715698108', 'metadata': {'Type': 'work'}}}} Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi '0' Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:14:52.657150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:14:52.658452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:14:52.659573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 05:14:52.659573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.661240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-34b48b2c-e688-476b-a3da-228eb95b380f tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:14:52.662269 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-34b48b2c-e688-476b-a3da-228eb95b380f tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.039164 Sep 01 05:14:52.662985 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 33/61] 10.222.0.49 () {60 vars in 1156 bytes} [Thu Sep 1 05:14:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:14:52.675244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7e8b44ee-3bae-4613-8dc4-98a1ca5bfb32 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Action: 'create', calling method: .version_select at 0x7f9625830700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1238842875", "metadata": {"Type": "work"}}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:52.683436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4c6d1aac-0446-45aa-a0a0-9f7c4c1c84e1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:52.686102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=83 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7e8b44ee-3bae-4613-8dc4-98a1ca5bfb32 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Request method failure captured: Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 119 Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED_LTndJIpGLGqhx0GLQqGiCMy4PpScHyyD6rfJ5O1PNF_VvQRMjnymiOOI0EwVLeZTPql-LV4qF34Asli5lJiXVwa_V8ipTFhZtF0JhsXbWMuVjrp4xurUkPd9QwBn6SBf0kPnPIK3xHZHl1MVIxFJkk5sjzm5xEXCW3dp5uyBb6LA Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 6cd5b34bd05c40548678f761b5db1775 Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:14:52.688350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cd5b34bd05c40548678f761b5db1775", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd5b34bd05c40548678f761b5db1775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd5b34bd05c40548678f761b5db1775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cd5b34bd05c40548678f761b5db1775"}]}] Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 6cd5b34bd05c40548678f761b5db1775 Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-VolumesNegativeTest-598999722-project Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 30737e610b68429c91aed639104e59a3 Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-VolumesNegativeTest-598999722-project Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1238842875", "metadata": {"Type": "work"}}} Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: Sep 01 05:14:52.689628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1238842875', 'metadata': {'Type': 'work'}}}} Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi '' Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:14:52.690621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:14:52.692296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:14:52.693653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 05:14:52.693653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.694779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7e8b44ee-3bae-4613-8dc4-98a1ca5bfb32 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:14:52.695779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7e8b44ee-3bae-4613-8dc4-98a1ca5bfb32 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026033 Sep 01 05:14:52.697548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 34/62] 10.222.0.49 () {60 vars in 1156 bytes} [Thu Sep 1 05:14:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 05:14:52.705032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4c6d1aac-0446-45aa-a0a0-9f7c4c1c84e1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.787438 Sep 01 05:14:52.706747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 29/63] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:51 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:52.721714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-10cf3a5e-f180-43fa-bb0c-a0e72527532b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:52.721875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0d5f1bc3-b3d5-40f2-950a-417bc9a62754 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Calling method '.version_select at 0x7f9624ff7b80>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:52.722636 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-10cf3a5e-f180-43fa-bb0c-a0e72527532b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:52.734010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:52.739178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10cf3a5e-f180-43fa-bb0c-a0e72527532b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:52.741793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10cf3a5e-f180-43fa-bb0c-a0e72527532b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:52.742533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10cf3a5e-f180-43fa-bb0c-a0e72527532b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:52.760195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10cf3a5e-f180-43fa-bb0c-a0e72527532b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:52.761581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10cf3a5e-f180-43fa-bb0c-a0e72527532b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:52.764976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10cf3a5e-f180-43fa-bb0c-a0e72527532b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:52.800633 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-0d5f1bc3-b3d5-40f2-950a-417bc9a62754 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] HTTP exception thrown: Volume tempest-invalid-968747062 could not be found. Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0d5f1bc3-b3d5-40f2-950a-417bc9a62754 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Request method failure captured: Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-968747062 HTTP/1.1 Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED_LTndJIpGLGqhx0GLQqGiCMy4PpScHyyD6rfJ5O1PNF_VvQRMjnymiOOI0EwVLeZTPql-LV4qF34Asli5lJiXVwa_V8ipTFhZtF0JhsXbWMuVjrp4xurUkPd9QwBn6SBf0kPnPIK3xHZHl1MVIxFJkk5sjzm5xEXCW3dp5uyBb6LA Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 6cd5b34bd05c40548678f761b5db1775 Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:14:52.803311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cd5b34bd05c40548678f761b5db1775", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd5b34bd05c40548678f761b5db1775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd5b34bd05c40548678f761b5db1775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cd5b34bd05c40548678f761b5db1775"}]}] Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 6cd5b34bd05c40548678f761b5db1775 Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-VolumesNegativeTest-598999722-project Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 30737e610b68429c91aed639104e59a3 Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-VolumesNegativeTest-598999722-project Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Volume tempest-invalid-968747062 could not be found. Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': 'tempest-invalid-968747062'} Sep 01 05:14:52.804584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-968747062 could not be found. (HTTP 404) (Request-ID: req-f9785826-51aa-45b0-b9fe-7b5531409a7b) Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:52.805368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:14:52.806582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-968747062 could not be found. Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:14:52.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-968747062 could not be found. Sep 01 05:14:52.809029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.809029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:52.809029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.809029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:52.809029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:52.809029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:52.809029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:14:52.809029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:14:52.809029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-968747062 could not be found. Sep 01 05:14:52.809029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:52.810803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0d5f1bc3-b3d5-40f2-950a-417bc9a62754 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Returning 404 to user: Volume tempest-invalid-968747062 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:14:52.811795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0d5f1bc3-b3d5-40f2-950a-417bc9a62754 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-968747062" status: 404 len: 98 microversion: 2.1 time: 0.109151 Sep 01 05:14:52.812869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 35/64] 10.222.0.49 () {58 vars in 1215 bytes} [Thu Sep 1 05:14:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-968747062 => generated 98 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:14:52.824634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-df8852cf-5f9a-4165-a04f-2e608045fcf6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:52.825607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-df8852cf-5f9a-4165-a04f-2e608045fcf6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:52.839997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df8852cf-5f9a-4165-a04f-2e608045fcf6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:52.840663 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df8852cf-5f9a-4165-a04f-2e608045fcf6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:52.841282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df8852cf-5f9a-4165-a04f-2e608045fcf6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:52.848552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df8852cf-5f9a-4165-a04f-2e608045fcf6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:52.849423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df8852cf-5f9a-4165-a04f-2e608045fcf6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:52.850077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df8852cf-5f9a-4165-a04f-2e608045fcf6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:53.159650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-df8852cf-5f9a-4165-a04f-2e608045fcf6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:53.163613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:53.168602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-df8852cf-5f9a-4165-a04f-2e608045fcf6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.354479 Sep 01 05:14:53.188009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 36/65] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:52 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:53.193697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ced2e884-3473-4db6-a01d-2bc99ea77570 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004259 Sep 01 05:14:53.194500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 37/66] 10.222.0.49 () {58 vars in 1140 bytes} [Thu Sep 1 05:14:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 05:14:53.204256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-eb0b8eb5-1a0a-4db6-af1c-afed13f5a056 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004342 Sep 01 05:14:53.205446 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 38/67] 10.222.0.49 () {58 vars in 1137 bytes} [Thu Sep 1 05:14:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 05:14:53.215615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ce758020-3532-4ef6-927c-1524b5767b22 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Calling method '.version_select at 0x7f96258dac10>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:53.218598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-10cf3a5e-f180-43fa-bb0c-a0e72527532b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:53.232758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-10cf3a5e-f180-43fa-bb0c-a0e72527532b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.521704 Sep 01 05:14:53.233786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 30/68] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:52 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:53.254004 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-ce758020-3532-4ef6-927c-1524b5767b22 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] HTTP exception thrown: Volume f6c3d886-3c4d-4ec7-9ef2-2b0750244e28 could not be found. Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ce758020-3532-4ef6-927c-1524b5767b22 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Request method failure captured: Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/os-volumes/f6c3d886-3c4d-4ec7-9ef2-2b0750244e28 HTTP/1.1 Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED_LTndJIpGLGqhx0GLQqGiCMy4PpScHyyD6rfJ5O1PNF_VvQRMjnymiOOI0EwVLeZTPql-LV4qF34Asli5lJiXVwa_V8ipTFhZtF0JhsXbWMuVjrp4xurUkPd9QwBn6SBf0kPnPIK3xHZHl1MVIxFJkk5sjzm5xEXCW3dp5uyBb6LA Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 6cd5b34bd05c40548678f761b5db1775 Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:14:53.256513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cd5b34bd05c40548678f761b5db1775", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd5b34bd05c40548678f761b5db1775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd5b34bd05c40548678f761b5db1775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cd5b34bd05c40548678f761b5db1775"}]}] Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 6cd5b34bd05c40548678f761b5db1775 Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-VolumesNegativeTest-598999722-project Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 30737e610b68429c91aed639104e59a3 Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-VolumesNegativeTest-598999722-project Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Volume f6c3d886-3c4d-4ec7-9ef2-2b0750244e28 could not be found. Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': 'f6c3d886-3c4d-4ec7-9ef2-2b0750244e28'} Sep 01 05:14:53.257820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6c3d886-3c4d-4ec7-9ef2-2b0750244e28 could not be found. (HTTP 404) (Request-ID: req-73ff1c49-2e40-4aac-a372-bca9a9ac27c6) Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:53.258851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:14:53.260137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6c3d886-3c4d-4ec7-9ef2-2b0750244e28 could not be found. Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 05:14:53.261664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:14:53.262694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6c3d886-3c4d-4ec7-9ef2-2b0750244e28 could not be found. Sep 01 05:14:53.262694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.262694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:53.262694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.262694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:53.262694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:53.262694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:53.262694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:14:53.262694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:14:53.262694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6c3d886-3c4d-4ec7-9ef2-2b0750244e28 could not be found. Sep 01 05:14:53.262694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.265297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ce758020-3532-4ef6-927c-1524b5767b22 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Returning 404 to user: Volume f6c3d886-3c4d-4ec7-9ef2-2b0750244e28 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:14:53.266394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ce758020-3532-4ef6-927c-1524b5767b22 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/f6c3d886-3c4d-4ec7-9ef2-2b0750244e28" status: 404 len: 109 microversion: 2.1 time: 0.055564 Sep 01 05:14:53.267112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 39/69] 10.222.0.49 () {58 vars in 1248 bytes} [Thu Sep 1 05:14:53 2022] DELETE /compute/v2.1/os-volumes/f6c3d886-3c4d-4ec7-9ef2-2b0750244e28 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:14:53.277175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e321f277-b248-4512-a3d9-e141bc4e0d94 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Calling method '.version_select at 0x7f96250bbe50>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:53.315556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-e321f277-b248-4512-a3d9-e141bc4e0d94 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] HTTP exception thrown: Volume 27d5bc7f-36a5-4b2e-9c5c-efeddd18b08a could not be found. Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e321f277-b248-4512-a3d9-e141bc4e0d94 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Request method failure captured: Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/os-volumes/27d5bc7f-36a5-4b2e-9c5c-efeddd18b08a HTTP/1.1 Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED_LTndJIpGLGqhx0GLQqGiCMy4PpScHyyD6rfJ5O1PNF_VvQRMjnymiOOI0EwVLeZTPql-LV4qF34Asli5lJiXVwa_V8ipTFhZtF0JhsXbWMuVjrp4xurUkPd9QwBn6SBf0kPnPIK3xHZHl1MVIxFJkk5sjzm5xEXCW3dp5uyBb6LA Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 6cd5b34bd05c40548678f761b5db1775 Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:14:53.321922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cd5b34bd05c40548678f761b5db1775", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd5b34bd05c40548678f761b5db1775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cd5b34bd05c40548678f761b5db1775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cd5b34bd05c40548678f761b5db1775"}]}] Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 6cd5b34bd05c40548678f761b5db1775 Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-VolumesNegativeTest-598999722 Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-VolumesNegativeTest-598999722-project Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 30737e610b68429c91aed639104e59a3 Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-VolumesNegativeTest-598999722-project Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Volume 27d5bc7f-36a5-4b2e-9c5c-efeddd18b08a could not be found. Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '27d5bc7f-36a5-4b2e-9c5c-efeddd18b08a'} Sep 01 05:14:53.323383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27d5bc7f-36a5-4b2e-9c5c-efeddd18b08a could not be found. (HTTP 404) (Request-ID: req-853b0eea-f182-416d-91de-b59c6b403b87) Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:53.324360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:14:53.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27d5bc7f-36a5-4b2e-9c5c-efeddd18b08a could not be found. Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:14:53.327392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:14:53.328865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27d5bc7f-36a5-4b2e-9c5c-efeddd18b08a could not be found. Sep 01 05:14:53.328865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.328865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:53.328865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.328865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:53.328865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:53.328865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:53.328865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:14:53.328865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:14:53.328865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27d5bc7f-36a5-4b2e-9c5c-efeddd18b08a could not be found. Sep 01 05:14:53.328865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.336967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e321f277-b248-4512-a3d9-e141bc4e0d94 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] Returning 404 to user: Volume 27d5bc7f-36a5-4b2e-9c5c-efeddd18b08a could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:14:53.336967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e321f277-b248-4512-a3d9-e141bc4e0d94 tempest-VolumesNegativeTest-598999722 tempest-VolumesNegativeTest-598999722-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/27d5bc7f-36a5-4b2e-9c5c-efeddd18b08a" status: 404 len: 109 microversion: 2.1 time: 0.058894 Sep 01 05:14:53.336967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 31/70] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:14:53 2022] GET /compute/v2.1/os-volumes/27d5bc7f-36a5-4b2e-9c5c-efeddd18b08a => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:14:53.636876 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-244e5a7b-4462-4c9d-90e7-7e385cf4abdd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:53.637664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-244e5a7b-4462-4c9d-90e7-7e385cf4abdd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:53.650291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-244e5a7b-4462-4c9d-90e7-7e385cf4abdd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:53.650955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-244e5a7b-4462-4c9d-90e7-7e385cf4abdd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:53.651378 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-244e5a7b-4462-4c9d-90e7-7e385cf4abdd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:53.652235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-244e5a7b-4462-4c9d-90e7-7e385cf4abdd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:53.652845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-244e5a7b-4462-4c9d-90e7-7e385cf4abdd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:53.653509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-244e5a7b-4462-4c9d-90e7-7e385cf4abdd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:53.732221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e8c6582e-4ea3-4e6c-89ef-34a652b85add tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:53.734183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e8c6582e-4ea3-4e6c-89ef-34a652b85add tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:53.744754 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8c6582e-4ea3-4e6c-89ef-34a652b85add tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:53.745273 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8c6582e-4ea3-4e6c-89ef-34a652b85add tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:53.745706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8c6582e-4ea3-4e6c-89ef-34a652b85add tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:53.746409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8c6582e-4ea3-4e6c-89ef-34a652b85add tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:53.746857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8c6582e-4ea3-4e6c-89ef-34a652b85add tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:53.747278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8c6582e-4ea3-4e6c-89ef-34a652b85add tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:53.904913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=24 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:53.933596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-244e5a7b-4462-4c9d-90e7-7e385cf4abdd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:53.948765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-244e5a7b-4462-4c9d-90e7-7e385cf4abdd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:53.949098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e8c6582e-4ea3-4e6c-89ef-34a652b85add tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:53.950261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-244e5a7b-4462-4c9d-90e7-7e385cf4abdd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:53.952205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-244e5a7b-4462-4c9d-90e7-7e385cf4abdd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.319107 Sep 01 05:14:53.952836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 40/71] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:14:53.957056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e8c6582e-4ea3-4e6c-89ef-34a652b85add tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.232610 Sep 01 05:14:53.958408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 32/72] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:53 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:53.958852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-5ec683ae-5db5-4a12-a327-0e6ad2680cc7 req-189e6806-678b-4ceb-a3ba-cc97417c13f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3674edea-d05c-428c-896e-938f3891acc1", "tag": "b84e0a09-0be3-4d95-aaaa-b1217f2ba513"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:53.968737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5ec683ae-5db5-4a12-a327-0e6ad2680cc7 req-189e6806-678b-4ceb-a3ba-cc97417c13f2 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:53.969246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5ec683ae-5db5-4a12-a327-0e6ad2680cc7 req-189e6806-678b-4ceb-a3ba-cc97417c13f2 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:53.969670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5ec683ae-5db5-4a12-a327-0e6ad2680cc7 req-189e6806-678b-4ceb-a3ba-cc97417c13f2 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:53.983763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-5ec683ae-5db5-4a12-a327-0e6ad2680cc7 req-189e6806-678b-4ceb-a3ba-cc97417c13f2 service nova] Creating event network-changed:b84e0a09-0be3-4d95-aaaa-b1217f2ba513 for instance 3674edea-d05c-428c-896e-938f3891acc1 on hv-cinder-85391 Sep 01 05:14:53.990739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-5ec683ae-5db5-4a12-a327-0e6ad2680cc7 req-189e6806-678b-4ceb-a3ba-cc97417c13f2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036486 Sep 01 05:14:53.991352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 41/73] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:54.196601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8a90eb4d-8c1f-4ee5-bec4-31f737a6d371 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:54.198485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8a90eb4d-8c1f-4ee5-bec4-31f737a6d371 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:54.209651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a90eb4d-8c1f-4ee5-bec4-31f737a6d371 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:54.210404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a90eb4d-8c1f-4ee5-bec4-31f737a6d371 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:54.211015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a90eb4d-8c1f-4ee5-bec4-31f737a6d371 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:54.214144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a90eb4d-8c1f-4ee5-bec4-31f737a6d371 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:54.215457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a90eb4d-8c1f-4ee5-bec4-31f737a6d371 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:54.216332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a90eb4d-8c1f-4ee5-bec4-31f737a6d371 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:54.257352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-217ba869-fde7-485c-b6b7-072be9a430c4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:54.258388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-217ba869-fde7-485c-b6b7-072be9a430c4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:54.268365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-217ba869-fde7-485c-b6b7-072be9a430c4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:54.268883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-217ba869-fde7-485c-b6b7-072be9a430c4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:54.269325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-217ba869-fde7-485c-b6b7-072be9a430c4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:54.270060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-217ba869-fde7-485c-b6b7-072be9a430c4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:54.270718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-217ba869-fde7-485c-b6b7-072be9a430c4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:54.271244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-217ba869-fde7-485c-b6b7-072be9a430c4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:54.490539 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-217ba869-fde7-485c-b6b7-072be9a430c4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:54.501761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-217ba869-fde7-485c-b6b7-072be9a430c4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.249691 Sep 01 05:14:54.502686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 42/74] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:54 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:54.513571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8a90eb4d-8c1f-4ee5-bec4-31f737a6d371 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:54.521763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8a90eb4d-8c1f-4ee5-bec4-31f737a6d371 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.330051 Sep 01 05:14:54.535689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 33/75] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:54 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:54.983471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-25c3adbd-1009-41f9-9adc-fbe5f7c5ec65 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:54.985817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-25c3adbd-1009-41f9-9adc-fbe5f7c5ec65 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:54.985965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-84802159-429a-4bc1-bf67-ae41a95baa30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:54.989006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-84802159-429a-4bc1-bf67-ae41a95baa30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:54.992122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=8 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:55.002333 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84802159-429a-4bc1-bf67-ae41a95baa30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:55.005025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84802159-429a-4bc1-bf67-ae41a95baa30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:55.007023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84802159-429a-4bc1-bf67-ae41a95baa30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:55.007650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25c3adbd-1009-41f9-9adc-fbe5f7c5ec65 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:55.008703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84802159-429a-4bc1-bf67-ae41a95baa30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:55.009336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25c3adbd-1009-41f9-9adc-fbe5f7c5ec65 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:55.009839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25c3adbd-1009-41f9-9adc-fbe5f7c5ec65 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:55.010368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84802159-429a-4bc1-bf67-ae41a95baa30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:55.011144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25c3adbd-1009-41f9-9adc-fbe5f7c5ec65 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:55.011648 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84802159-429a-4bc1-bf67-ae41a95baa30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:55.013199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25c3adbd-1009-41f9-9adc-fbe5f7c5ec65 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:55.015054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25c3adbd-1009-41f9-9adc-fbe5f7c5ec65 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:55.193319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-84802159-429a-4bc1-bf67-ae41a95baa30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:55.202323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-84802159-429a-4bc1-bf67-ae41a95baa30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:55.203773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-84802159-429a-4bc1-bf67-ae41a95baa30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:55.209618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-84802159-429a-4bc1-bf67-ae41a95baa30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.237135 Sep 01 05:14:55.210177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 43/76] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:14:55.245286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-25c3adbd-1009-41f9-9adc-fbe5f7c5ec65 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:55.258556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-25c3adbd-1009-41f9-9adc-fbe5f7c5ec65 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.283594 Sep 01 05:14:55.259616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 34/77] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:54 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:55.522755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-31181791-8b1e-43f9-bc14-f7ab91dd3fa0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:55.523369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-31181791-8b1e-43f9-bc14-f7ab91dd3fa0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:55.530298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-31181791-8b1e-43f9-bc14-f7ab91dd3fa0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:55.530782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-31181791-8b1e-43f9-bc14-f7ab91dd3fa0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:55.532498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-31181791-8b1e-43f9-bc14-f7ab91dd3fa0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:55.534359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-31181791-8b1e-43f9-bc14-f7ab91dd3fa0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:55.537861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-31181791-8b1e-43f9-bc14-f7ab91dd3fa0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:55.539587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-31181791-8b1e-43f9-bc14-f7ab91dd3fa0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:55.817456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-31181791-8b1e-43f9-bc14-f7ab91dd3fa0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:55.831073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-31181791-8b1e-43f9-bc14-f7ab91dd3fa0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.310904 Sep 01 05:14:55.836852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 35/78] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:55 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:55.843153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-07545773-8c1c-4c47-8d5b-3c9db21b32a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:55.844518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-07545773-8c1c-4c47-8d5b-3c9db21b32a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:55.866778 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07545773-8c1c-4c47-8d5b-3c9db21b32a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:55.867291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07545773-8c1c-4c47-8d5b-3c9db21b32a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:55.867697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07545773-8c1c-4c47-8d5b-3c9db21b32a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:55.868392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07545773-8c1c-4c47-8d5b-3c9db21b32a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:55.868863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07545773-8c1c-4c47-8d5b-3c9db21b32a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:55.881796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07545773-8c1c-4c47-8d5b-3c9db21b32a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:55.904338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-4d3b4b81-7366-4339-8098-7a8b00568db2 req-5442d83f-f1aa-4aa9-a761-0e01472890c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52140d99-84e5-4f90-bc00-1b9d431b8c52", "name": "network-vif-plugged", "status": "completed", "tag": "b4770713-261c-4b2a-9e65-3bb6e7b77741"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:55.948127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4d3b4b81-7366-4339-8098-7a8b00568db2 req-5442d83f-f1aa-4aa9-a761-0e01472890c5 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:55.948568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4d3b4b81-7366-4339-8098-7a8b00568db2 req-5442d83f-f1aa-4aa9-a761-0e01472890c5 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:55.949050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4d3b4b81-7366-4339-8098-7a8b00568db2 req-5442d83f-f1aa-4aa9-a761-0e01472890c5 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:56.001475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-4d3b4b81-7366-4339-8098-7a8b00568db2 req-5442d83f-f1aa-4aa9-a761-0e01472890c5 service nova] Creating event network-vif-plugged:b4770713-261c-4b2a-9e65-3bb6e7b77741 for instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 on hv-cinder-85391 Sep 01 05:14:56.017433 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-4d3b4b81-7366-4339-8098-7a8b00568db2 req-5442d83f-f1aa-4aa9-a761-0e01472890c5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.604019 Sep 01 05:14:56.039292 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 44/79] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:56.235712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-12b56095-f0bb-46d1-946c-74fce12ec3fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:56.236629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-12b56095-f0bb-46d1-946c-74fce12ec3fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:56.254312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-12b56095-f0bb-46d1-946c-74fce12ec3fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:56.256212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-12b56095-f0bb-46d1-946c-74fce12ec3fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:56.257279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-12b56095-f0bb-46d1-946c-74fce12ec3fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:56.260118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-12b56095-f0bb-46d1-946c-74fce12ec3fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:56.260932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-12b56095-f0bb-46d1-946c-74fce12ec3fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:56.263354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-12b56095-f0bb-46d1-946c-74fce12ec3fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:56.462040 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-12b56095-f0bb-46d1-946c-74fce12ec3fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:56.472853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-12b56095-f0bb-46d1-946c-74fce12ec3fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:56.474564 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-12b56095-f0bb-46d1-946c-74fce12ec3fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:56.476194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-12b56095-f0bb-46d1-946c-74fce12ec3fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.246607 Sep 01 05:14:56.477164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 45/80] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:14:56.482029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-eee098c8-4e4a-4dc4-925b-7c3001569634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:56.482846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-eee098c8-4e4a-4dc4-925b-7c3001569634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:56.491757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eee098c8-4e4a-4dc4-925b-7c3001569634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:56.492534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eee098c8-4e4a-4dc4-925b-7c3001569634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:56.493161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eee098c8-4e4a-4dc4-925b-7c3001569634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:56.494356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eee098c8-4e4a-4dc4-925b-7c3001569634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:56.495087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eee098c8-4e4a-4dc4-925b-7c3001569634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:56.495740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eee098c8-4e4a-4dc4-925b-7c3001569634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:56.543397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-07545773-8c1c-4c47-8d5b-3c9db21b32a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:56.555656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-07545773-8c1c-4c47-8d5b-3c9db21b32a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.714438 Sep 01 05:14:56.556648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 36/81] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:55 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:56.744100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-eee098c8-4e4a-4dc4-925b-7c3001569634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:56.753927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-eee098c8-4e4a-4dc4-925b-7c3001569634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.275102 Sep 01 05:14:56.754877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 46/82] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:56 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:56.856360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8b780ff6-86c5-4df5-9e07-224089e7683a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:56.857309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8b780ff6-86c5-4df5-9e07-224089e7683a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:56.865889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b780ff6-86c5-4df5-9e07-224089e7683a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:56.866647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b780ff6-86c5-4df5-9e07-224089e7683a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:56.867306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b780ff6-86c5-4df5-9e07-224089e7683a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:56.868084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b780ff6-86c5-4df5-9e07-224089e7683a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:56.868816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b780ff6-86c5-4df5-9e07-224089e7683a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:56.869426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b780ff6-86c5-4df5-9e07-224089e7683a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:57.057016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8b780ff6-86c5-4df5-9e07-224089e7683a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:57.072614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8b780ff6-86c5-4df5-9e07-224089e7683a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.220481 Sep 01 05:14:57.073518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 37/83] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:56 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:57.521756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e91337a7-3b9e-4a27-9181-44199814875c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:57.522487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e91337a7-3b9e-4a27-9181-44199814875c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:57.529542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e91337a7-3b9e-4a27-9181-44199814875c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:57.530177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e91337a7-3b9e-4a27-9181-44199814875c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:57.530651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e91337a7-3b9e-4a27-9181-44199814875c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:57.531344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e91337a7-3b9e-4a27-9181-44199814875c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:57.531796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e91337a7-3b9e-4a27-9181-44199814875c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:57.532216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e91337a7-3b9e-4a27-9181-44199814875c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:57.581371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-66ae7d30-d06e-4e25-8006-de470e5167d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:57.582667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-66ae7d30-d06e-4e25-8006-de470e5167d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:57.590481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-66ae7d30-d06e-4e25-8006-de470e5167d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:57.591485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-66ae7d30-d06e-4e25-8006-de470e5167d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:57.592404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-66ae7d30-d06e-4e25-8006-de470e5167d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:57.593317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-66ae7d30-d06e-4e25-8006-de470e5167d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:57.593920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-66ae7d30-d06e-4e25-8006-de470e5167d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:57.594331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-66ae7d30-d06e-4e25-8006-de470e5167d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:57.697651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e91337a7-3b9e-4a27-9181-44199814875c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:57.709819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e91337a7-3b9e-4a27-9181-44199814875c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:57.712178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e91337a7-3b9e-4a27-9181-44199814875c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:57.713853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e91337a7-3b9e-4a27-9181-44199814875c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.210352 Sep 01 05:14:57.714946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 47/84] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:14:57.777778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-45c40363-dd10-4148-87e9-460e1e3a010e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:57.783983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-45c40363-dd10-4148-87e9-460e1e3a010e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:57.790866 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45c40363-dd10-4148-87e9-460e1e3a010e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:57.791476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45c40363-dd10-4148-87e9-460e1e3a010e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:57.792273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45c40363-dd10-4148-87e9-460e1e3a010e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:57.793063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45c40363-dd10-4148-87e9-460e1e3a010e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:57.793712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45c40363-dd10-4148-87e9-460e1e3a010e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:57.794421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45c40363-dd10-4148-87e9-460e1e3a010e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:57.862686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-66ae7d30-d06e-4e25-8006-de470e5167d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:57.872608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-66ae7d30-d06e-4e25-8006-de470e5167d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.297723 Sep 01 05:14:57.878005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 38/85] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:57 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:57.975459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-45c40363-dd10-4148-87e9-460e1e3a010e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:57.987709 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-45c40363-dd10-4148-87e9-460e1e3a010e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.215960 Sep 01 05:14:57.989739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 48/86] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:57 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:58.041977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-ecd03ab8-1f4f-4d2f-8bb1-cafc4aa38be6 req-d6b1ff62-245c-4ce6-bea4-c0c38bedad3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a582556-d184-4047-ac19-285c0edd2fdf", "name": "network-vif-plugged", "status": "completed", "tag": "6e571bd8-c64a-432f-894b-026d58cce109"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:58.058020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-ecd03ab8-1f4f-4d2f-8bb1-cafc4aa38be6 req-d6b1ff62-245c-4ce6-bea4-c0c38bedad3f service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:58.058667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-ecd03ab8-1f4f-4d2f-8bb1-cafc4aa38be6 req-d6b1ff62-245c-4ce6-bea4-c0c38bedad3f service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:58.059367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-ecd03ab8-1f4f-4d2f-8bb1-cafc4aa38be6 req-d6b1ff62-245c-4ce6-bea4-c0c38bedad3f service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:58.073748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-ecd03ab8-1f4f-4d2f-8bb1-cafc4aa38be6 req-d6b1ff62-245c-4ce6-bea4-c0c38bedad3f service nova] Creating event network-vif-plugged:6e571bd8-c64a-432f-894b-026d58cce109 for instance 2a582556-d184-4047-ac19-285c0edd2fdf on hv-cinder-85391 Sep 01 05:14:58.079436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-ecd03ab8-1f4f-4d2f-8bb1-cafc4aa38be6 req-d6b1ff62-245c-4ce6-bea4-c0c38bedad3f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041332 Sep 01 05:14:58.080324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 39/87] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:14:58.094714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-abff415c-7b78-47e4-890a-2f9a66c20516 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:58.095667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-abff415c-7b78-47e4-890a-2f9a66c20516 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:58.102215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abff415c-7b78-47e4-890a-2f9a66c20516 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:58.102686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abff415c-7b78-47e4-890a-2f9a66c20516 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:58.103297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abff415c-7b78-47e4-890a-2f9a66c20516 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:58.104167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abff415c-7b78-47e4-890a-2f9a66c20516 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:58.104616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abff415c-7b78-47e4-890a-2f9a66c20516 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:58.105114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abff415c-7b78-47e4-890a-2f9a66c20516 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:58.247744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-abff415c-7b78-47e4-890a-2f9a66c20516 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:58.260226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-abff415c-7b78-47e4-890a-2f9a66c20516 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.169031 Sep 01 05:14:58.260828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 49/88] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:58 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:58.739572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1d81350b-86b6-47d7-b024-8ab0e11dc7c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:58.740416 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1d81350b-86b6-47d7-b024-8ab0e11dc7c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:58.747882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d81350b-86b6-47d7-b024-8ab0e11dc7c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:58.748396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d81350b-86b6-47d7-b024-8ab0e11dc7c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:58.748968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d81350b-86b6-47d7-b024-8ab0e11dc7c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:58.749697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d81350b-86b6-47d7-b024-8ab0e11dc7c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:58.750182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d81350b-86b6-47d7-b024-8ab0e11dc7c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:58.750608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d81350b-86b6-47d7-b024-8ab0e11dc7c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:58.893126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1d81350b-86b6-47d7-b024-8ab0e11dc7c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:58.900308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-64910cde-232f-44b0-a071-b4b1231b9c6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:58.903550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-64910cde-232f-44b0-a071-b4b1231b9c6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:58.909653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64910cde-232f-44b0-a071-b4b1231b9c6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:58.909804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1d81350b-86b6-47d7-b024-8ab0e11dc7c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:58.911702 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1d81350b-86b6-47d7-b024-8ab0e11dc7c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:58.911838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64910cde-232f-44b0-a071-b4b1231b9c6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:58.912162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64910cde-232f-44b0-a071-b4b1231b9c6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:58.912828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1d81350b-86b6-47d7-b024-8ab0e11dc7c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.178337 Sep 01 05:14:58.912974 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64910cde-232f-44b0-a071-b4b1231b9c6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:58.913328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64910cde-232f-44b0-a071-b4b1231b9c6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:58.913752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64910cde-232f-44b0-a071-b4b1231b9c6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:58.919624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 40/89] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:14:59.011834 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e22e7a17-8475-4644-9342-ac739cdbf4d8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:59.013033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e22e7a17-8475-4644-9342-ac739cdbf4d8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:59.019925 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e22e7a17-8475-4644-9342-ac739cdbf4d8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:59.020523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e22e7a17-8475-4644-9342-ac739cdbf4d8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:59.021169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e22e7a17-8475-4644-9342-ac739cdbf4d8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:59.022248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e22e7a17-8475-4644-9342-ac739cdbf4d8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:59.022814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e22e7a17-8475-4644-9342-ac739cdbf4d8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:59.023339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e22e7a17-8475-4644-9342-ac739cdbf4d8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:59.055642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-64910cde-232f-44b0-a071-b4b1231b9c6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:59.065583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-64910cde-232f-44b0-a071-b4b1231b9c6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.168633 Sep 01 05:14:59.076823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 50/90] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:58 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:59.182502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e22e7a17-8475-4644-9342-ac739cdbf4d8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:59.191808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e22e7a17-8475-4644-9342-ac739cdbf4d8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.186116 Sep 01 05:14:59.192460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 41/91] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:59 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:59.281437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c3edca76-1a26-4cee-a620-fa8397073667 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:59.282105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c3edca76-1a26-4cee-a620-fa8397073667 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:59.288923 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3edca76-1a26-4cee-a620-fa8397073667 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:59.289466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3edca76-1a26-4cee-a620-fa8397073667 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:59.289910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3edca76-1a26-4cee-a620-fa8397073667 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:59.290619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3edca76-1a26-4cee-a620-fa8397073667 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:59.291078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3edca76-1a26-4cee-a620-fa8397073667 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:59.291505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3edca76-1a26-4cee-a620-fa8397073667 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:59.331408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=6 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:59.438913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c3edca76-1a26-4cee-a620-fa8397073667 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:59.446507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c3edca76-1a26-4cee-a620-fa8397073667 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.168955 Sep 01 05:14:59.447065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 51/92] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:59 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:59.941009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6602a9f1-00e9-4c8d-841e-c39615872954 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:59.942212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6602a9f1-00e9-4c8d-841e-c39615872954 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:59.948320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6602a9f1-00e9-4c8d-841e-c39615872954 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:59.948830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6602a9f1-00e9-4c8d-841e-c39615872954 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:59.949351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6602a9f1-00e9-4c8d-841e-c39615872954 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:59.950041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6602a9f1-00e9-4c8d-841e-c39615872954 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:59.950491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6602a9f1-00e9-4c8d-841e-c39615872954 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:59.950911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6602a9f1-00e9-4c8d-841e-c39615872954 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:00.081102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6602a9f1-00e9-4c8d-841e-c39615872954 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:00.087939 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-98155fd1-1b4c-49c2-a33b-6046d623b2e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:00.088821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-98155fd1-1b4c-49c2-a33b-6046d623b2e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:00.090540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6602a9f1-00e9-4c8d-841e-c39615872954 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:00.092004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6602a9f1-00e9-4c8d-841e-c39615872954 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:00.093121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6602a9f1-00e9-4c8d-841e-c39615872954 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.156014 Sep 01 05:15:00.093729 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 42/93] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:14:59 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:15:00.100256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-98155fd1-1b4c-49c2-a33b-6046d623b2e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:00.100737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-98155fd1-1b4c-49c2-a33b-6046d623b2e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:00.101192 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-98155fd1-1b4c-49c2-a33b-6046d623b2e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:00.101882 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-98155fd1-1b4c-49c2-a33b-6046d623b2e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:00.102327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-98155fd1-1b4c-49c2-a33b-6046d623b2e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:00.102742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-98155fd1-1b4c-49c2-a33b-6046d623b2e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:00.212317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e67ea555-d827-4337-b33c-8670f425ff12 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:00.212957 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e67ea555-d827-4337-b33c-8670f425ff12 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:00.218723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e67ea555-d827-4337-b33c-8670f425ff12 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:00.219207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e67ea555-d827-4337-b33c-8670f425ff12 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:00.219748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e67ea555-d827-4337-b33c-8670f425ff12 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:00.220452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e67ea555-d827-4337-b33c-8670f425ff12 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:00.220985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e67ea555-d827-4337-b33c-8670f425ff12 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:00.221403 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e67ea555-d827-4337-b33c-8670f425ff12 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:00.242959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-98155fd1-1b4c-49c2-a33b-6046d623b2e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:00.256984 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-98155fd1-1b4c-49c2-a33b-6046d623b2e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.172924 Sep 01 05:15:00.257687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 52/94] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:00 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:00.361773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e67ea555-d827-4337-b33c-8670f425ff12 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:00.370002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e67ea555-d827-4337-b33c-8670f425ff12 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.161703 Sep 01 05:15:00.370566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 43/95] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:00 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:00.467440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-18d06e7f-5048-451b-88bd-f221a43bc8b5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:00.467973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-18d06e7f-5048-451b-88bd-f221a43bc8b5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:00.474546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18d06e7f-5048-451b-88bd-f221a43bc8b5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:00.475031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18d06e7f-5048-451b-88bd-f221a43bc8b5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:00.475470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18d06e7f-5048-451b-88bd-f221a43bc8b5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:00.476151 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18d06e7f-5048-451b-88bd-f221a43bc8b5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:00.476602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18d06e7f-5048-451b-88bd-f221a43bc8b5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:00.477058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18d06e7f-5048-451b-88bd-f221a43bc8b5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:00.610144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-18d06e7f-5048-451b-88bd-f221a43bc8b5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:00.618968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-18d06e7f-5048-451b-88bd-f221a43bc8b5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.155474 Sep 01 05:15:00.619533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 53/96] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:00 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:01.116416 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a15f245d-e248-449e-9dd2-b5c7daaae8f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:01.117008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a15f245d-e248-449e-9dd2-b5c7daaae8f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:01.122948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a15f245d-e248-449e-9dd2-b5c7daaae8f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:01.123429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a15f245d-e248-449e-9dd2-b5c7daaae8f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:01.123892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a15f245d-e248-449e-9dd2-b5c7daaae8f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:01.124575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a15f245d-e248-449e-9dd2-b5c7daaae8f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:01.125058 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a15f245d-e248-449e-9dd2-b5c7daaae8f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:01.125481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a15f245d-e248-449e-9dd2-b5c7daaae8f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:01.271104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a15f245d-e248-449e-9dd2-b5c7daaae8f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:01.279255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a15f245d-e248-449e-9dd2-b5c7daaae8f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:01.281041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a15f245d-e248-449e-9dd2-b5c7daaae8f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:01.282149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a15f245d-e248-449e-9dd2-b5c7daaae8f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.169842 Sep 01 05:15:01.282695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 44/97] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:15:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:15:01.287956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-614dedf2-2fb3-4129-ba12-54421550891b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:01.288575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-614dedf2-2fb3-4129-ba12-54421550891b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:01.294892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-614dedf2-2fb3-4129-ba12-54421550891b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:01.295380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-614dedf2-2fb3-4129-ba12-54421550891b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:01.295815 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-614dedf2-2fb3-4129-ba12-54421550891b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:01.296537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-614dedf2-2fb3-4129-ba12-54421550891b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:01.297025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-614dedf2-2fb3-4129-ba12-54421550891b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:01.297448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-614dedf2-2fb3-4129-ba12-54421550891b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:01.392001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b425eebb-35d0-4807-bf58-8e0e225cca51 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:01.392737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b425eebb-35d0-4807-bf58-8e0e225cca51 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:01.400049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b425eebb-35d0-4807-bf58-8e0e225cca51 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:01.400640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b425eebb-35d0-4807-bf58-8e0e225cca51 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:01.401307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b425eebb-35d0-4807-bf58-8e0e225cca51 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:01.402366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b425eebb-35d0-4807-bf58-8e0e225cca51 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:01.402984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b425eebb-35d0-4807-bf58-8e0e225cca51 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:01.403619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b425eebb-35d0-4807-bf58-8e0e225cca51 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:01.445642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-614dedf2-2fb3-4129-ba12-54421550891b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:01.454168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-614dedf2-2fb3-4129-ba12-54421550891b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.173041 Sep 01 05:15:01.465277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 54/98] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:01 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:01.544140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b425eebb-35d0-4807-bf58-8e0e225cca51 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:01.552168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b425eebb-35d0-4807-bf58-8e0e225cca51 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.164593 Sep 01 05:15:01.552729 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 45/99] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:01 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:01.641782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3dffa4ac-1b54-47f3-8fee-bbfde4e22616 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:01.642465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3dffa4ac-1b54-47f3-8fee-bbfde4e22616 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:01.649268 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3dffa4ac-1b54-47f3-8fee-bbfde4e22616 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:01.649756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3dffa4ac-1b54-47f3-8fee-bbfde4e22616 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:01.650185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3dffa4ac-1b54-47f3-8fee-bbfde4e22616 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:01.650882 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3dffa4ac-1b54-47f3-8fee-bbfde4e22616 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:01.651335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3dffa4ac-1b54-47f3-8fee-bbfde4e22616 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:01.651866 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3dffa4ac-1b54-47f3-8fee-bbfde4e22616 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:01.783760 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3dffa4ac-1b54-47f3-8fee-bbfde4e22616 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:01.791301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3dffa4ac-1b54-47f3-8fee-bbfde4e22616 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.155131 Sep 01 05:15:01.791852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 55/100] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:01 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:02.303854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-09eda221-cf06-44d9-b460-fb108ad8ef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:02.304454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-09eda221-cf06-44d9-b460-fb108ad8ef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:02.310559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09eda221-cf06-44d9-b460-fb108ad8ef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:02.311027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09eda221-cf06-44d9-b460-fb108ad8ef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:02.311451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09eda221-cf06-44d9-b460-fb108ad8ef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:02.312123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09eda221-cf06-44d9-b460-fb108ad8ef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:02.312567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09eda221-cf06-44d9-b460-fb108ad8ef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:02.313021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09eda221-cf06-44d9-b460-fb108ad8ef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:02.440256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-09eda221-cf06-44d9-b460-fb108ad8ef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:02.448234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-09eda221-cf06-44d9-b460-fb108ad8ef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:02.449718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-09eda221-cf06-44d9-b460-fb108ad8ef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:02.450805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-09eda221-cf06-44d9-b460-fb108ad8ef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.151420 Sep 01 05:15:02.451352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 46/101] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:15:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:15:02.475217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cb97b9d1-127f-4e5e-8549-f2a34a9305e1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:02.475980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cb97b9d1-127f-4e5e-8549-f2a34a9305e1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:02.482173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb97b9d1-127f-4e5e-8549-f2a34a9305e1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:02.482661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb97b9d1-127f-4e5e-8549-f2a34a9305e1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:02.483100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb97b9d1-127f-4e5e-8549-f2a34a9305e1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:02.483791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb97b9d1-127f-4e5e-8549-f2a34a9305e1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:02.484245 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb97b9d1-127f-4e5e-8549-f2a34a9305e1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:02.484670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb97b9d1-127f-4e5e-8549-f2a34a9305e1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:02.573441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-99115707-3bde-4bfb-b7ab-0d8b72774d66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:02.574135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-99115707-3bde-4bfb-b7ab-0d8b72774d66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:02.580224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-99115707-3bde-4bfb-b7ab-0d8b72774d66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:02.580709 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-99115707-3bde-4bfb-b7ab-0d8b72774d66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:02.581177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-99115707-3bde-4bfb-b7ab-0d8b72774d66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:02.582458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-99115707-3bde-4bfb-b7ab-0d8b72774d66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:02.582914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-99115707-3bde-4bfb-b7ab-0d8b72774d66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:02.583341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-99115707-3bde-4bfb-b7ab-0d8b72774d66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:02.610476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cb97b9d1-127f-4e5e-8549-f2a34a9305e1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:02.618643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cb97b9d1-127f-4e5e-8549-f2a34a9305e1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.147801 Sep 01 05:15:02.619365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 56/102] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:02 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:02.714884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-99115707-3bde-4bfb-b7ab-0d8b72774d66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:02.722391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-99115707-3bde-4bfb-b7ab-0d8b72774d66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.152778 Sep 01 05:15:02.722945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 47/103] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:02 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:02.812403 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-950abfa7-d82a-46f3-86c5-71357aab3f00 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:02.813050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-950abfa7-d82a-46f3-86c5-71357aab3f00 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:02.819711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-950abfa7-d82a-46f3-86c5-71357aab3f00 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:02.820193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-950abfa7-d82a-46f3-86c5-71357aab3f00 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:02.820630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-950abfa7-d82a-46f3-86c5-71357aab3f00 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:02.821348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-950abfa7-d82a-46f3-86c5-71357aab3f00 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:02.821801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-950abfa7-d82a-46f3-86c5-71357aab3f00 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:02.822225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-950abfa7-d82a-46f3-86c5-71357aab3f00 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:02.951689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-950abfa7-d82a-46f3-86c5-71357aab3f00 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:02.955095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:02.960991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-950abfa7-d82a-46f3-86c5-71357aab3f00 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1315 microversion: 2.1 time: 0.152656 Sep 01 05:15:02.961554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 57/104] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:02 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:03.473928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9a02e635-46ef-417f-adbb-7221b02b666d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:03.474524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9a02e635-46ef-417f-adbb-7221b02b666d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:03.480554 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a02e635-46ef-417f-adbb-7221b02b666d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:03.481134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a02e635-46ef-417f-adbb-7221b02b666d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:03.481564 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a02e635-46ef-417f-adbb-7221b02b666d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:03.482294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a02e635-46ef-417f-adbb-7221b02b666d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:03.482739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a02e635-46ef-417f-adbb-7221b02b666d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:03.483156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a02e635-46ef-417f-adbb-7221b02b666d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:03.485809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:03.610351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9a02e635-46ef-417f-adbb-7221b02b666d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:03.619120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9a02e635-46ef-417f-adbb-7221b02b666d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:03.620551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9a02e635-46ef-417f-adbb-7221b02b666d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:03.621669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9a02e635-46ef-417f-adbb-7221b02b666d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.152074 Sep 01 05:15:03.622212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 48/105] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:15:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:15:03.640119 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f704b65b-25ac-450c-8dd2-ee24fe19517a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:03.640853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f704b65b-25ac-450c-8dd2-ee24fe19517a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:03.648243 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f704b65b-25ac-450c-8dd2-ee24fe19517a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:03.648849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f704b65b-25ac-450c-8dd2-ee24fe19517a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:03.649650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f704b65b-25ac-450c-8dd2-ee24fe19517a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:03.665674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f704b65b-25ac-450c-8dd2-ee24fe19517a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:03.666274 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f704b65b-25ac-450c-8dd2-ee24fe19517a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:03.666874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f704b65b-25ac-450c-8dd2-ee24fe19517a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:03.742697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3adf8591-e9e7-4e21-9257-70389556be28 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:03.743690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3adf8591-e9e7-4e21-9257-70389556be28 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:03.749677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3adf8591-e9e7-4e21-9257-70389556be28 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:03.750164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3adf8591-e9e7-4e21-9257-70389556be28 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:03.750600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3adf8591-e9e7-4e21-9257-70389556be28 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:03.751292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3adf8591-e9e7-4e21-9257-70389556be28 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:03.751933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3adf8591-e9e7-4e21-9257-70389556be28 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:03.752353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3adf8591-e9e7-4e21-9257-70389556be28 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:03.844393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f704b65b-25ac-450c-8dd2-ee24fe19517a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:03.858739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f704b65b-25ac-450c-8dd2-ee24fe19517a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.222865 Sep 01 05:15:03.859408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 58/106] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:03 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:03.927906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3adf8591-e9e7-4e21-9257-70389556be28 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:03.936189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3adf8591-e9e7-4e21-9257-70389556be28 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.197119 Sep 01 05:15:03.936798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 49/107] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:03 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:03.981860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f294e4cd-8e4e-470b-9066-1315c173269e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:03.982479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f294e4cd-8e4e-470b-9066-1315c173269e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:03.989162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f294e4cd-8e4e-470b-9066-1315c173269e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:03.989645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f294e4cd-8e4e-470b-9066-1315c173269e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:03.990084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f294e4cd-8e4e-470b-9066-1315c173269e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:03.990772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f294e4cd-8e4e-470b-9066-1315c173269e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:03.991226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f294e4cd-8e4e-470b-9066-1315c173269e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:03.991649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f294e4cd-8e4e-470b-9066-1315c173269e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:04.117180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f294e4cd-8e4e-470b-9066-1315c173269e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:04.124727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f294e4cd-8e4e-470b-9066-1315c173269e tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1502 microversion: 2.1 time: 0.146779 Sep 01 05:15:04.125309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 59/108] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:03 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:04.646098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9ca272ef-db46-4f5e-87e1-8e9f10ff7591 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:04.646732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9ca272ef-db46-4f5e-87e1-8e9f10ff7591 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:04.652545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ca272ef-db46-4f5e-87e1-8e9f10ff7591 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:04.653052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ca272ef-db46-4f5e-87e1-8e9f10ff7591 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:04.653483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ca272ef-db46-4f5e-87e1-8e9f10ff7591 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:04.654154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ca272ef-db46-4f5e-87e1-8e9f10ff7591 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:04.654594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ca272ef-db46-4f5e-87e1-8e9f10ff7591 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:04.655004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ca272ef-db46-4f5e-87e1-8e9f10ff7591 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:04.791032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ca272ef-db46-4f5e-87e1-8e9f10ff7591 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:04.799235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ca272ef-db46-4f5e-87e1-8e9f10ff7591 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:04.801551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ca272ef-db46-4f5e-87e1-8e9f10ff7591 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:04.802643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9ca272ef-db46-4f5e-87e1-8e9f10ff7591 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.160983 Sep 01 05:15:04.803188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 50/109] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:15:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:15:04.882439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1b995918-07b3-475a-8cc1-323715f3780c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:04.882955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1b995918-07b3-475a-8cc1-323715f3780c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:04.889091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b995918-07b3-475a-8cc1-323715f3780c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:04.889702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b995918-07b3-475a-8cc1-323715f3780c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:04.890144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b995918-07b3-475a-8cc1-323715f3780c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:04.890849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b995918-07b3-475a-8cc1-323715f3780c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:04.891299 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b995918-07b3-475a-8cc1-323715f3780c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:04.891719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b995918-07b3-475a-8cc1-323715f3780c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:04.960524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c6bc0ee1-d557-42a0-98b5-88a6d6eac9a7 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:04.961427 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c6bc0ee1-d557-42a0-98b5-88a6d6eac9a7 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:04.967683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6bc0ee1-d557-42a0-98b5-88a6d6eac9a7 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:04.968088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6bc0ee1-d557-42a0-98b5-88a6d6eac9a7 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:04.968519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6bc0ee1-d557-42a0-98b5-88a6d6eac9a7 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:04.969333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6bc0ee1-d557-42a0-98b5-88a6d6eac9a7 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:04.969655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6bc0ee1-d557-42a0-98b5-88a6d6eac9a7 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:04.970245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6bc0ee1-d557-42a0-98b5-88a6d6eac9a7 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:05.041314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1b995918-07b3-475a-8cc1-323715f3780c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:05.048897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1b995918-07b3-475a-8cc1-323715f3780c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.171676 Sep 01 05:15:05.049459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 60/110] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:04 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:05.114497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c6bc0ee1-d557-42a0-98b5-88a6d6eac9a7 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:05.122001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c6bc0ee1-d557-42a0-98b5-88a6d6eac9a7 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.167717 Sep 01 05:15:05.122553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 51/111] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:04 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:05.832213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-de6b2b40-aeec-4d29-94a7-7a70f0faa451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:05.832827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-de6b2b40-aeec-4d29-94a7-7a70f0faa451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:05.838681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de6b2b40-aeec-4d29-94a7-7a70f0faa451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:05.839162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de6b2b40-aeec-4d29-94a7-7a70f0faa451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:05.839593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de6b2b40-aeec-4d29-94a7-7a70f0faa451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:05.840272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de6b2b40-aeec-4d29-94a7-7a70f0faa451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:05.840716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de6b2b40-aeec-4d29-94a7-7a70f0faa451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:05.841161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de6b2b40-aeec-4d29-94a7-7a70f0faa451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:05.967375 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-de6b2b40-aeec-4d29-94a7-7a70f0faa451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:05.975375 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-de6b2b40-aeec-4d29-94a7-7a70f0faa451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:05.976814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-de6b2b40-aeec-4d29-94a7-7a70f0faa451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:05.977902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-de6b2b40-aeec-4d29-94a7-7a70f0faa451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.150339 Sep 01 05:15:05.978664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 61/112] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:15:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:15:06.071078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-90bc99ac-64b5-4488-815a-aa2041135437 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:06.071681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-90bc99ac-64b5-4488-815a-aa2041135437 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:06.077630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90bc99ac-64b5-4488-815a-aa2041135437 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:06.078156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90bc99ac-64b5-4488-815a-aa2041135437 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:06.078584 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90bc99ac-64b5-4488-815a-aa2041135437 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:06.079259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90bc99ac-64b5-4488-815a-aa2041135437 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:06.079701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90bc99ac-64b5-4488-815a-aa2041135437 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:06.080132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90bc99ac-64b5-4488-815a-aa2041135437 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:06.143041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9d44f142-2e79-478b-a472-ff2bf81b9c74 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:06.143690 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9d44f142-2e79-478b-a472-ff2bf81b9c74 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:06.150564 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d44f142-2e79-478b-a472-ff2bf81b9c74 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:06.151045 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d44f142-2e79-478b-a472-ff2bf81b9c74 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:06.151475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d44f142-2e79-478b-a472-ff2bf81b9c74 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:06.152156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d44f142-2e79-478b-a472-ff2bf81b9c74 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:06.152600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d44f142-2e79-478b-a472-ff2bf81b9c74 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:06.153050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d44f142-2e79-478b-a472-ff2bf81b9c74 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:06.211909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-90bc99ac-64b5-4488-815a-aa2041135437 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:06.219615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-90bc99ac-64b5-4488-815a-aa2041135437 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.152381 Sep 01 05:15:06.220191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 52/113] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:06 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:06.457358 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9d44f142-2e79-478b-a472-ff2bf81b9c74 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:06.465520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9d44f142-2e79-478b-a472-ff2bf81b9c74 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.326229 Sep 01 05:15:06.466074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 62/114] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:06 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:06.817474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-71899bff-f1f7-473b-a7ad-3a58f65a7f32 req-fc7f32e0-f673-4661-91b3-d0a0c6b3df43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266d4ced-afe8-4d91-a857-192e9315a28e", "name": "network-vif-plugged", "status": "completed", "tag": "0d853372-0a5c-486f-98d3-6a3c853acda7"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:06.827528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-71899bff-f1f7-473b-a7ad-3a58f65a7f32 req-fc7f32e0-f673-4661-91b3-d0a0c6b3df43 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:06.827845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-71899bff-f1f7-473b-a7ad-3a58f65a7f32 req-fc7f32e0-f673-4661-91b3-d0a0c6b3df43 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:06.828501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-71899bff-f1f7-473b-a7ad-3a58f65a7f32 req-fc7f32e0-f673-4661-91b3-d0a0c6b3df43 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:06.842825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-71899bff-f1f7-473b-a7ad-3a58f65a7f32 req-fc7f32e0-f673-4661-91b3-d0a0c6b3df43 service nova] Creating event network-vif-plugged:0d853372-0a5c-486f-98d3-6a3c853acda7 for instance 266d4ced-afe8-4d91-a857-192e9315a28e on hv-cinder-85391 Sep 01 05:15:06.848647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-71899bff-f1f7-473b-a7ad-3a58f65a7f32 req-fc7f32e0-f673-4661-91b3-d0a0c6b3df43 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035579 Sep 01 05:15:06.849454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 53/115] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:07.003807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dbfd9409-ffd6-4c08-8de7-8453e9bebad5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:07.004587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dbfd9409-ffd6-4c08-8de7-8453e9bebad5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:07.013611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbfd9409-ffd6-4c08-8de7-8453e9bebad5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:07.014101 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbfd9409-ffd6-4c08-8de7-8453e9bebad5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:07.014527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbfd9409-ffd6-4c08-8de7-8453e9bebad5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:07.015366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbfd9409-ffd6-4c08-8de7-8453e9bebad5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:07.015818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbfd9409-ffd6-4c08-8de7-8453e9bebad5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:07.016241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbfd9409-ffd6-4c08-8de7-8453e9bebad5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:07.182141 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dbfd9409-ffd6-4c08-8de7-8453e9bebad5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:07.193125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dbfd9409-ffd6-4c08-8de7-8453e9bebad5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:07.195740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dbfd9409-ffd6-4c08-8de7-8453e9bebad5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:07.196963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dbfd9409-ffd6-4c08-8de7-8453e9bebad5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1406 microversion: 2.20 time: 0.198630 Sep 01 05:15:07.198256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 63/116] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:15:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:15:07.240789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-328025c7-f208-47ec-93ec-039b765a5314 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:07.241488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-328025c7-f208-47ec-93ec-039b765a5314 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:07.248355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-328025c7-f208-47ec-93ec-039b765a5314 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:07.248874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-328025c7-f208-47ec-93ec-039b765a5314 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:07.249337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-328025c7-f208-47ec-93ec-039b765a5314 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:07.250022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-328025c7-f208-47ec-93ec-039b765a5314 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:07.250496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-328025c7-f208-47ec-93ec-039b765a5314 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:07.250986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-328025c7-f208-47ec-93ec-039b765a5314 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:07.423243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-328025c7-f208-47ec-93ec-039b765a5314 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:07.430867 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-328025c7-f208-47ec-93ec-039b765a5314 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.194363 Sep 01 05:15:07.431432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 54/117] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:07 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:07.486584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0df000a2-661a-415d-8266-1813a6cf1a2c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:07.487272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0df000a2-661a-415d-8266-1813a6cf1a2c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:07.493351 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0df000a2-661a-415d-8266-1813a6cf1a2c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:07.493837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0df000a2-661a-415d-8266-1813a6cf1a2c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:07.494270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0df000a2-661a-415d-8266-1813a6cf1a2c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:07.494955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0df000a2-661a-415d-8266-1813a6cf1a2c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:07.495405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0df000a2-661a-415d-8266-1813a6cf1a2c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:07.495822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0df000a2-661a-415d-8266-1813a6cf1a2c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:07.622854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8824e583-1450-401e-94f9-2ceee983b5b4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d11bab02-05e5-4cea-9b04-a86268d34bfe"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:07.625983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8824e583-1450-401e-94f9-2ceee983b5b4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:07.635048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0df000a2-661a-415d-8266-1813a6cf1a2c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:07.637358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8824e583-1450-401e-94f9-2ceee983b5b4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:07.637848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8824e583-1450-401e-94f9-2ceee983b5b4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:07.638304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8824e583-1450-401e-94f9-2ceee983b5b4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:07.639045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8824e583-1450-401e-94f9-2ceee983b5b4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:07.639502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8824e583-1450-401e-94f9-2ceee983b5b4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:07.639962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8824e583-1450-401e-94f9-2ceee983b5b4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:07.648620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0df000a2-661a-415d-8266-1813a6cf1a2c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.165290 Sep 01 05:15:07.650188 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 64/118] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:07 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:08.223931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-df43ae7b-f912-423f-8a2a-8bce2d09405a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:08.224559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-df43ae7b-f912-423f-8a2a-8bce2d09405a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:08.230376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df43ae7b-f912-423f-8a2a-8bce2d09405a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:08.231211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df43ae7b-f912-423f-8a2a-8bce2d09405a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:08.231836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df43ae7b-f912-423f-8a2a-8bce2d09405a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:08.232738 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df43ae7b-f912-423f-8a2a-8bce2d09405a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:08.233396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df43ae7b-f912-423f-8a2a-8bce2d09405a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:08.233970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df43ae7b-f912-423f-8a2a-8bce2d09405a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:08.292949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8824e583-1450-401e-94f9-2ceee983b5b4 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "POST /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673826 Sep 01 05:15:08.294154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 55/119] 10.222.0.49 () {60 vars in 1323 bytes} [Thu Sep 1 05:15:07 2022] POST /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52/os-volume_attachments => generated 194 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:15:08.401759 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-df43ae7b-f912-423f-8a2a-8bce2d09405a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:08.411383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-df43ae7b-f912-423f-8a2a-8bce2d09405a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:08.412978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-df43ae7b-f912-423f-8a2a-8bce2d09405a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:08.414231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-df43ae7b-f912-423f-8a2a-8bce2d09405a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1598 microversion: 2.20 time: 0.195522 Sep 01 05:15:08.414884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 65/120] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:15:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1598 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:15:08.438725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-78610c8f-7691-4927-ab2c-3f9a683896a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:08.439300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-78610c8f-7691-4927-ab2c-3f9a683896a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:08.446081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-78610c8f-7691-4927-ab2c-3f9a683896a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:08.446905 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-78610c8f-7691-4927-ab2c-3f9a683896a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:08.447532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-78610c8f-7691-4927-ab2c-3f9a683896a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:08.448419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-78610c8f-7691-4927-ab2c-3f9a683896a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:08.449112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-78610c8f-7691-4927-ab2c-3f9a683896a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:08.449729 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-78610c8f-7691-4927-ab2c-3f9a683896a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:08.452627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c2c4c711-2eb8-4cb3-bf6e-ea10d137dccf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:08.453583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c2c4c711-2eb8-4cb3-bf6e-ea10d137dccf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:08.461824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2c4c711-2eb8-4cb3-bf6e-ea10d137dccf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:08.462308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2c4c711-2eb8-4cb3-bf6e-ea10d137dccf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:08.462847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2c4c711-2eb8-4cb3-bf6e-ea10d137dccf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:08.463597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2c4c711-2eb8-4cb3-bf6e-ea10d137dccf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:08.464056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2c4c711-2eb8-4cb3-bf6e-ea10d137dccf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:08.464507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2c4c711-2eb8-4cb3-bf6e-ea10d137dccf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:08.543770 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-78610c8f-7691-4927-ab2c-3f9a683896a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.110011 Sep 01 05:15:08.545497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 56/121] 10.222.0.49 () {60 vars in 1316 bytes} [Thu Sep 1 05:15:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:15:08.632345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c2c4c711-2eb8-4cb3-bf6e-ea10d137dccf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:08.641307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c2c4c711-2eb8-4cb3-bf6e-ea10d137dccf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.193249 Sep 01 05:15:08.646011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 66/122] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:08 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:08.671020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-528caa30-4003-4052-8073-5b233ce2b384 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:08.671750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-528caa30-4003-4052-8073-5b233ce2b384 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:08.678621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-528caa30-4003-4052-8073-5b233ce2b384 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:08.679308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-528caa30-4003-4052-8073-5b233ce2b384 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:08.679892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-528caa30-4003-4052-8073-5b233ce2b384 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:08.680593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-528caa30-4003-4052-8073-5b233ce2b384 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:08.681521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-528caa30-4003-4052-8073-5b233ce2b384 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:08.681959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-528caa30-4003-4052-8073-5b233ce2b384 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:08.865390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-4dc02846-3785-42fc-bfd7-ab2b45f1d45f req-73993453-5263-485f-9b82-77453a5d2cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9edb178-d264-4269-ae85-e2b524170b64", "name": "network-vif-plugged", "status": "completed", "tag": "fe7dc8dd-0874-4433-84e8-a98124ba174e"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:08.875397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4dc02846-3785-42fc-bfd7-ab2b45f1d45f req-73993453-5263-485f-9b82-77453a5d2cc5 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:08.875871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4dc02846-3785-42fc-bfd7-ab2b45f1d45f req-73993453-5263-485f-9b82-77453a5d2cc5 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:08.876484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4dc02846-3785-42fc-bfd7-ab2b45f1d45f req-73993453-5263-485f-9b82-77453a5d2cc5 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:08.898108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-4dc02846-3785-42fc-bfd7-ab2b45f1d45f req-73993453-5263-485f-9b82-77453a5d2cc5 service nova] Creating event network-vif-plugged:fe7dc8dd-0874-4433-84e8-a98124ba174e for instance f9edb178-d264-4269-ae85-e2b524170b64 on hv-cinder-85391 Sep 01 05:15:08.904456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-4dc02846-3785-42fc-bfd7-ab2b45f1d45f req-73993453-5263-485f-9b82-77453a5d2cc5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042250 Sep 01 05:15:08.905186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 67/123] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 01 05:15:09.098092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-528caa30-4003-4052-8073-5b233ce2b384 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:09.107797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-528caa30-4003-4052-8073-5b233ce2b384 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.441009 Sep 01 05:15:09.108646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 57/124] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:08 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:09.664021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3dd3e470-673d-4d27-a61d-6d640cfe8704 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:09.664868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3dd3e470-673d-4d27-a61d-6d640cfe8704 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:09.671081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3dd3e470-673d-4d27-a61d-6d640cfe8704 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:09.671569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3dd3e470-673d-4d27-a61d-6d640cfe8704 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:09.671998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3dd3e470-673d-4d27-a61d-6d640cfe8704 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:09.672685 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3dd3e470-673d-4d27-a61d-6d640cfe8704 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:09.673166 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3dd3e470-673d-4d27-a61d-6d640cfe8704 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:09.673633 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3dd3e470-673d-4d27-a61d-6d640cfe8704 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:09.809544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3dd3e470-673d-4d27-a61d-6d640cfe8704 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:09.817931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3dd3e470-673d-4d27-a61d-6d640cfe8704 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.158071 Sep 01 05:15:09.818499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 68/125] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:09 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:10.048619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-e8daafa3-1a5a-44ce-b2b0-25d562357d99 req-724fefca-3874-46fc-843d-9cdc275f4608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a582556-d184-4047-ac19-285c0edd2fdf", "tag": "6e571bd8-c64a-432f-894b-026d58cce109"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:10.059443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-e8daafa3-1a5a-44ce-b2b0-25d562357d99 req-724fefca-3874-46fc-843d-9cdc275f4608 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:10.059926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-e8daafa3-1a5a-44ce-b2b0-25d562357d99 req-724fefca-3874-46fc-843d-9cdc275f4608 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:10.060359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-e8daafa3-1a5a-44ce-b2b0-25d562357d99 req-724fefca-3874-46fc-843d-9cdc275f4608 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:10.072255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-e8daafa3-1a5a-44ce-b2b0-25d562357d99 req-724fefca-3874-46fc-843d-9cdc275f4608 service nova] Creating event network-changed:6e571bd8-c64a-432f-894b-026d58cce109 for instance 2a582556-d184-4047-ac19-285c0edd2fdf on hv-cinder-85391 Sep 01 05:15:10.077286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-e8daafa3-1a5a-44ce-b2b0-25d562357d99 req-724fefca-3874-46fc-843d-9cdc275f4608 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032199 Sep 01 05:15:10.077880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 58/126] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:15:10.130371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-aaa79257-0e27-450d-8a2d-0e66923c9cdf tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:10.131027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-aaa79257-0e27-450d-8a2d-0e66923c9cdf tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:10.137253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aaa79257-0e27-450d-8a2d-0e66923c9cdf tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:10.137747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aaa79257-0e27-450d-8a2d-0e66923c9cdf tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:10.138183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aaa79257-0e27-450d-8a2d-0e66923c9cdf tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:10.138920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aaa79257-0e27-450d-8a2d-0e66923c9cdf tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:10.139543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aaa79257-0e27-450d-8a2d-0e66923c9cdf tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:10.139972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aaa79257-0e27-450d-8a2d-0e66923c9cdf tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:10.272246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-aaa79257-0e27-450d-8a2d-0e66923c9cdf tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:10.281051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-aaa79257-0e27-450d-8a2d-0e66923c9cdf tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.155157 Sep 01 05:15:10.282031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 69/127] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:10 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:10.838956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-273828ce-3039-4b53-9c14-fe59f1b3adef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:10.839641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-273828ce-3039-4b53-9c14-fe59f1b3adef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:10.845988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-273828ce-3039-4b53-9c14-fe59f1b3adef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:10.846463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-273828ce-3039-4b53-9c14-fe59f1b3adef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:10.846912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-273828ce-3039-4b53-9c14-fe59f1b3adef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:10.847595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-273828ce-3039-4b53-9c14-fe59f1b3adef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:10.848040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-273828ce-3039-4b53-9c14-fe59f1b3adef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:10.848455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-273828ce-3039-4b53-9c14-fe59f1b3adef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:10.926089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-e2b15fa4-ee38-4f56-94a8-ab2abaa8781f req-a8ccb1a5-6f9f-4ebf-8cef-f59a3cc5515c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3674edea-d05c-428c-896e-938f3891acc1", "name": "network-vif-plugged", "status": "completed", "tag": "b84e0a09-0be3-4d95-aaaa-b1217f2ba513"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:10.935517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-e2b15fa4-ee38-4f56-94a8-ab2abaa8781f req-a8ccb1a5-6f9f-4ebf-8cef-f59a3cc5515c service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:10.935987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-e2b15fa4-ee38-4f56-94a8-ab2abaa8781f req-a8ccb1a5-6f9f-4ebf-8cef-f59a3cc5515c service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:10.936407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-e2b15fa4-ee38-4f56-94a8-ab2abaa8781f req-a8ccb1a5-6f9f-4ebf-8cef-f59a3cc5515c service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:10.952910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-e2b15fa4-ee38-4f56-94a8-ab2abaa8781f req-a8ccb1a5-6f9f-4ebf-8cef-f59a3cc5515c service nova] Creating event network-vif-plugged:b84e0a09-0be3-4d95-aaaa-b1217f2ba513 for instance 3674edea-d05c-428c-896e-938f3891acc1 on hv-cinder-85391 Sep 01 05:15:10.958513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-e2b15fa4-ee38-4f56-94a8-ab2abaa8781f req-a8ccb1a5-6f9f-4ebf-8cef-f59a3cc5515c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036948 Sep 01 05:15:10.959443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 70/128] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:15:10.987202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-273828ce-3039-4b53-9c14-fe59f1b3adef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:10.995480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-273828ce-3039-4b53-9c14-fe59f1b3adef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1322 microversion: 2.1 time: 0.160762 Sep 01 05:15:10.996038 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 59/129] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:10 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:11.302783 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e53701e1-2b97-4cbc-b6f7-db37517699ce tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:11.303305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e53701e1-2b97-4cbc-b6f7-db37517699ce tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:11.310702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e53701e1-2b97-4cbc-b6f7-db37517699ce tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:11.311260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e53701e1-2b97-4cbc-b6f7-db37517699ce tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:11.311773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e53701e1-2b97-4cbc-b6f7-db37517699ce tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:11.312530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e53701e1-2b97-4cbc-b6f7-db37517699ce tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:11.313204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e53701e1-2b97-4cbc-b6f7-db37517699ce tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:11.313618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e53701e1-2b97-4cbc-b6f7-db37517699ce tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:11.446501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e53701e1-2b97-4cbc-b6f7-db37517699ce tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:11.454194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e53701e1-2b97-4cbc-b6f7-db37517699ce tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.156383 Sep 01 05:15:11.454744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 71/130] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:11 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:12.016291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-28ad5d5b-e531-4d5b-af0f-2e60cc5ffa3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:12.016952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-28ad5d5b-e531-4d5b-af0f-2e60cc5ffa3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:12.024118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28ad5d5b-e531-4d5b-af0f-2e60cc5ffa3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:12.024646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28ad5d5b-e531-4d5b-af0f-2e60cc5ffa3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:12.025099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28ad5d5b-e531-4d5b-af0f-2e60cc5ffa3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:12.025769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28ad5d5b-e531-4d5b-af0f-2e60cc5ffa3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:12.026211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28ad5d5b-e531-4d5b-af0f-2e60cc5ffa3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:12.026877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28ad5d5b-e531-4d5b-af0f-2e60cc5ffa3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:12.166251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-28ad5d5b-e531-4d5b-af0f-2e60cc5ffa3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:12.173788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-28ad5d5b-e531-4d5b-af0f-2e60cc5ffa3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1516 microversion: 2.1 time: 0.161374 Sep 01 05:15:12.174321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 60/131] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:12 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:12.195506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-49cd634f-3772-4241-8e60-34c47d2c3346 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:12.197689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-49cd634f-3772-4241-8e60-34c47d2c3346 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:12.203563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49cd634f-3772-4241-8e60-34c47d2c3346 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:12.204039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49cd634f-3772-4241-8e60-34c47d2c3346 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:12.204462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49cd634f-3772-4241-8e60-34c47d2c3346 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:12.205162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49cd634f-3772-4241-8e60-34c47d2c3346 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:12.205612 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49cd634f-3772-4241-8e60-34c47d2c3346 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:12.206542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49cd634f-3772-4241-8e60-34c47d2c3346 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:12.268244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-49cd634f-3772-4241-8e60-34c47d2c3346 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lazy-loading 'flavor' on Instance uuid 266d4ced-afe8-4d91-a857-192e9315a28e {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:15:12.420633 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-49cd634f-3772-4241-8e60-34c47d2c3346 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "POST /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e/action" status: 200 len: 32 microversion: 2.1 time: 0.227998 Sep 01 05:15:12.422164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 72/132] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:15:12 2022] POST /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:15:12.434876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d955db53-d369-4a50-9d5c-62e6fad03b30 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:12.435378 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d955db53-d369-4a50-9d5c-62e6fad03b30 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:12.447007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d955db53-d369-4a50-9d5c-62e6fad03b30 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:12.450785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d955db53-d369-4a50-9d5c-62e6fad03b30 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:12.451821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d955db53-d369-4a50-9d5c-62e6fad03b30 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:12.454850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d955db53-d369-4a50-9d5c-62e6fad03b30 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:12.455352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d955db53-d369-4a50-9d5c-62e6fad03b30 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:12.460052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d955db53-d369-4a50-9d5c-62e6fad03b30 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:12.481124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8d6901dc-2c8a-4451-9557-eaebae98856a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:12.484065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8d6901dc-2c8a-4451-9557-eaebae98856a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:12.540283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d6901dc-2c8a-4451-9557-eaebae98856a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:12.541794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d6901dc-2c8a-4451-9557-eaebae98856a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:12.546929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d6901dc-2c8a-4451-9557-eaebae98856a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:12.547807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d6901dc-2c8a-4451-9557-eaebae98856a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:12.559880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d6901dc-2c8a-4451-9557-eaebae98856a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:12.563277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d6901dc-2c8a-4451-9557-eaebae98856a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:12.778385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8d6901dc-2c8a-4451-9557-eaebae98856a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:12.781874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:12.790527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8d6901dc-2c8a-4451-9557-eaebae98856a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.316562 Sep 01 05:15:12.804659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 73/133] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:12 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:12.807143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d955db53-d369-4a50-9d5c-62e6fad03b30 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:12.820070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d955db53-d369-4a50-9d5c-62e6fad03b30 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.390614 Sep 01 05:15:12.821209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 61/134] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:12 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:13.811634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-21252f95-aad8-4241-aa48-0455cbbb5377 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:13.812244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-21252f95-aad8-4241-aa48-0455cbbb5377 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:13.820445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21252f95-aad8-4241-aa48-0455cbbb5377 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:13.821347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21252f95-aad8-4241-aa48-0455cbbb5377 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:13.821779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21252f95-aad8-4241-aa48-0455cbbb5377 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:13.822640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21252f95-aad8-4241-aa48-0455cbbb5377 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:13.823237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21252f95-aad8-4241-aa48-0455cbbb5377 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:13.823903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21252f95-aad8-4241-aa48-0455cbbb5377 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:13.843428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a46bb5f7-25d6-4a29-b4ca-148755b7a59e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:13.844878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a46bb5f7-25d6-4a29-b4ca-148755b7a59e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:13.857650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a46bb5f7-25d6-4a29-b4ca-148755b7a59e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:13.858134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a46bb5f7-25d6-4a29-b4ca-148755b7a59e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:13.858751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a46bb5f7-25d6-4a29-b4ca-148755b7a59e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:13.861993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a46bb5f7-25d6-4a29-b4ca-148755b7a59e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:13.863117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a46bb5f7-25d6-4a29-b4ca-148755b7a59e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:13.863551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a46bb5f7-25d6-4a29-b4ca-148755b7a59e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:14.047211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-21252f95-aad8-4241-aa48-0455cbbb5377 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:14.057914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-21252f95-aad8-4241-aa48-0455cbbb5377 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.250206 Sep 01 05:15:14.060992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 74/135] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:13 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:14.136692 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a46bb5f7-25d6-4a29-b4ca-148755b7a59e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:14.146365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a46bb5f7-25d6-4a29-b4ca-148755b7a59e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.307223 Sep 01 05:15:14.161303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 62/136] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:13 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:15.080764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b5bfad0b-8bd7-4566-b6b8-13c2988cb5ba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:15.081806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b5bfad0b-8bd7-4566-b6b8-13c2988cb5ba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:15.089379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5bfad0b-8bd7-4566-b6b8-13c2988cb5ba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:15.089860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5bfad0b-8bd7-4566-b6b8-13c2988cb5ba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:15.090435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5bfad0b-8bd7-4566-b6b8-13c2988cb5ba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:15.091123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5bfad0b-8bd7-4566-b6b8-13c2988cb5ba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:15.091735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5bfad0b-8bd7-4566-b6b8-13c2988cb5ba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:15.092380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5bfad0b-8bd7-4566-b6b8-13c2988cb5ba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:15.169687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ec88f29f-ebf4-48fb-899e-6a100afe4316 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:15.170294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ec88f29f-ebf4-48fb-899e-6a100afe4316 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:15.184363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec88f29f-ebf4-48fb-899e-6a100afe4316 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:15.186794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec88f29f-ebf4-48fb-899e-6a100afe4316 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:15.187232 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec88f29f-ebf4-48fb-899e-6a100afe4316 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:15.188258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec88f29f-ebf4-48fb-899e-6a100afe4316 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:15.189269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec88f29f-ebf4-48fb-899e-6a100afe4316 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:15.191228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec88f29f-ebf4-48fb-899e-6a100afe4316 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:15.271723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b5bfad0b-8bd7-4566-b6b8-13c2988cb5ba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:15.280377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b5bfad0b-8bd7-4566-b6b8-13c2988cb5ba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.203391 Sep 01 05:15:15.281005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 75/137] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:15 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:15.373003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ec88f29f-ebf4-48fb-899e-6a100afe4316 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:15.382574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ec88f29f-ebf4-48fb-899e-6a100afe4316 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.216490 Sep 01 05:15:15.384996 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 63/138] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:15 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:16.303170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-84daedb2-6e18-4c83-9c6d-bba4f00a4a1f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:16.303777 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-84daedb2-6e18-4c83-9c6d-bba4f00a4a1f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:16.306663 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=98 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:16.310469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84daedb2-6e18-4c83-9c6d-bba4f00a4a1f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:16.310947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84daedb2-6e18-4c83-9c6d-bba4f00a4a1f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:16.311374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84daedb2-6e18-4c83-9c6d-bba4f00a4a1f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:16.312063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84daedb2-6e18-4c83-9c6d-bba4f00a4a1f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:16.312508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84daedb2-6e18-4c83-9c6d-bba4f00a4a1f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:16.313245 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84daedb2-6e18-4c83-9c6d-bba4f00a4a1f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:16.404720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7d0219e0-61d7-49bc-9ae9-59f5598ac1d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:16.406115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7d0219e0-61d7-49bc-9ae9-59f5598ac1d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:16.415648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d0219e0-61d7-49bc-9ae9-59f5598ac1d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:16.416145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d0219e0-61d7-49bc-9ae9-59f5598ac1d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:16.416896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d0219e0-61d7-49bc-9ae9-59f5598ac1d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:16.418484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d0219e0-61d7-49bc-9ae9-59f5598ac1d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:16.419012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d0219e0-61d7-49bc-9ae9-59f5598ac1d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:16.419959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d0219e0-61d7-49bc-9ae9-59f5598ac1d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:16.552990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-84daedb2-6e18-4c83-9c6d-bba4f00a4a1f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:16.561719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-84daedb2-6e18-4c83-9c6d-bba4f00a4a1f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.262253 Sep 01 05:15:16.562295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 76/139] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:16 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:16.571460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7d0219e0-61d7-49bc-9ae9-59f5598ac1d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:16.579483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7d0219e0-61d7-49bc-9ae9-59f5598ac1d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.178899 Sep 01 05:15:16.580048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 64/140] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:16 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:17.585216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-532555b7-900c-425a-b4f9-efbe87b3b510 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:17.586023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-532555b7-900c-425a-b4f9-efbe87b3b510 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:17.598549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-532555b7-900c-425a-b4f9-efbe87b3b510 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:17.599578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-532555b7-900c-425a-b4f9-efbe87b3b510 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:17.600432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-532555b7-900c-425a-b4f9-efbe87b3b510 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:17.601443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-532555b7-900c-425a-b4f9-efbe87b3b510 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:17.602009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-532555b7-900c-425a-b4f9-efbe87b3b510 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:17.602527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-532555b7-900c-425a-b4f9-efbe87b3b510 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:17.603570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ce8fdcda-6a26-4aaf-a816-31508c7c6f84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:17.604903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ce8fdcda-6a26-4aaf-a816-31508c7c6f84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:17.617057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce8fdcda-6a26-4aaf-a816-31508c7c6f84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:17.617577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce8fdcda-6a26-4aaf-a816-31508c7c6f84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:17.618016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce8fdcda-6a26-4aaf-a816-31508c7c6f84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:17.619659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce8fdcda-6a26-4aaf-a816-31508c7c6f84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:17.620122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce8fdcda-6a26-4aaf-a816-31508c7c6f84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:17.620548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce8fdcda-6a26-4aaf-a816-31508c7c6f84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:17.625302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:17.761154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-532555b7-900c-425a-b4f9-efbe87b3b510 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:17.769543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-532555b7-900c-425a-b4f9-efbe87b3b510 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1363 microversion: 2.1 time: 0.190654 Sep 01 05:15:17.770387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 77/141] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:17 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:17.787440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ce8fdcda-6a26-4aaf-a816-31508c7c6f84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:17.795938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ce8fdcda-6a26-4aaf-a816-31508c7c6f84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.198191 Sep 01 05:15:17.796749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 65/142] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:17 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:18.779297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1309126711", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "networks": [{"uuid": "740d7186-3463-429c-a205-ef43d7ad53e2"}]}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:18.795989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-29ee8a39-f2ed-4ece-a783-305c706eb1c0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:18.797118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-29ee8a39-f2ed-4ece-a783-305c706eb1c0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:18.806993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29ee8a39-f2ed-4ece-a783-305c706eb1c0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:18.807479 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29ee8a39-f2ed-4ece-a783-305c706eb1c0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:18.807909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29ee8a39-f2ed-4ece-a783-305c706eb1c0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:18.808964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29ee8a39-f2ed-4ece-a783-305c706eb1c0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:18.809414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29ee8a39-f2ed-4ece-a783-305c706eb1c0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:18.809852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29ee8a39-f2ed-4ece-a783-305c706eb1c0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:18.842268 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.network.neutron [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] validate_networks() for [('740d7186-3463-429c-a205-ef43d7ad53e2', None, None, None, None, None)] {{(pid=120674) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:15:18.957917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-29ee8a39-f2ed-4ece-a783-305c706eb1c0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:18.966022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-29ee8a39-f2ed-4ece-a783-305c706eb1c0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1550 microversion: 2.1 time: 0.173756 Sep 01 05:15:18.966747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 66/143] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:18 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1550 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:18.973021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-48258694-706d-40e3-ba01-ccb93eeb5f92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:18.973946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-48258694-706d-40e3-ba01-ccb93eeb5f92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:18.980800 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48258694-706d-40e3-ba01-ccb93eeb5f92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:18.981644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48258694-706d-40e3-ba01-ccb93eeb5f92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:18.982504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48258694-706d-40e3-ba01-ccb93eeb5f92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:18.983607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48258694-706d-40e3-ba01-ccb93eeb5f92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:18.984515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48258694-706d-40e3-ba01-ccb93eeb5f92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:18.985021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48258694-706d-40e3-ba01-ccb93eeb5f92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:19.166384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-48258694-706d-40e3-ba01-ccb93eeb5f92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:19.174346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-48258694-706d-40e3-ba01-ccb93eeb5f92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.206780 Sep 01 05:15:19.175438 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 67/144] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:18 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:19.189674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5fd48bce-6007-466d-9065-7791defa8634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:19.193705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5fd48bce-6007-466d-9065-7791defa8634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fd48bce-6007-466d-9065-7791defa8634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:19.201012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fd48bce-6007-466d-9065-7791defa8634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:19.201509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fd48bce-6007-466d-9065-7791defa8634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:19.202463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fd48bce-6007-466d-9065-7791defa8634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:19.203113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fd48bce-6007-466d-9065-7791defa8634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:19.203536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fd48bce-6007-466d-9065-7791defa8634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:19.296211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5fd48bce-6007-466d-9065-7791defa8634 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119205 Sep 01 05:15:19.296901 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 68/145] 10.222.0.49 () {58 vars in 1275 bytes} [Thu Sep 1 05:15:19 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:19.444794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Flavor limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:15:19.445215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Image limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:15:19.445677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Flavor pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:15:19.446078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Image pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:15:19.446476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:15:19.455667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:19.456153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:19.456606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:19.457379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:19.457825 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:19.458239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:19.477498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Getting quotas for project 66f6958ea49445f780bcec5d8b86840d. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:15:19.481922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Getting quotas for user 075c5a476ec14386afb0f9f16b66f7f9 and project 66f6958ea49445f780bcec5d8b86840d. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:15:19.494551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Going to run 1 instances... {{(pid=120674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:15:19.497311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:15:19.559582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5ae934b7-8eba-40a5-974f-b646ce167cbd tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783982 Sep 01 05:15:19.560720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 78/146] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:15:19.571120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-38f47f20-fd69-488f-b4a8-a913132a758e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:19.571676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-38f47f20-fd69-488f-b4a8-a913132a758e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:19.642180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-38f47f20-fd69-488f-b4a8-a913132a758e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:19.650790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-38f47f20-fd69-488f-b4a8-a913132a758e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1214 microversion: 2.1 time: 0.083434 Sep 01 05:15:19.653740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 69/147] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:19 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:20.199213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9487587b-44f1-4c37-8496-e7676a633eb4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:20.201766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9487587b-44f1-4c37-8496-e7676a633eb4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:20.209777 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9487587b-44f1-4c37-8496-e7676a633eb4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:20.211430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9487587b-44f1-4c37-8496-e7676a633eb4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:20.212353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9487587b-44f1-4c37-8496-e7676a633eb4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:20.213347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9487587b-44f1-4c37-8496-e7676a633eb4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:20.214197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9487587b-44f1-4c37-8496-e7676a633eb4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:20.214902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9487587b-44f1-4c37-8496-e7676a633eb4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:20.370008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9487587b-44f1-4c37-8496-e7676a633eb4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:20.382344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9487587b-44f1-4c37-8496-e7676a633eb4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.190398 Sep 01 05:15:20.383157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 79/148] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:20 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:20.476842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-92ffd979-7925-4e98-8f00-8581353e6a11 req-bf728a70-c879-4bca-9a56-9045a15463b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3674edea-d05c-428c-896e-938f3891acc1", "tag": "b84e0a09-0be3-4d95-aaaa-b1217f2ba513"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:20.488567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-92ffd979-7925-4e98-8f00-8581353e6a11 req-bf728a70-c879-4bca-9a56-9045a15463b0 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:20.489062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-92ffd979-7925-4e98-8f00-8581353e6a11 req-bf728a70-c879-4bca-9a56-9045a15463b0 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:20.489485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-92ffd979-7925-4e98-8f00-8581353e6a11 req-bf728a70-c879-4bca-9a56-9045a15463b0 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:20.501052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-92ffd979-7925-4e98-8f00-8581353e6a11 req-bf728a70-c879-4bca-9a56-9045a15463b0 service nova] Creating event network-changed:b84e0a09-0be3-4d95-aaaa-b1217f2ba513 for instance 3674edea-d05c-428c-896e-938f3891acc1 on hv-cinder-85391 Sep 01 05:15:20.506950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-92ffd979-7925-4e98-8f00-8581353e6a11 req-bf728a70-c879-4bca-9a56-9045a15463b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033937 Sep 01 05:15:20.508084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 70/149] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:20.677587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c8e58a59-878e-4824-a6e2-6de54b0f87d9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:20.678529 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c8e58a59-878e-4824-a6e2-6de54b0f87d9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:20.687782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c8e58a59-878e-4824-a6e2-6de54b0f87d9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:20.688875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c8e58a59-878e-4824-a6e2-6de54b0f87d9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:20.689614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c8e58a59-878e-4824-a6e2-6de54b0f87d9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:20.692739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c8e58a59-878e-4824-a6e2-6de54b0f87d9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:20.693852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c8e58a59-878e-4824-a6e2-6de54b0f87d9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:20.695620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c8e58a59-878e-4824-a6e2-6de54b0f87d9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:20.768950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c8e58a59-878e-4824-a6e2-6de54b0f87d9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:20.777304 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c8e58a59-878e-4824-a6e2-6de54b0f87d9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1218 microversion: 2.1 time: 0.106191 Sep 01 05:15:20.794444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 80/150] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:20 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:21.403981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0a7b598c-1b5f-4207-b4ba-47e9ef775854 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:21.404695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0a7b598c-1b5f-4207-b4ba-47e9ef775854 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:21.411049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a7b598c-1b5f-4207-b4ba-47e9ef775854 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:21.411528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a7b598c-1b5f-4207-b4ba-47e9ef775854 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:21.411957 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a7b598c-1b5f-4207-b4ba-47e9ef775854 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:21.412648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a7b598c-1b5f-4207-b4ba-47e9ef775854 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:21.413124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a7b598c-1b5f-4207-b4ba-47e9ef775854 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:21.413542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a7b598c-1b5f-4207-b4ba-47e9ef775854 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:21.548174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0a7b598c-1b5f-4207-b4ba-47e9ef775854 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:21.556930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0a7b598c-1b5f-4207-b4ba-47e9ef775854 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.157074 Sep 01 05:15:21.557513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 71/151] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:21 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:21.816070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-77cd03b3-cfcd-48bb-a361-60187b55b85e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:21.816610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-77cd03b3-cfcd-48bb-a361-60187b55b85e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:21.822849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77cd03b3-cfcd-48bb-a361-60187b55b85e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:21.823416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77cd03b3-cfcd-48bb-a361-60187b55b85e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:21.823854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77cd03b3-cfcd-48bb-a361-60187b55b85e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:21.824534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77cd03b3-cfcd-48bb-a361-60187b55b85e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:21.825013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77cd03b3-cfcd-48bb-a361-60187b55b85e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:21.825435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77cd03b3-cfcd-48bb-a361-60187b55b85e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:21.884939 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-77cd03b3-cfcd-48bb-a361-60187b55b85e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:21.892548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-77cd03b3-cfcd-48bb-a361-60187b55b85e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1218 microversion: 2.1 time: 0.080647 Sep 01 05:15:21.893765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 81/152] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:21 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:22.578009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-92169939-3414-47fb-a93f-1ffb87e1df79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:22.578613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-92169939-3414-47fb-a93f-1ffb87e1df79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:22.585112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92169939-3414-47fb-a93f-1ffb87e1df79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.585584 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92169939-3414-47fb-a93f-1ffb87e1df79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.586015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92169939-3414-47fb-a93f-1ffb87e1df79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.586688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92169939-3414-47fb-a93f-1ffb87e1df79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.587127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92169939-3414-47fb-a93f-1ffb87e1df79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.587539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92169939-3414-47fb-a93f-1ffb87e1df79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.714163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-92169939-3414-47fb-a93f-1ffb87e1df79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:22.721828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-92169939-3414-47fb-a93f-1ffb87e1df79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.147624 Sep 01 05:15:22.722386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 72/153] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:22 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:22.915183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b1031194-201b-4542-85d3-1a261dbe2455 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:22.915794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b1031194-201b-4542-85d3-1a261dbe2455 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:22.921846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1031194-201b-4542-85d3-1a261dbe2455 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.922322 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1031194-201b-4542-85d3-1a261dbe2455 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.922750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1031194-201b-4542-85d3-1a261dbe2455 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.923426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1031194-201b-4542-85d3-1a261dbe2455 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.923869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1031194-201b-4542-85d3-1a261dbe2455 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.924874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1031194-201b-4542-85d3-1a261dbe2455 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.984944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b1031194-201b-4542-85d3-1a261dbe2455 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:22.993991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b1031194-201b-4542-85d3-1a261dbe2455 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1218 microversion: 2.1 time: 0.082599 Sep 01 05:15:22.994676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 82/154] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:22 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:23.745224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ad88758e-6b1c-4570-843a-edaba7ab3ba0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:23.746353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ad88758e-6b1c-4570-843a-edaba7ab3ba0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:23.750142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=86 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:23.756813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ad88758e-6b1c-4570-843a-edaba7ab3ba0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.757327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ad88758e-6b1c-4570-843a-edaba7ab3ba0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.757759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ad88758e-6b1c-4570-843a-edaba7ab3ba0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.758639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ad88758e-6b1c-4570-843a-edaba7ab3ba0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.759096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ad88758e-6b1c-4570-843a-edaba7ab3ba0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.759519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ad88758e-6b1c-4570-843a-edaba7ab3ba0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:24.015066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9561ed60-40f0-473a-b355-47cf22fa61db tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:24.015683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9561ed60-40f0-473a-b355-47cf22fa61db tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:24.022437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9561ed60-40f0-473a-b355-47cf22fa61db tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:24.023121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9561ed60-40f0-473a-b355-47cf22fa61db tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:24.023719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9561ed60-40f0-473a-b355-47cf22fa61db tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:24.024584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9561ed60-40f0-473a-b355-47cf22fa61db tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:24.025222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9561ed60-40f0-473a-b355-47cf22fa61db tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:24.025715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9561ed60-40f0-473a-b355-47cf22fa61db tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:24.104615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ad88758e-6b1c-4570-843a-edaba7ab3ba0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:24.130879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ad88758e-6b1c-4570-843a-edaba7ab3ba0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.391756 Sep 01 05:15:24.146395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 73/155] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:23 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:24.317330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9561ed60-40f0-473a-b355-47cf22fa61db tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:24.325327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9561ed60-40f0-473a-b355-47cf22fa61db tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1266 microversion: 2.1 time: 0.313987 Sep 01 05:15:24.325893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 83/156] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:24 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:24.587640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f3378f11-34d9-4fa0-bc87-f291d49cf2a2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:24.588185 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f3378f11-34d9-4fa0-bc87-f291d49cf2a2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:24.627443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3378f11-34d9-4fa0-bc87-f291d49cf2a2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:24.628146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3378f11-34d9-4fa0-bc87-f291d49cf2a2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:24.628793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3378f11-34d9-4fa0-bc87-f291d49cf2a2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:24.635031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3378f11-34d9-4fa0-bc87-f291d49cf2a2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:24.635515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3378f11-34d9-4fa0-bc87-f291d49cf2a2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:24.636434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3378f11-34d9-4fa0-bc87-f291d49cf2a2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:24.670413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f3378f11-34d9-4fa0-bc87-f291d49cf2a2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:15:24.787168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f3378f11-34d9-4fa0-bc87-f291d49cf2a2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "DELETE /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 204 len: 0 microversion: 2.1 time: 0.207240 Sep 01 05:15:24.791529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 74/157] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:24 2022] DELETE /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:15:24.796267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-14fdbaa7-74d2-4840-ae63-ce70d4c73b12 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:24.796983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-14fdbaa7-74d2-4840-ae63-ce70d4c73b12 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:24.803802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14fdbaa7-74d2-4840-ae63-ce70d4c73b12 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:24.804297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14fdbaa7-74d2-4840-ae63-ce70d4c73b12 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:24.805027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14fdbaa7-74d2-4840-ae63-ce70d4c73b12 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:24.805731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14fdbaa7-74d2-4840-ae63-ce70d4c73b12 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:24.806182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14fdbaa7-74d2-4840-ae63-ce70d4c73b12 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:24.806605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14fdbaa7-74d2-4840-ae63-ce70d4c73b12 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:24.939458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-14fdbaa7-74d2-4840-ae63-ce70d4c73b12 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:24.949914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-14fdbaa7-74d2-4840-ae63-ce70d4c73b12 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1554 microversion: 2.1 time: 0.157657 Sep 01 05:15:24.950482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 84/158] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:24 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:25.155471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-06cae727-150e-493e-b94c-30596f0f2618 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:25.156159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-06cae727-150e-493e-b94c-30596f0f2618 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:25.162576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06cae727-150e-493e-b94c-30596f0f2618 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:25.163053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06cae727-150e-493e-b94c-30596f0f2618 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:25.163479 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06cae727-150e-493e-b94c-30596f0f2618 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:25.164154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06cae727-150e-493e-b94c-30596f0f2618 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:25.164595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06cae727-150e-493e-b94c-30596f0f2618 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:25.165035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06cae727-150e-493e-b94c-30596f0f2618 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:25.350328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-31532fbb-edc3-451a-bb91-08409d3e67a5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:25.351650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-31532fbb-edc3-451a-bb91-08409d3e67a5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:25.362734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31532fbb-edc3-451a-bb91-08409d3e67a5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:25.363673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31532fbb-edc3-451a-bb91-08409d3e67a5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:25.364321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31532fbb-edc3-451a-bb91-08409d3e67a5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:25.369154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31532fbb-edc3-451a-bb91-08409d3e67a5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:25.370148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31532fbb-edc3-451a-bb91-08409d3e67a5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:25.370961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31532fbb-edc3-451a-bb91-08409d3e67a5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:25.410664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-06cae727-150e-493e-b94c-30596f0f2618 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:25.420299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-06cae727-150e-493e-b94c-30596f0f2618 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.268762 Sep 01 05:15:25.433874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 75/159] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:25 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:25.532964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-31532fbb-edc3-451a-bb91-08409d3e67a5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:25.541293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-31532fbb-edc3-451a-bb91-08409d3e67a5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.198401 Sep 01 05:15:25.541990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 85/160] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:25 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:25.971802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a5f52624-52b0-49a2-9d32-869fb6bbaeb2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:25.972473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a5f52624-52b0-49a2-9d32-869fb6bbaeb2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:25.979115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5f52624-52b0-49a2-9d32-869fb6bbaeb2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:25.979594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5f52624-52b0-49a2-9d32-869fb6bbaeb2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:25.980025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5f52624-52b0-49a2-9d32-869fb6bbaeb2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:25.980705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5f52624-52b0-49a2-9d32-869fb6bbaeb2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:25.981185 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5f52624-52b0-49a2-9d32-869fb6bbaeb2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:25.981598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5f52624-52b0-49a2-9d32-869fb6bbaeb2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:26.120130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a5f52624-52b0-49a2-9d32-869fb6bbaeb2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:26.128923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a5f52624-52b0-49a2-9d32-869fb6bbaeb2 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1554 microversion: 2.1 time: 0.161503 Sep 01 05:15:26.129487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 76/161] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:25 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:26.443804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d08c03d0-9a1d-4e06-a4ac-1d6656928523 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:26.444418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d08c03d0-9a1d-4e06-a4ac-1d6656928523 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:26.450323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d08c03d0-9a1d-4e06-a4ac-1d6656928523 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:26.450806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d08c03d0-9a1d-4e06-a4ac-1d6656928523 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:26.451235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d08c03d0-9a1d-4e06-a4ac-1d6656928523 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:26.451917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d08c03d0-9a1d-4e06-a4ac-1d6656928523 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:26.452362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d08c03d0-9a1d-4e06-a4ac-1d6656928523 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:26.452830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d08c03d0-9a1d-4e06-a4ac-1d6656928523 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:26.562903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cf85fdac-638f-4a2e-97be-1da74fda807b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:26.563895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cf85fdac-638f-4a2e-97be-1da74fda807b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:26.571587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf85fdac-638f-4a2e-97be-1da74fda807b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:26.572056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf85fdac-638f-4a2e-97be-1da74fda807b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:26.572488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf85fdac-638f-4a2e-97be-1da74fda807b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:26.573194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf85fdac-638f-4a2e-97be-1da74fda807b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:26.573643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf85fdac-638f-4a2e-97be-1da74fda807b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:26.574055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf85fdac-638f-4a2e-97be-1da74fda807b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:26.586664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d08c03d0-9a1d-4e06-a4ac-1d6656928523 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:26.598389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d08c03d0-9a1d-4e06-a4ac-1d6656928523 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.159271 Sep 01 05:15:26.599006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 86/162] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:26 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:26.715736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cf85fdac-638f-4a2e-97be-1da74fda807b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:26.723726 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cf85fdac-638f-4a2e-97be-1da74fda807b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.164667 Sep 01 05:15:26.724278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 77/163] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:26 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:27.150048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1a25e21f-5945-49a5-bc91-ae63b55eb829 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:27.150735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1a25e21f-5945-49a5-bc91-ae63b55eb829 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:27.157061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a25e21f-5945-49a5-bc91-ae63b55eb829 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:27.157553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a25e21f-5945-49a5-bc91-ae63b55eb829 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:27.157991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a25e21f-5945-49a5-bc91-ae63b55eb829 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:27.158686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a25e21f-5945-49a5-bc91-ae63b55eb829 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:27.159139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a25e21f-5945-49a5-bc91-ae63b55eb829 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:27.159564 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a25e21f-5945-49a5-bc91-ae63b55eb829 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:27.325121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1a25e21f-5945-49a5-bc91-ae63b55eb829 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:27.334317 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1a25e21f-5945-49a5-bc91-ae63b55eb829 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1554 microversion: 2.1 time: 0.188351 Sep 01 05:15:27.335187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 87/164] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:27 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:27.621159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e5080434-49b0-41d4-a3ed-75c7f849a370 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:27.621846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e5080434-49b0-41d4-a3ed-75c7f849a370 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:27.628809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e5080434-49b0-41d4-a3ed-75c7f849a370 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:27.629274 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e5080434-49b0-41d4-a3ed-75c7f849a370 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:27.629701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e5080434-49b0-41d4-a3ed-75c7f849a370 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:27.630477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e5080434-49b0-41d4-a3ed-75c7f849a370 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:27.632972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e5080434-49b0-41d4-a3ed-75c7f849a370 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:27.633707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e5080434-49b0-41d4-a3ed-75c7f849a370 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:27.744517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dbeb0cf3-ccbd-478b-85a7-42e43f22b2c5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:27.745223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dbeb0cf3-ccbd-478b-85a7-42e43f22b2c5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:27.751094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbeb0cf3-ccbd-478b-85a7-42e43f22b2c5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:27.751570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbeb0cf3-ccbd-478b-85a7-42e43f22b2c5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:27.751999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbeb0cf3-ccbd-478b-85a7-42e43f22b2c5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:27.753064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbeb0cf3-ccbd-478b-85a7-42e43f22b2c5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:27.753260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbeb0cf3-ccbd-478b-85a7-42e43f22b2c5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:27.753667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbeb0cf3-ccbd-478b-85a7-42e43f22b2c5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:27.828719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e5080434-49b0-41d4-a3ed-75c7f849a370 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:27.838169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e5080434-49b0-41d4-a3ed-75c7f849a370 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.221449 Sep 01 05:15:27.838828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 78/165] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:27 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:27.843450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-cc28303a-c958-4cb9-bb31-2b057bd5451c req-ce765243-6fd9-40cf-aa76-ccce182d4663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e969189e-c347-414c-a696-7b8bf28398f4", "tag": "eb9f60e7-fa3b-470f-b52c-5fb70ef0ebf5"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:27.854830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-cc28303a-c958-4cb9-bb31-2b057bd5451c req-ce765243-6fd9-40cf-aa76-ccce182d4663 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:27.855503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-cc28303a-c958-4cb9-bb31-2b057bd5451c req-ce765243-6fd9-40cf-aa76-ccce182d4663 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:27.856026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-cc28303a-c958-4cb9-bb31-2b057bd5451c req-ce765243-6fd9-40cf-aa76-ccce182d4663 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:27.867167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-cc28303a-c958-4cb9-bb31-2b057bd5451c req-ce765243-6fd9-40cf-aa76-ccce182d4663 service nova] Creating event network-changed:eb9f60e7-fa3b-470f-b52c-5fb70ef0ebf5 for instance e969189e-c347-414c-a696-7b8bf28398f4 on hv-cinder-85391 Sep 01 05:15:27.871992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-cc28303a-c958-4cb9-bb31-2b057bd5451c req-ce765243-6fd9-40cf-aa76-ccce182d4663 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031911 Sep 01 05:15:27.872587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 79/166] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:27.886735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dbeb0cf3-ccbd-478b-85a7-42e43f22b2c5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:27.894910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dbeb0cf3-ccbd-478b-85a7-42e43f22b2c5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.154294 Sep 01 05:15:27.895583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 88/167] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:27 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:28.356733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-45295937-93cf-45d8-af38-4d9d9235b53c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:28.357894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-45295937-93cf-45d8-af38-4d9d9235b53c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:28.364708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45295937-93cf-45d8-af38-4d9d9235b53c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:28.365326 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45295937-93cf-45d8-af38-4d9d9235b53c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:28.366015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45295937-93cf-45d8-af38-4d9d9235b53c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:28.366926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45295937-93cf-45d8-af38-4d9d9235b53c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:28.367449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45295937-93cf-45d8-af38-4d9d9235b53c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:28.367935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45295937-93cf-45d8-af38-4d9d9235b53c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:28.860194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ed20875d-bd4b-45ac-aee8-60b9579ee042 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:28.862547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ed20875d-bd4b-45ac-aee8-60b9579ee042 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:28.877964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed20875d-bd4b-45ac-aee8-60b9579ee042 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:28.879334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed20875d-bd4b-45ac-aee8-60b9579ee042 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:28.880157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed20875d-bd4b-45ac-aee8-60b9579ee042 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:28.882635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed20875d-bd4b-45ac-aee8-60b9579ee042 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:28.883393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed20875d-bd4b-45ac-aee8-60b9579ee042 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:28.883946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed20875d-bd4b-45ac-aee8-60b9579ee042 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:28.993449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-45295937-93cf-45d8-af38-4d9d9235b53c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:29.006795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-45295937-93cf-45d8-af38-4d9d9235b53c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1554 microversion: 2.1 time: 0.654995 Sep 01 05:15:29.007396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 80/168] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:28 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1554 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:29.018706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bc7cb29d-6fcc-436c-ae48-e0ad852d8b16 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:29.019556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bc7cb29d-6fcc-436c-ae48-e0ad852d8b16 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:29.026474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc7cb29d-6fcc-436c-ae48-e0ad852d8b16 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:29.027205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc7cb29d-6fcc-436c-ae48-e0ad852d8b16 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:29.027739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc7cb29d-6fcc-436c-ae48-e0ad852d8b16 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:29.028679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc7cb29d-6fcc-436c-ae48-e0ad852d8b16 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:29.029413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc7cb29d-6fcc-436c-ae48-e0ad852d8b16 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:29.029929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc7cb29d-6fcc-436c-ae48-e0ad852d8b16 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:29.083883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ed20875d-bd4b-45ac-aee8-60b9579ee042 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:29.095315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ed20875d-bd4b-45ac-aee8-60b9579ee042 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.238921 Sep 01 05:15:29.097030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 89/169] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:28 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:29.459993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bc7cb29d-6fcc-436c-ae48-e0ad852d8b16 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:29.469545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bc7cb29d-6fcc-436c-ae48-e0ad852d8b16 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.455220 Sep 01 05:15:29.471809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 81/170] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:29 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:29.886688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-28fcf29c-1751-4c2a-b0a0-d38dcbf55834 req-6762ca4a-9513-46ee-9bfe-8196c44e0017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52140d99-84e5-4f90-bc00-1b9d431b8c52", "name": "network-vif-deleted", "tag": "b4770713-261c-4b2a-9e65-3bb6e7b77741"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:29.892361 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:29.893641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=6 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:29.905629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-28fcf29c-1751-4c2a-b0a0-d38dcbf55834 req-6762ca4a-9513-46ee-9bfe-8196c44e0017 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:29.905629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-28fcf29c-1751-4c2a-b0a0-d38dcbf55834 req-6762ca4a-9513-46ee-9bfe-8196c44e0017 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:29.905629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-28fcf29c-1751-4c2a-b0a0-d38dcbf55834 req-6762ca4a-9513-46ee-9bfe-8196c44e0017 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:29.914394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-28fcf29c-1751-4c2a-b0a0-d38dcbf55834 req-6762ca4a-9513-46ee-9bfe-8196c44e0017 service nova] Creating event network-vif-deleted:b4770713-261c-4b2a-9e65-3bb6e7b77741 for instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 on hv-cinder-85391 Sep 01 05:15:29.919640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-28fcf29c-1751-4c2a-b0a0-d38dcbf55834 req-6762ca4a-9513-46ee-9bfe-8196c44e0017 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036744 Sep 01 05:15:29.920241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 90/171] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:30.027466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cd74ad60-d015-4d8c-9ced-477cfef7617c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:30.028266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cd74ad60-d015-4d8c-9ced-477cfef7617c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:30.031022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:30.037696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd74ad60-d015-4d8c-9ced-477cfef7617c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:30.038180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd74ad60-d015-4d8c-9ced-477cfef7617c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:30.038640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd74ad60-d015-4d8c-9ced-477cfef7617c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:30.039332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd74ad60-d015-4d8c-9ced-477cfef7617c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:30.039778 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd74ad60-d015-4d8c-9ced-477cfef7617c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:30.040205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd74ad60-d015-4d8c-9ced-477cfef7617c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:30.114209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cd74ad60-d015-4d8c-9ced-477cfef7617c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:30.118604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-acac86e6-b753-4508-8330-e172391a1af4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:30.119625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-acac86e6-b753-4508-8330-e172391a1af4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:30.121428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:30.124642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cd74ad60-d015-4d8c-9ced-477cfef7617c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1346 microversion: 2.1 time: 0.101088 Sep 01 05:15:30.125437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 82/172] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:30 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:30.126382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-acac86e6-b753-4508-8330-e172391a1af4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:30.126995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-acac86e6-b753-4508-8330-e172391a1af4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:30.127746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-acac86e6-b753-4508-8330-e172391a1af4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:30.128530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-acac86e6-b753-4508-8330-e172391a1af4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:30.129735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-acac86e6-b753-4508-8330-e172391a1af4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:30.130319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-acac86e6-b753-4508-8330-e172391a1af4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:30.273420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-acac86e6-b753-4508-8330-e172391a1af4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:30.277302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:30.284086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-acac86e6-b753-4508-8330-e172391a1af4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.170011 Sep 01 05:15:30.284803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 91/173] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:30 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:30.491731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4046be19-4685-4322-9ae7-ab2851f02adf tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:30.492342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4046be19-4685-4322-9ae7-ab2851f02adf tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:30.501100 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4046be19-4685-4322-9ae7-ab2851f02adf tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:30.501584 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4046be19-4685-4322-9ae7-ab2851f02adf tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:30.502042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4046be19-4685-4322-9ae7-ab2851f02adf tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:30.502739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4046be19-4685-4322-9ae7-ab2851f02adf tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:30.503337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4046be19-4685-4322-9ae7-ab2851f02adf tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:30.503765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4046be19-4685-4322-9ae7-ab2851f02adf tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:30.663943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4046be19-4685-4322-9ae7-ab2851f02adf tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:30.673291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4046be19-4685-4322-9ae7-ab2851f02adf tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.185245 Sep 01 05:15:30.684889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 83/174] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:30 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:31.147201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:31.147888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:31.155077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:31.155856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:31.156545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:31.157650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:31.158483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:31.159145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:31.195117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:31.195604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:31.196180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:31.196856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lazy-loading 'fault' on Instance uuid 52140d99-84e5-4f90-bc00-1b9d431b8c52 {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:15:31.247953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:31.258170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c0409bc7-3971-4603-a48e-870d3fa89d19 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1351 microversion: 2.1 time: 0.115215 Sep 01 05:15:31.258749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 92/175] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:31 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:31.305493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-281d49a8-df47-4808-a2c5-59cf98e6af8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:31.306067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-281d49a8-df47-4808-a2c5-59cf98e6af8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:31.312676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-281d49a8-df47-4808-a2c5-59cf98e6af8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:31.313191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-281d49a8-df47-4808-a2c5-59cf98e6af8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:31.313619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-281d49a8-df47-4808-a2c5-59cf98e6af8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:31.314322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-281d49a8-df47-4808-a2c5-59cf98e6af8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:31.314994 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-281d49a8-df47-4808-a2c5-59cf98e6af8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:31.315478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-281d49a8-df47-4808-a2c5-59cf98e6af8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:31.449856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-281d49a8-df47-4808-a2c5-59cf98e6af8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:31.458195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-281d49a8-df47-4808-a2c5-59cf98e6af8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.156556 Sep 01 05:15:31.459073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 84/176] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:31 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:31.694972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1020cb6f-118a-4641-b0f5-f8c7b2879cc8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:31.695714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1020cb6f-118a-4641-b0f5-f8c7b2879cc8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:31.701902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1020cb6f-118a-4641-b0f5-f8c7b2879cc8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:31.702330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1020cb6f-118a-4641-b0f5-f8c7b2879cc8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:31.702779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1020cb6f-118a-4641-b0f5-f8c7b2879cc8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:31.703458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1020cb6f-118a-4641-b0f5-f8c7b2879cc8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:31.703910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1020cb6f-118a-4641-b0f5-f8c7b2879cc8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:31.705505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1020cb6f-118a-4641-b0f5-f8c7b2879cc8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:31.854943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1020cb6f-118a-4641-b0f5-f8c7b2879cc8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:31.863066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1020cb6f-118a-4641-b0f5-f8c7b2879cc8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.172034 Sep 01 05:15:31.863636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 93/177] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:31 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:32.278205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:32.278820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:32.284940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:32.285422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:32.285906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:32.286594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:32.287043 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:32.287464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:32.319671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:32.320264 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:32.320571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:32.321053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lazy-loading 'fault' on Instance uuid 52140d99-84e5-4f90-bc00-1b9d431b8c52 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:15:32.368182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:32.376247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-10bf330d-4b71-4d4b-bcc0-52f61070bbe5 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1351 microversion: 2.1 time: 0.101860 Sep 01 05:15:32.376829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 85/178] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:32 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:32.482342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-59faf337-330d-42a7-a871-c541bbe91fa5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:32.483115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-59faf337-330d-42a7-a871-c541bbe91fa5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:32.491020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-59faf337-330d-42a7-a871-c541bbe91fa5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:32.491689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-59faf337-330d-42a7-a871-c541bbe91fa5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:32.492320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-59faf337-330d-42a7-a871-c541bbe91fa5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:32.492832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-59faf337-330d-42a7-a871-c541bbe91fa5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:32.493722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-59faf337-330d-42a7-a871-c541bbe91fa5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:32.494519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-59faf337-330d-42a7-a871-c541bbe91fa5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:32.631246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-59faf337-330d-42a7-a871-c541bbe91fa5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:32.639502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-59faf337-330d-42a7-a871-c541bbe91fa5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.161335 Sep 01 05:15:32.640078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 94/179] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:32 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:32.883284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-414a69e1-2050-451f-9325-ab7011538d52 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:32.883898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-414a69e1-2050-451f-9325-ab7011538d52 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:32.890008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-414a69e1-2050-451f-9325-ab7011538d52 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:32.890485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-414a69e1-2050-451f-9325-ab7011538d52 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:32.890912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-414a69e1-2050-451f-9325-ab7011538d52 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:32.891593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-414a69e1-2050-451f-9325-ab7011538d52 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:32.892040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-414a69e1-2050-451f-9325-ab7011538d52 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:32.892455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-414a69e1-2050-451f-9325-ab7011538d52 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:33.028390 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-414a69e1-2050-451f-9325-ab7011538d52 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:33.037517 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-414a69e1-2050-451f-9325-ab7011538d52 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.158045 Sep 01 05:15:33.038085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 86/180] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:32 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:33.397931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:33.398538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:33.404466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:33.404984 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:33.405411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:33.406090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:33.406531 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:33.407053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:33.440498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:33.440992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:33.441417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:33.441848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lazy-loading 'fault' on Instance uuid 52140d99-84e5-4f90-bc00-1b9d431b8c52 {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:15:33.485012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:33.495946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-111ed1fa-f812-4a7c-9f42-5b8340824a16 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1351 microversion: 2.1 time: 0.101665 Sep 01 05:15:33.499770 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 95/181] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:33 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:33.660901 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-34d8dfa3-ec3b-488b-978d-aff023b3f8aa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:33.661547 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-34d8dfa3-ec3b-488b-978d-aff023b3f8aa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:33.667852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34d8dfa3-ec3b-488b-978d-aff023b3f8aa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:33.668332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34d8dfa3-ec3b-488b-978d-aff023b3f8aa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:33.668764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34d8dfa3-ec3b-488b-978d-aff023b3f8aa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:33.669475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34d8dfa3-ec3b-488b-978d-aff023b3f8aa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:33.669928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34d8dfa3-ec3b-488b-978d-aff023b3f8aa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:33.670352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34d8dfa3-ec3b-488b-978d-aff023b3f8aa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:33.814096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-34d8dfa3-ec3b-488b-978d-aff023b3f8aa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:33.826572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-34d8dfa3-ec3b-488b-978d-aff023b3f8aa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.169965 Sep 01 05:15:33.827376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 87/182] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:33 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:34.059761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-80405623-a4ec-4e09-a954-61f3b8afa27a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:34.060686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-80405623-a4ec-4e09-a954-61f3b8afa27a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:34.068386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80405623-a4ec-4e09-a954-61f3b8afa27a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:34.068932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80405623-a4ec-4e09-a954-61f3b8afa27a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:34.069366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80405623-a4ec-4e09-a954-61f3b8afa27a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:34.070065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80405623-a4ec-4e09-a954-61f3b8afa27a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:34.070513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80405623-a4ec-4e09-a954-61f3b8afa27a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:34.070935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80405623-a4ec-4e09-a954-61f3b8afa27a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:34.245142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-80405623-a4ec-4e09-a954-61f3b8afa27a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:34.254753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-80405623-a4ec-4e09-a954-61f3b8afa27a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.199179 Sep 01 05:15:34.257486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 96/183] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:34 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:34.517014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:34.518337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:34.528439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:34.528968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:34.529765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:34.530744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:34.531420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:34.532010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:34.581896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:34.582289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:34.582728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:34.583416 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lazy-loading 'fault' on Instance uuid 52140d99-84e5-4f90-bc00-1b9d431b8c52 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:15:34.648360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd370790538405c9e95f79126b5ea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac233deaa84df29af6140ec35f168e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:34.661200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a491aff5-ab58-4a08-ada3-76d2b56f7994 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 200 len: 1305 microversion: 2.1 time: 0.148854 Sep 01 05:15:34.662671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 88/184] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:34 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 1305 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:34.847744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ec63f659-c681-4768-8bac-2d738dbbd895 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:34.848404 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ec63f659-c681-4768-8bac-2d738dbbd895 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:34.854495 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec63f659-c681-4768-8bac-2d738dbbd895 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:34.855253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec63f659-c681-4768-8bac-2d738dbbd895 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:34.855688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec63f659-c681-4768-8bac-2d738dbbd895 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:34.856376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec63f659-c681-4768-8bac-2d738dbbd895 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:34.856854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec63f659-c681-4768-8bac-2d738dbbd895 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:34.857275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec63f659-c681-4768-8bac-2d738dbbd895 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:35.016121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ec63f659-c681-4768-8bac-2d738dbbd895 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:35.025164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ec63f659-c681-4768-8bac-2d738dbbd895 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.181400 Sep 01 05:15:35.025927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 97/185] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:34 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:35.276556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-44283df5-003f-4032-add4-c5594c4c0d0f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:35.277266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-44283df5-003f-4032-add4-c5594c4c0d0f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:35.284902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44283df5-003f-4032-add4-c5594c4c0d0f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:35.285440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44283df5-003f-4032-add4-c5594c4c0d0f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:35.285941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44283df5-003f-4032-add4-c5594c4c0d0f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:35.286678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44283df5-003f-4032-add4-c5594c4c0d0f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:35.287190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44283df5-003f-4032-add4-c5594c4c0d0f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:35.287670 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44283df5-003f-4032-add4-c5594c4c0d0f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:35.427495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-44283df5-003f-4032-add4-c5594c4c0d0f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:35.435464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-44283df5-003f-4032-add4-c5594c4c0d0f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.162853 Sep 01 05:15:35.436028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 89/186] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:35 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:35.685310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1bba8556-0ec2-4bc3-be42-3f8b13b7fff0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:35.686108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1bba8556-0ec2-4bc3-be42-3f8b13b7fff0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:35.692745 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1bba8556-0ec2-4bc3-be42-3f8b13b7fff0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:35.693252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1bba8556-0ec2-4bc3-be42-3f8b13b7fff0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:35.693683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1bba8556-0ec2-4bc3-be42-3f8b13b7fff0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:35.694369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1bba8556-0ec2-4bc3-be42-3f8b13b7fff0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:35.696282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1bba8556-0ec2-4bc3-be42-3f8b13b7fff0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:35.696707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1bba8556-0ec2-4bc3-be42-3f8b13b7fff0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:35.710593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-1bba8556-0ec2-4bc3-be42-3f8b13b7fff0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] HTTP exception thrown: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1bba8556-0ec2-4bc3-be42-3f8b13b7fff0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Request method failure captured: Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 HTTP/1.1 Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED-tm61eFxZHKpbkXNLcp1b5j9Vyjtd3KmGatQ_8VU1YAFLbdJR82KipVNLKbZMgSBlGtOjz7WKzQgKorioMpYxusMdMqlCc2sSaMSypU0N7-jscWYVdy-oJrFd3zRqNHBX_jmKh6zcxpRqbtpbmPVNblRfJCrsqd1f7mHKnx0LSEtw Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: a8ac233deaa84df29af6140ec35f168e Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-DeleteServersTestJSON-485390079 Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:15:35.715200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:15:35.716841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8ac233deaa84df29af6140ec35f168e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8ac233deaa84df29af6140ec35f168e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8ac233deaa84df29af6140ec35f168e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8ac233deaa84df29af6140ec35f168e"}]}] Sep 01 05:15:35.716841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-DeleteServersTestJSON-485390079 Sep 01 05:15:35.716841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: a8ac233deaa84df29af6140ec35f168e Sep 01 05:15:35.716841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-DeleteServersTestJSON-485390079 Sep 01 05:15:35.716841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-DeleteServersTestJSON-485390079-project Sep 01 05:15:35.716841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:15:35.716841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:15:35.716841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 4bd370790538405c9e95f79126b5ea6b Sep 01 05:15:35.716841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-DeleteServersTestJSON-485390079-project Sep 01 05:15:35.716841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:15:35.716841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:35.716841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '52140d99-84e5-4f90-bc00-1b9d431b8c52'} Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:35.718489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:35.721239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:15:35.723716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1bba8556-0ec2-4bc3-be42-3f8b13b7fff0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Returning 404 to user: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:35.723716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1bba8556-0ec2-4bc3-be42-3f8b13b7fff0 tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 404 len: 111 microversion: 2.1 time: 0.035477 Sep 01 05:15:35.723716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 98/187] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:35 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:35.839798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1b6a6bd1-cc73-4d4d-9180-f80d7dcb9b4c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:35.842060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1b6a6bd1-cc73-4d4d-9180-f80d7dcb9b4c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:35.847991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1b6a6bd1-cc73-4d4d-9180-f80d7dcb9b4c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:35.848474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1b6a6bd1-cc73-4d4d-9180-f80d7dcb9b4c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:35.848944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1b6a6bd1-cc73-4d4d-9180-f80d7dcb9b4c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:35.849636 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1b6a6bd1-cc73-4d4d-9180-f80d7dcb9b4c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:35.850087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1b6a6bd1-cc73-4d4d-9180-f80d7dcb9b4c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:35.850509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1b6a6bd1-cc73-4d4d-9180-f80d7dcb9b4c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:35.864055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-1b6a6bd1-cc73-4d4d-9180-f80d7dcb9b4c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] HTTP exception thrown: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1b6a6bd1-cc73-4d4d-9180-f80d7dcb9b4c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Request method failure captured: Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52/os-volume_attachments HTTP/1.1 Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED-tm61eFxZHKpbkXNLcp1b5j9Vyjtd3KmGatQ_8VU1YAFLbdJR82KipVNLKbZMgSBlGtOjz7WKzQgKorioMpYxusMdMqlCc2sSaMSypU0N7-jscWYVdy-oJrFd3zRqNHBX_jmKh6zcxpRqbtpbmPVNblRfJCrsqd1f7mHKnx0LSEtw Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: a8ac233deaa84df29af6140ec35f168e Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-DeleteServersTestJSON-485390079 Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:15:35.868655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:15:35.870166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8ac233deaa84df29af6140ec35f168e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8ac233deaa84df29af6140ec35f168e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8ac233deaa84df29af6140ec35f168e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8ac233deaa84df29af6140ec35f168e"}]}] Sep 01 05:15:35.870166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-DeleteServersTestJSON-485390079 Sep 01 05:15:35.870166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: a8ac233deaa84df29af6140ec35f168e Sep 01 05:15:35.870166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-DeleteServersTestJSON-485390079 Sep 01 05:15:35.870166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-DeleteServersTestJSON-485390079-project Sep 01 05:15:35.870166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:15:35.870166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:15:35.870166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 4bd370790538405c9e95f79126b5ea6b Sep 01 05:15:35.870166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-DeleteServersTestJSON-485390079-project Sep 01 05:15:35.870166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:15:35.870166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:35.870166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'server_id': '52140d99-84e5-4f90-bc00-1b9d431b8c52'} Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:35.871321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:35.872657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:35.873797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1b6a6bd1-cc73-4d4d-9180-f80d7dcb9b4c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Returning 404 to user: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:35.873797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1b6a6bd1-cc73-4d4d-9180-f80d7dcb9b4c tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034439 Sep 01 05:15:35.873797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 90/188] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:15:35 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:36.047374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c63e1902-9f37-455b-a822-37dd696b016f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:36.048069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c63e1902-9f37-455b-a822-37dd696b016f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:36.055106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c63e1902-9f37-455b-a822-37dd696b016f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:36.055848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c63e1902-9f37-455b-a822-37dd696b016f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:36.056287 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c63e1902-9f37-455b-a822-37dd696b016f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:36.057133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c63e1902-9f37-455b-a822-37dd696b016f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:36.057954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c63e1902-9f37-455b-a822-37dd696b016f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:36.058537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c63e1902-9f37-455b-a822-37dd696b016f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:36.203398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c63e1902-9f37-455b-a822-37dd696b016f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:36.211528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c63e1902-9f37-455b-a822-37dd696b016f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.168325 Sep 01 05:15:36.212082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 99/189] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:36 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:36.456992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c798e8f9-4508-42f6-a30b-90d78a5669f9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:36.457626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c798e8f9-4508-42f6-a30b-90d78a5669f9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:36.464821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c798e8f9-4508-42f6-a30b-90d78a5669f9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:36.465300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c798e8f9-4508-42f6-a30b-90d78a5669f9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:36.465726 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c798e8f9-4508-42f6-a30b-90d78a5669f9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:36.466401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c798e8f9-4508-42f6-a30b-90d78a5669f9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:36.466840 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c798e8f9-4508-42f6-a30b-90d78a5669f9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:36.467251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c798e8f9-4508-42f6-a30b-90d78a5669f9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:36.593459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c798e8f9-4508-42f6-a30b-90d78a5669f9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:36.601125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c798e8f9-4508-42f6-a30b-90d78a5669f9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.148081 Sep 01 05:15:36.601707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 91/190] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:36 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:37.233052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ebdcb014-7ac6-49ab-b899-17cd0577138c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:37.233660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ebdcb014-7ac6-49ab-b899-17cd0577138c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:37.239800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebdcb014-7ac6-49ab-b899-17cd0577138c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:37.240277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebdcb014-7ac6-49ab-b899-17cd0577138c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:37.240705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebdcb014-7ac6-49ab-b899-17cd0577138c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:37.241414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebdcb014-7ac6-49ab-b899-17cd0577138c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:37.241861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebdcb014-7ac6-49ab-b899-17cd0577138c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:37.242282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebdcb014-7ac6-49ab-b899-17cd0577138c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:37.376013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ebdcb014-7ac6-49ab-b899-17cd0577138c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:37.384179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ebdcb014-7ac6-49ab-b899-17cd0577138c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.154990 Sep 01 05:15:37.384742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 100/191] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:37 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:37.621707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-51cb475b-558e-4345-bb09-37744982ac33 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:37.622258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-51cb475b-558e-4345-bb09-37744982ac33 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:37.628804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51cb475b-558e-4345-bb09-37744982ac33 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:37.629284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51cb475b-558e-4345-bb09-37744982ac33 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:37.629713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51cb475b-558e-4345-bb09-37744982ac33 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:37.630388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51cb475b-558e-4345-bb09-37744982ac33 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:37.630836 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51cb475b-558e-4345-bb09-37744982ac33 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:37.631251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51cb475b-558e-4345-bb09-37744982ac33 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:37.765686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-51cb475b-558e-4345-bb09-37744982ac33 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:37.773315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-51cb475b-558e-4345-bb09-37744982ac33 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.155536 Sep 01 05:15:37.773878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 92/192] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:37 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:38.411596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8d1658da-3156-477a-baea-a53063d944b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:38.412219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8d1658da-3156-477a-baea-a53063d944b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:38.418639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d1658da-3156-477a-baea-a53063d944b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:38.419138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d1658da-3156-477a-baea-a53063d944b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:38.419552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d1658da-3156-477a-baea-a53063d944b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:38.420295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d1658da-3156-477a-baea-a53063d944b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:38.420745 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d1658da-3156-477a-baea-a53063d944b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:38.421187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d1658da-3156-477a-baea-a53063d944b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:38.558360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8d1658da-3156-477a-baea-a53063d944b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:38.567607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8d1658da-3156-477a-baea-a53063d944b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.166480 Sep 01 05:15:38.568404 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 101/193] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:38 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:38.794591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e47fa1c1-6f29-414b-b121-16272229571b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:38.795152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e47fa1c1-6f29-414b-b121-16272229571b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:38.802426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e47fa1c1-6f29-414b-b121-16272229571b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:38.802903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e47fa1c1-6f29-414b-b121-16272229571b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:38.803335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e47fa1c1-6f29-414b-b121-16272229571b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:38.804015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e47fa1c1-6f29-414b-b121-16272229571b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:38.804459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e47fa1c1-6f29-414b-b121-16272229571b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:38.804903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e47fa1c1-6f29-414b-b121-16272229571b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:38.935369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e47fa1c1-6f29-414b-b121-16272229571b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:38.943882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e47fa1c1-6f29-414b-b121-16272229571b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.153241 Sep 01 05:15:38.944448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 93/194] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:38 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:39.230179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-50a09789-2e5e-421a-a964-73b9fd35ea2a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:39.230672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-50a09789-2e5e-421a-a964-73b9fd35ea2a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:39.237181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-50a09789-2e5e-421a-a964-73b9fd35ea2a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:39.237659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-50a09789-2e5e-421a-a964-73b9fd35ea2a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:39.238092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-50a09789-2e5e-421a-a964-73b9fd35ea2a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:39.238800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-50a09789-2e5e-421a-a964-73b9fd35ea2a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:39.239246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-50a09789-2e5e-421a-a964-73b9fd35ea2a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:39.239665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-50a09789-2e5e-421a-a964-73b9fd35ea2a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:39.255820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-50a09789-2e5e-421a-a964-73b9fd35ea2a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] HTTP exception thrown: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-50a09789-2e5e-421a-a964-73b9fd35ea2a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Request method failure captured: Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 HTTP/1.1 Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED-tm61eFxZHKpbkXNLcp1b5j9Vyjtd3KmGatQ_8VU1YAFLbdJR82KipVNLKbZMgSBlGtOjz7WKzQgKorioMpYxusMdMqlCc2sSaMSypU0N7-jscWYVdy-oJrFd3zRqNHBX_jmKh6zcxpRqbtpbmPVNblRfJCrsqd1f7mHKnx0LSEtw Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: a8ac233deaa84df29af6140ec35f168e Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-DeleteServersTestJSON-485390079 Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:15:39.257417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:15:39.258893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8ac233deaa84df29af6140ec35f168e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8ac233deaa84df29af6140ec35f168e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8ac233deaa84df29af6140ec35f168e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8ac233deaa84df29af6140ec35f168e"}]}] Sep 01 05:15:39.258893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-DeleteServersTestJSON-485390079 Sep 01 05:15:39.258893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: a8ac233deaa84df29af6140ec35f168e Sep 01 05:15:39.258893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-DeleteServersTestJSON-485390079 Sep 01 05:15:39.258893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-DeleteServersTestJSON-485390079-project Sep 01 05:15:39.258893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:15:39.258893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:15:39.258893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 4bd370790538405c9e95f79126b5ea6b Sep 01 05:15:39.258893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-DeleteServersTestJSON-485390079-project Sep 01 05:15:39.258893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:15:39.258893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:39.258893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '52140d99-84e5-4f90-bc00-1b9d431b8c52'} Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:39.259673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:39.260838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:15:39.261968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-50a09789-2e5e-421a-a964-73b9fd35ea2a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Returning 404 to user: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:39.261968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-50a09789-2e5e-421a-a964-73b9fd35ea2a tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "DELETE /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 404 len: 111 microversion: 2.1 time: 0.032401 Sep 01 05:15:39.261968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 102/195] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:39 2022] DELETE /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:39.267505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0f334930-b738-497d-8c60-6919f6a0066b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:39.268171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0f334930-b738-497d-8c60-6919f6a0066b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] [instance: 52140d99-84e5-4f90-bc00-1b9d431b8c52] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:39.274216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f334930-b738-497d-8c60-6919f6a0066b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:39.274698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f334930-b738-497d-8c60-6919f6a0066b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:39.275130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f334930-b738-497d-8c60-6919f6a0066b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:39.275812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f334930-b738-497d-8c60-6919f6a0066b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:39.276261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f334930-b738-497d-8c60-6919f6a0066b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:39.276682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f334930-b738-497d-8c60-6919f6a0066b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:39.291684 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-0f334930-b738-497d-8c60-6919f6a0066b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] HTTP exception thrown: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0f334930-b738-497d-8c60-6919f6a0066b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Request method failure captured: Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 HTTP/1.1 Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED-tm61eFxZHKpbkXNLcp1b5j9Vyjtd3KmGatQ_8VU1YAFLbdJR82KipVNLKbZMgSBlGtOjz7WKzQgKorioMpYxusMdMqlCc2sSaMSypU0N7-jscWYVdy-oJrFd3zRqNHBX_jmKh6zcxpRqbtpbmPVNblRfJCrsqd1f7mHKnx0LSEtw Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: a8ac233deaa84df29af6140ec35f168e Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-DeleteServersTestJSON-485390079 Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:15:39.293810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:15:39.295480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8ac233deaa84df29af6140ec35f168e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8ac233deaa84df29af6140ec35f168e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8ac233deaa84df29af6140ec35f168e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8ac233deaa84df29af6140ec35f168e"}]}] Sep 01 05:15:39.295480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-DeleteServersTestJSON-485390079 Sep 01 05:15:39.295480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: a8ac233deaa84df29af6140ec35f168e Sep 01 05:15:39.295480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-DeleteServersTestJSON-485390079 Sep 01 05:15:39.295480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-DeleteServersTestJSON-485390079-project Sep 01 05:15:39.295480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:15:39.295480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:15:39.295480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 4bd370790538405c9e95f79126b5ea6b Sep 01 05:15:39.295480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-DeleteServersTestJSON-485390079-project Sep 01 05:15:39.295480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:15:39.295480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:39.295480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '52140d99-84e5-4f90-bc00-1b9d431b8c52'} Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:39.296768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. Sep 01 05:15:39.298428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:39.300462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0f334930-b738-497d-8c60-6919f6a0066b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] Returning 404 to user: Instance 52140d99-84e5-4f90-bc00-1b9d431b8c52 could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:39.300462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0f334930-b738-497d-8c60-6919f6a0066b tempest-DeleteServersTestJSON-485390079 tempest-DeleteServersTestJSON-485390079-project] 10.222.0.49 "GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52" status: 404 len: 111 microversion: 2.1 time: 0.031513 Sep 01 05:15:39.300462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 94/196] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:39 2022] GET /compute/v2.1/servers/52140d99-84e5-4f90-bc00-1b9d431b8c52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:39.590643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b7172256-f72d-4491-8a41-24f5dea2c666 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:39.591261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b7172256-f72d-4491-8a41-24f5dea2c666 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:39.598015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7172256-f72d-4491-8a41-24f5dea2c666 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:39.598673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7172256-f72d-4491-8a41-24f5dea2c666 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:39.599137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7172256-f72d-4491-8a41-24f5dea2c666 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:39.600830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7172256-f72d-4491-8a41-24f5dea2c666 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:39.601311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7172256-f72d-4491-8a41-24f5dea2c666 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:39.601731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7172256-f72d-4491-8a41-24f5dea2c666 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:39.770280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b7172256-f72d-4491-8a41-24f5dea2c666 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:39.779226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b7172256-f72d-4491-8a41-24f5dea2c666 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.192505 Sep 01 05:15:39.793002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 103/197] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:39 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:39.912423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-a7288aeb-6cb4-4d85-b932-b1db1ce4537b req-cc8da4fc-7784-413c-a426-c4373fe15557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e969189e-c347-414c-a696-7b8bf28398f4", "name": "network-vif-plugged", "status": "completed", "tag": "eb9f60e7-fa3b-470f-b52c-5fb70ef0ebf5"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:39.937979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-a7288aeb-6cb4-4d85-b932-b1db1ce4537b req-cc8da4fc-7784-413c-a426-c4373fe15557 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:39.938736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-a7288aeb-6cb4-4d85-b932-b1db1ce4537b req-cc8da4fc-7784-413c-a426-c4373fe15557 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:39.939964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-a7288aeb-6cb4-4d85-b932-b1db1ce4537b req-cc8da4fc-7784-413c-a426-c4373fe15557 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:39.959944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-a7288aeb-6cb4-4d85-b932-b1db1ce4537b req-cc8da4fc-7784-413c-a426-c4373fe15557 service nova] Creating event network-vif-plugged:eb9f60e7-fa3b-470f-b52c-5fb70ef0ebf5 for instance e969189e-c347-414c-a696-7b8bf28398f4 on hv-cinder-85391 Sep 01 05:15:39.967725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-a7288aeb-6cb4-4d85-b932-b1db1ce4537b req-cc8da4fc-7784-413c-a426-c4373fe15557 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062249 Sep 01 05:15:39.968970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 95/198] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:39.969226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-939e8781-5eaf-4a27-9600-c8ebf7b6436a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:39.970288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-939e8781-5eaf-4a27-9600-c8ebf7b6436a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:39.977258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-939e8781-5eaf-4a27-9600-c8ebf7b6436a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:39.983662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-939e8781-5eaf-4a27-9600-c8ebf7b6436a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:39.984181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-939e8781-5eaf-4a27-9600-c8ebf7b6436a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:39.996199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-939e8781-5eaf-4a27-9600-c8ebf7b6436a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:40.005858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-939e8781-5eaf-4a27-9600-c8ebf7b6436a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:40.006644 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-939e8781-5eaf-4a27-9600-c8ebf7b6436a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:40.173068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-939e8781-5eaf-4a27-9600-c8ebf7b6436a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:40.182112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-939e8781-5eaf-4a27-9600-c8ebf7b6436a tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.220988 Sep 01 05:15:40.183522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 104/199] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:39 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:40.801880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b91a99ca-7d64-4764-8c2a-539ce8d0676e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:40.802583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b91a99ca-7d64-4764-8c2a-539ce8d0676e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:40.809306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b91a99ca-7d64-4764-8c2a-539ce8d0676e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:40.809791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b91a99ca-7d64-4764-8c2a-539ce8d0676e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:40.810227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b91a99ca-7d64-4764-8c2a-539ce8d0676e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:40.810927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b91a99ca-7d64-4764-8c2a-539ce8d0676e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:40.811377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b91a99ca-7d64-4764-8c2a-539ce8d0676e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:40.811797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b91a99ca-7d64-4764-8c2a-539ce8d0676e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:41.203504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-71d6d302-64c6-42ac-a23c-2bbeaa4df1be tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:41.204702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-71d6d302-64c6-42ac-a23c-2bbeaa4df1be tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:41.211979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71d6d302-64c6-42ac-a23c-2bbeaa4df1be tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:41.212691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71d6d302-64c6-42ac-a23c-2bbeaa4df1be tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:41.213160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71d6d302-64c6-42ac-a23c-2bbeaa4df1be tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:41.213846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71d6d302-64c6-42ac-a23c-2bbeaa4df1be tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:41.214288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71d6d302-64c6-42ac-a23c-2bbeaa4df1be tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:41.214702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71d6d302-64c6-42ac-a23c-2bbeaa4df1be tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:41.277054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b91a99ca-7d64-4764-8c2a-539ce8d0676e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:41.295615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b91a99ca-7d64-4764-8c2a-539ce8d0676e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.494151 Sep 01 05:15:41.296297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 96/200] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:40 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:41.427250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-71d6d302-64c6-42ac-a23c-2bbeaa4df1be tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:41.435831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-71d6d302-64c6-42ac-a23c-2bbeaa4df1be tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1314 microversion: 2.1 time: 0.236174 Sep 01 05:15:41.436659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 105/201] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:41 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:42.322557 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fc26ec78-d230-4648-8155-ff3a0b6d9de3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:42.323163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fc26ec78-d230-4648-8155-ff3a0b6d9de3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:42.330127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc26ec78-d230-4648-8155-ff3a0b6d9de3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:42.331165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc26ec78-d230-4648-8155-ff3a0b6d9de3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:42.333995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc26ec78-d230-4648-8155-ff3a0b6d9de3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:42.334768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc26ec78-d230-4648-8155-ff3a0b6d9de3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:42.335234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc26ec78-d230-4648-8155-ff3a0b6d9de3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:42.335663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc26ec78-d230-4648-8155-ff3a0b6d9de3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:42.457678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6c456347-e40a-4fa3-a0fa-4e56ea0065b5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:42.458292 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6c456347-e40a-4fa3-a0fa-4e56ea0065b5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:42.465134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c456347-e40a-4fa3-a0fa-4e56ea0065b5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:42.465635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c456347-e40a-4fa3-a0fa-4e56ea0065b5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:42.466138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c456347-e40a-4fa3-a0fa-4e56ea0065b5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:42.467031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c456347-e40a-4fa3-a0fa-4e56ea0065b5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:42.467478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c456347-e40a-4fa3-a0fa-4e56ea0065b5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:42.468016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c456347-e40a-4fa3-a0fa-4e56ea0065b5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:42.590454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fc26ec78-d230-4648-8155-ff3a0b6d9de3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:42.600351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fc26ec78-d230-4648-8155-ff3a0b6d9de3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.281675 Sep 01 05:15:42.601524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 97/202] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:42 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:42.638989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6c456347-e40a-4fa3-a0fa-4e56ea0065b5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:42.655272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6c456347-e40a-4fa3-a0fa-4e56ea0065b5 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1499 microversion: 2.1 time: 0.200406 Sep 01 05:15:42.669362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 106/203] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:42 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1499 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:43.420426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-995734ed-5d60-4b03-a85b-7d7341dbc02e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:43.421005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-995734ed-5d60-4b03-a85b-7d7341dbc02e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:43.429364 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-995734ed-5d60-4b03-a85b-7d7341dbc02e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:43.429849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-995734ed-5d60-4b03-a85b-7d7341dbc02e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:43.430278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-995734ed-5d60-4b03-a85b-7d7341dbc02e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:43.431025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-995734ed-5d60-4b03-a85b-7d7341dbc02e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:43.438085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-995734ed-5d60-4b03-a85b-7d7341dbc02e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:43.439216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-995734ed-5d60-4b03-a85b-7d7341dbc02e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:43.474906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-995734ed-5d60-4b03-a85b-7d7341dbc02e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:15:43.610646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-995734ed-5d60-4b03-a85b-7d7341dbc02e tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 204 len: 0 microversion: 2.1 time: 0.194005 Sep 01 05:15:43.612804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 98/204] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:43 2022] DELETE /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:15:43.623033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6c5de919-fc49-4e12-83e9-22b9cff9fcfe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:43.623460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-910b5eb6-59db-4171-a2cc-558ade8ba4b7 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:43.624081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-910b5eb6-59db-4171-a2cc-558ade8ba4b7 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:43.625744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6c5de919-fc49-4e12-83e9-22b9cff9fcfe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:43.633332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6c5de919-fc49-4e12-83e9-22b9cff9fcfe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:43.633715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-910b5eb6-59db-4171-a2cc-558ade8ba4b7 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:43.634344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6c5de919-fc49-4e12-83e9-22b9cff9fcfe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:43.634670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-910b5eb6-59db-4171-a2cc-558ade8ba4b7 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:43.635124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6c5de919-fc49-4e12-83e9-22b9cff9fcfe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:43.635676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-910b5eb6-59db-4171-a2cc-558ade8ba4b7 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:43.635956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6c5de919-fc49-4e12-83e9-22b9cff9fcfe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:43.636412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6c5de919-fc49-4e12-83e9-22b9cff9fcfe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:43.636857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6c5de919-fc49-4e12-83e9-22b9cff9fcfe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:43.637343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-910b5eb6-59db-4171-a2cc-558ade8ba4b7 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:43.637939 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-910b5eb6-59db-4171-a2cc-558ade8ba4b7 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:43.638866 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-910b5eb6-59db-4171-a2cc-558ade8ba4b7 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:43.641120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:43.786110 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6c5de919-fc49-4e12-83e9-22b9cff9fcfe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:43.797500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6c5de919-fc49-4e12-83e9-22b9cff9fcfe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.178620 Sep 01 05:15:43.798068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 99/205] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:43 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:43.857588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-910b5eb6-59db-4171-a2cc-558ade8ba4b7 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:43.866141 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-910b5eb6-59db-4171-a2cc-558ade8ba4b7 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1505 microversion: 2.1 time: 0.247118 Sep 01 05:15:43.866702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 107/206] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:43 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:44.819425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cfc3fa17-9045-4f87-8882-c16ac1e619d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:44.820034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cfc3fa17-9045-4f87-8882-c16ac1e619d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:44.826998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfc3fa17-9045-4f87-8882-c16ac1e619d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:44.827603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfc3fa17-9045-4f87-8882-c16ac1e619d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:44.828139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfc3fa17-9045-4f87-8882-c16ac1e619d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:44.828961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfc3fa17-9045-4f87-8882-c16ac1e619d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:44.829510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfc3fa17-9045-4f87-8882-c16ac1e619d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:44.830049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfc3fa17-9045-4f87-8882-c16ac1e619d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:44.887479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7ce9683e-a6c4-4b72-8ac6-f9659907bb9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:44.888282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7ce9683e-a6c4-4b72-8ac6-f9659907bb9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:44.895330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7ce9683e-a6c4-4b72-8ac6-f9659907bb9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:44.896212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7ce9683e-a6c4-4b72-8ac6-f9659907bb9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:44.896721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7ce9683e-a6c4-4b72-8ac6-f9659907bb9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:44.897537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7ce9683e-a6c4-4b72-8ac6-f9659907bb9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:44.898065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7ce9683e-a6c4-4b72-8ac6-f9659907bb9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:44.898559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7ce9683e-a6c4-4b72-8ac6-f9659907bb9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:45.006753 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cfc3fa17-9045-4f87-8882-c16ac1e619d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:45.016054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cfc3fa17-9045-4f87-8882-c16ac1e619d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.199840 Sep 01 05:15:45.016630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 100/207] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:44 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:45.062980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7ce9683e-a6c4-4b72-8ac6-f9659907bb9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:45.071262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7ce9683e-a6c4-4b72-8ac6-f9659907bb9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1505 microversion: 2.1 time: 0.187662 Sep 01 05:15:45.071832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 108/208] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:44 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:46.037204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7bbc2ff3-a8c3-4a0f-8b74-60d0f044d48f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:46.037755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7bbc2ff3-a8c3-4a0f-8b74-60d0f044d48f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:46.044196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7bbc2ff3-a8c3-4a0f-8b74-60d0f044d48f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:46.044669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7bbc2ff3-a8c3-4a0f-8b74-60d0f044d48f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:46.045127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7bbc2ff3-a8c3-4a0f-8b74-60d0f044d48f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:46.045804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7bbc2ff3-a8c3-4a0f-8b74-60d0f044d48f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:46.046246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7bbc2ff3-a8c3-4a0f-8b74-60d0f044d48f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:46.046658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7bbc2ff3-a8c3-4a0f-8b74-60d0f044d48f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:46.091564 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cb7c6e9a-6c64-4418-8f2f-4b4866c35438 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:46.092168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cb7c6e9a-6c64-4418-8f2f-4b4866c35438 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:46.098342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb7c6e9a-6c64-4418-8f2f-4b4866c35438 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:46.098815 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb7c6e9a-6c64-4418-8f2f-4b4866c35438 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:46.099243 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb7c6e9a-6c64-4418-8f2f-4b4866c35438 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:46.099928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb7c6e9a-6c64-4418-8f2f-4b4866c35438 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:46.100372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb7c6e9a-6c64-4418-8f2f-4b4866c35438 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:46.100807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb7c6e9a-6c64-4418-8f2f-4b4866c35438 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:46.104879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:46.180960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7bbc2ff3-a8c3-4a0f-8b74-60d0f044d48f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:46.189642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7bbc2ff3-a8c3-4a0f-8b74-60d0f044d48f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.156324 Sep 01 05:15:46.191029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 101/209] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:46 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:46.231101 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cb7c6e9a-6c64-4418-8f2f-4b4866c35438 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:46.239907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cb7c6e9a-6c64-4418-8f2f-4b4866c35438 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1505 microversion: 2.1 time: 0.152056 Sep 01 05:15:46.240478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 109/210] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:46 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:47.211935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ab9af86f-3efa-4ae2-a1dd-dbd59a609d0f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:47.212647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ab9af86f-3efa-4ae2-a1dd-dbd59a609d0f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:47.220061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab9af86f-3efa-4ae2-a1dd-dbd59a609d0f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:47.220526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab9af86f-3efa-4ae2-a1dd-dbd59a609d0f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:47.221082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab9af86f-3efa-4ae2-a1dd-dbd59a609d0f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:47.222297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab9af86f-3efa-4ae2-a1dd-dbd59a609d0f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:47.222751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab9af86f-3efa-4ae2-a1dd-dbd59a609d0f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:47.223194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab9af86f-3efa-4ae2-a1dd-dbd59a609d0f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:47.261068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1a239a33-1ebc-4cf0-b534-7c00645d16ad tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:47.261769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1a239a33-1ebc-4cf0-b534-7c00645d16ad tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:47.264944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:47.268983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a239a33-1ebc-4cf0-b534-7c00645d16ad tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:47.275957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a239a33-1ebc-4cf0-b534-7c00645d16ad tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:47.276470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a239a33-1ebc-4cf0-b534-7c00645d16ad tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:47.277291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a239a33-1ebc-4cf0-b534-7c00645d16ad tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:47.277811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a239a33-1ebc-4cf0-b534-7c00645d16ad tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:47.279671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a239a33-1ebc-4cf0-b534-7c00645d16ad tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:47.377940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ab9af86f-3efa-4ae2-a1dd-dbd59a609d0f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:47.386090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ab9af86f-3efa-4ae2-a1dd-dbd59a609d0f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.178087 Sep 01 05:15:47.386736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 102/211] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:47 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:47.440383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1a239a33-1ebc-4cf0-b534-7c00645d16ad tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:47.448684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1a239a33-1ebc-4cf0-b534-7c00645d16ad tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1505 microversion: 2.1 time: 0.191328 Sep 01 05:15:47.449293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 110/212] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:47 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:48.414262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-037628a6-e3f2-4f8a-a5c4-9294ff97699c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:48.415433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-037628a6-e3f2-4f8a-a5c4-9294ff97699c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:48.428309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-037628a6-e3f2-4f8a-a5c4-9294ff97699c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:48.428818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-037628a6-e3f2-4f8a-a5c4-9294ff97699c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:48.429329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-037628a6-e3f2-4f8a-a5c4-9294ff97699c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:48.429989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-037628a6-e3f2-4f8a-a5c4-9294ff97699c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:48.430553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-037628a6-e3f2-4f8a-a5c4-9294ff97699c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:48.430999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-037628a6-e3f2-4f8a-a5c4-9294ff97699c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:48.470232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8fc1ba2a-97cb-434f-888c-4eff3c1d3d3d tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:48.470840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8fc1ba2a-97cb-434f-888c-4eff3c1d3d3d tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:48.480188 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fc1ba2a-97cb-434f-888c-4eff3c1d3d3d tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:48.485128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fc1ba2a-97cb-434f-888c-4eff3c1d3d3d tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:48.485869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fc1ba2a-97cb-434f-888c-4eff3c1d3d3d tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:48.487826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fc1ba2a-97cb-434f-888c-4eff3c1d3d3d tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:48.488312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fc1ba2a-97cb-434f-888c-4eff3c1d3d3d tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:48.490241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fc1ba2a-97cb-434f-888c-4eff3c1d3d3d tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:48.696145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8fc1ba2a-97cb-434f-888c-4eff3c1d3d3d tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:48.710687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8fc1ba2a-97cb-434f-888c-4eff3c1d3d3d tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1505 microversion: 2.1 time: 0.242956 Sep 01 05:15:48.722971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 111/213] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:48 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:48.776646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-037628a6-e3f2-4f8a-a5c4-9294ff97699c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:48.787001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-037628a6-e3f2-4f8a-a5c4-9294ff97699c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.376651 Sep 01 05:15:48.788067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 103/214] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:48 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:49.055484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-c57c7820-a703-4202-ac95-1c0a4b927d79 req-4de8048c-a165-415c-b7e7-e7aa3a8b4724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e969189e-c347-414c-a696-7b8bf28398f4", "name": "network-vif-deleted", "tag": "eb9f60e7-fa3b-470f-b52c-5fb70ef0ebf5"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:49.071465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-c57c7820-a703-4202-ac95-1c0a4b927d79 req-4de8048c-a165-415c-b7e7-e7aa3a8b4724 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:49.071951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-c57c7820-a703-4202-ac95-1c0a4b927d79 req-4de8048c-a165-415c-b7e7-e7aa3a8b4724 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:49.072617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-c57c7820-a703-4202-ac95-1c0a4b927d79 req-4de8048c-a165-415c-b7e7-e7aa3a8b4724 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:49.086448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-c57c7820-a703-4202-ac95-1c0a4b927d79 req-4de8048c-a165-415c-b7e7-e7aa3a8b4724 service nova] Creating event network-vif-deleted:eb9f60e7-fa3b-470f-b52c-5fb70ef0ebf5 for instance e969189e-c347-414c-a696-7b8bf28398f4 on hv-cinder-85391 Sep 01 05:15:49.091411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-c57c7820-a703-4202-ac95-1c0a4b927d79 req-4de8048c-a165-415c-b7e7-e7aa3a8b4724 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049332 Sep 01 05:15:49.092039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 112/215] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:49.735255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:49.736418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:49.744464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:49.745027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:49.745601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:49.746156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:49.746603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:49.747205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:49.784653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:49.785054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:49.785539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:49.785932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lazy-loading 'fault' on Instance uuid e969189e-c347-414c-a696-7b8bf28398f4 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:15:49.809529 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0968a8c9-10bd-493a-a85e-411005e3dc23 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:49.810418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0968a8c9-10bd-493a-a85e-411005e3dc23 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:49.828444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0968a8c9-10bd-493a-a85e-411005e3dc23 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:49.828989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0968a8c9-10bd-493a-a85e-411005e3dc23 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:49.829430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0968a8c9-10bd-493a-a85e-411005e3dc23 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:49.830157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0968a8c9-10bd-493a-a85e-411005e3dc23 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:49.830659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0968a8c9-10bd-493a-a85e-411005e3dc23 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:49.831088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0968a8c9-10bd-493a-a85e-411005e3dc23 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:49.857041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:49.873632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-11773eac-345e-4072-bff3-80a91f40259f tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 200 len: 1304 microversion: 2.1 time: 0.142219 Sep 01 05:15:49.874221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 104/216] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:49 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:50.011014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0968a8c9-10bd-493a-a85e-411005e3dc23 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:50.019775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0968a8c9-10bd-493a-a85e-411005e3dc23 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.215484 Sep 01 05:15:50.020352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 113/217] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:49 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:50.896817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0678ac48-972c-4a79-9b8b-af544b2621ce tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:50.897332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0678ac48-972c-4a79-9b8b-af544b2621ce tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: e969189e-c347-414c-a696-7b8bf28398f4] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:50.910841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0678ac48-972c-4a79-9b8b-af544b2621ce tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:50.910841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0678ac48-972c-4a79-9b8b-af544b2621ce tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:50.910841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0678ac48-972c-4a79-9b8b-af544b2621ce tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:50.910841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0678ac48-972c-4a79-9b8b-af544b2621ce tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:50.911187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0678ac48-972c-4a79-9b8b-af544b2621ce tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:50.911187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0678ac48-972c-4a79-9b8b-af544b2621ce tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:50.922323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-0678ac48-972c-4a79-9b8b-af544b2621ce tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] HTTP exception thrown: Instance e969189e-c347-414c-a696-7b8bf28398f4 could not be found. Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0678ac48-972c-4a79-9b8b-af544b2621ce tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Request method failure captured: Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 HTTP/1.1 Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED_kQBK6CMkZECCYugiSeha6QDRonwq8G9TF7R3nAC8ExIauUd-hGoSsjUr0AFOms6bUrL2Bpsaq_fvKlOS9iFoy2-_bxfYQWjq9K7kTW5gNqQ5hBghEy0QQN0o8mFLQ0vj-A6QnK2oNGeyb1wv27a_pXBkt5PsPRWXfTW_xTcOxTP0 Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 66f6958ea49445f780bcec5d8b86840d Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-VolumesActionsTest-254228033 Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:15:50.923967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:15:50.925560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_66f6958ea49445f780bcec5d8b86840d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/66f6958ea49445f780bcec5d8b86840d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/66f6958ea49445f780bcec5d8b86840d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/66f6958ea49445f780bcec5d8b86840d"}]}] Sep 01 05:15:50.925560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-VolumesActionsTest-254228033 Sep 01 05:15:50.925560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 66f6958ea49445f780bcec5d8b86840d Sep 01 05:15:50.925560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-VolumesActionsTest-254228033 Sep 01 05:15:50.925560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-VolumesActionsTest-254228033-project Sep 01 05:15:50.925560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:15:50.925560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:15:50.925560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 075c5a476ec14386afb0f9f16b66f7f9 Sep 01 05:15:50.925560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-VolumesActionsTest-254228033-project Sep 01 05:15:50.925560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:15:50.925560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance e969189e-c347-414c-a696-7b8bf28398f4 could not be found. Sep 01 05:15:50.925560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': 'e969189e-c347-414c-a696-7b8bf28398f4'} Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e969189e-c347-414c-a696-7b8bf28398f4 could not be found. Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:50.926657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e969189e-c347-414c-a696-7b8bf28398f4 could not be found. Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e969189e-c347-414c-a696-7b8bf28398f4 could not be found. Sep 01 05:15:50.928030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:15:50.929350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0678ac48-972c-4a79-9b8b-af544b2621ce tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Returning 404 to user: Instance e969189e-c347-414c-a696-7b8bf28398f4 could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:50.929350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0678ac48-972c-4a79-9b8b-af544b2621ce tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4" status: 404 len: 111 microversion: 2.1 time: 0.033917 Sep 01 05:15:50.929350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 105/218] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:50 2022] GET /compute/v2.1/servers/e969189e-c347-414c-a696-7b8bf28398f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:51.034068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1709666337", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "networks": [{"uuid": "740d7186-3463-429c-a205-ef43d7ad53e2"}]}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:51.047497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0ef23df6-8c8d-4098-bcc7-42b92315b818 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:51.048384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0ef23df6-8c8d-4098-bcc7-42b92315b818 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:51.058475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ef23df6-8c8d-4098-bcc7-42b92315b818 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:51.058960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ef23df6-8c8d-4098-bcc7-42b92315b818 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:51.059495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ef23df6-8c8d-4098-bcc7-42b92315b818 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:51.060193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ef23df6-8c8d-4098-bcc7-42b92315b818 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:51.060655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ef23df6-8c8d-4098-bcc7-42b92315b818 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:51.061112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ef23df6-8c8d-4098-bcc7-42b92315b818 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:51.094851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.network.neutron [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] validate_networks() for [('740d7186-3463-429c-a205-ef43d7ad53e2', None, None, None, None, None)] {{(pid=120674) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:15:51.230565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0ef23df6-8c8d-4098-bcc7-42b92315b818 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:51.240644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0ef23df6-8c8d-4098-bcc7-42b92315b818 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.197085 Sep 01 05:15:51.241330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 106/219] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:51 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:51.514553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Flavor limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:15:51.515121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Image limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:15:51.516041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Flavor pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:15:51.516648 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Image pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:15:51.517309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:15:51.531910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:51.532396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:51.532855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:51.534235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:51.535031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:51.535231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:51.555994 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Getting quotas for project 66f6958ea49445f780bcec5d8b86840d. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:15:51.561030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Getting quotas for user 075c5a476ec14386afb0f9f16b66f7f9 and project 66f6958ea49445f780bcec5d8b86840d. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:15:51.575992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Going to run 1 instances... {{(pid=120674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:15:51.578731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:15:51.633122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2b10f8e5-d8cd-4d0b-9066-d9a45e547341 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602744 Sep 01 05:15:51.633828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 114/220] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:15:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:15:51.646129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3372577f-1fa1-4227-b35b-03a5b1433eaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:51.646950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3372577f-1fa1-4227-b35b-03a5b1433eaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:51.719400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3372577f-1fa1-4227-b35b-03a5b1433eaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:51.734731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3372577f-1fa1-4227-b35b-03a5b1433eaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1214 microversion: 2.1 time: 0.092641 Sep 01 05:15:51.735453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 107/221] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:51 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:52.263028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7df5cf1b-afa2-4ac3-856d-dc2f09e78a1c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:52.264003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7df5cf1b-afa2-4ac3-856d-dc2f09e78a1c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:52.282032 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7df5cf1b-afa2-4ac3-856d-dc2f09e78a1c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:52.282970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7df5cf1b-afa2-4ac3-856d-dc2f09e78a1c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:52.284352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7df5cf1b-afa2-4ac3-856d-dc2f09e78a1c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:52.285538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7df5cf1b-afa2-4ac3-856d-dc2f09e78a1c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:52.286205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7df5cf1b-afa2-4ac3-856d-dc2f09e78a1c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:52.287321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7df5cf1b-afa2-4ac3-856d-dc2f09e78a1c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:52.462836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7df5cf1b-afa2-4ac3-856d-dc2f09e78a1c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:52.472955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7df5cf1b-afa2-4ac3-856d-dc2f09e78a1c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.214810 Sep 01 05:15:52.473546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 115/222] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:52 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:52.756634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dc40d96d-a918-41e3-8b0c-c8fee803df05 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:52.757292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dc40d96d-a918-41e3-8b0c-c8fee803df05 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:52.763655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc40d96d-a918-41e3-8b0c-c8fee803df05 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:52.764145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc40d96d-a918-41e3-8b0c-c8fee803df05 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:52.766213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc40d96d-a918-41e3-8b0c-c8fee803df05 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:52.766936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc40d96d-a918-41e3-8b0c-c8fee803df05 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:52.767565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc40d96d-a918-41e3-8b0c-c8fee803df05 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:52.768257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc40d96d-a918-41e3-8b0c-c8fee803df05 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:52.834778 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-dc40d96d-a918-41e3-8b0c-c8fee803df05 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:52.843713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dc40d96d-a918-41e3-8b0c-c8fee803df05 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1266 microversion: 2.1 time: 0.091605 Sep 01 05:15:52.844290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 108/223] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:52 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:53.498376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c88fd075-5802-4c30-938b-33f28d6d5f5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:53.499709 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c88fd075-5802-4c30-938b-33f28d6d5f5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:53.507705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c88fd075-5802-4c30-938b-33f28d6d5f5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:53.508422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c88fd075-5802-4c30-938b-33f28d6d5f5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:53.508889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c88fd075-5802-4c30-938b-33f28d6d5f5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:53.509941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c88fd075-5802-4c30-938b-33f28d6d5f5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:53.510583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c88fd075-5802-4c30-938b-33f28d6d5f5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:53.511155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c88fd075-5802-4c30-938b-33f28d6d5f5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:53.734015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c88fd075-5802-4c30-938b-33f28d6d5f5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:53.743950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c88fd075-5802-4c30-938b-33f28d6d5f5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.253022 Sep 01 05:15:53.745464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 116/224] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:53 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:53.865938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-65fe9e29-f50f-4ef8-9c79-2a7f5209f5e8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:53.867140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-65fe9e29-f50f-4ef8-9c79-2a7f5209f5e8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:53.873049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:53.875099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65fe9e29-f50f-4ef8-9c79-2a7f5209f5e8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:53.875790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65fe9e29-f50f-4ef8-9c79-2a7f5209f5e8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:53.876477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65fe9e29-f50f-4ef8-9c79-2a7f5209f5e8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:53.877473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65fe9e29-f50f-4ef8-9c79-2a7f5209f5e8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:53.878534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65fe9e29-f50f-4ef8-9c79-2a7f5209f5e8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:53.879581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65fe9e29-f50f-4ef8-9c79-2a7f5209f5e8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:53.978851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-65fe9e29-f50f-4ef8-9c79-2a7f5209f5e8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:53.997778 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-65fe9e29-f50f-4ef8-9c79-2a7f5209f5e8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1272 microversion: 2.1 time: 0.136698 Sep 01 05:15:53.998639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 109/225] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:53 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:54.766639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-15310cc7-f1f3-42ef-b105-a2c0fcd90b97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:54.768646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-15310cc7-f1f3-42ef-b105-a2c0fcd90b97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:54.789256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15310cc7-f1f3-42ef-b105-a2c0fcd90b97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:54.789924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15310cc7-f1f3-42ef-b105-a2c0fcd90b97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:54.790496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15310cc7-f1f3-42ef-b105-a2c0fcd90b97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:54.791398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15310cc7-f1f3-42ef-b105-a2c0fcd90b97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:54.791922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15310cc7-f1f3-42ef-b105-a2c0fcd90b97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:54.792415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15310cc7-f1f3-42ef-b105-a2c0fcd90b97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:54.971649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-15310cc7-f1f3-42ef-b105-a2c0fcd90b97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:54.980050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-15310cc7-f1f3-42ef-b105-a2c0fcd90b97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.218209 Sep 01 05:15:54.980635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 117/226] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:54 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:55.024951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a331c814-1f69-40f7-9fbb-bb2eecb0ef54 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:55.026556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a331c814-1f69-40f7-9fbb-bb2eecb0ef54 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:55.044504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-68cca781-2d96-4af8-ad31-0a8d1a660e6a req-c2279c75-4b46-4ac5-8288-61e6c9837e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01993e59-9adf-4c96-92ae-801ab1d73546", "tag": "83643e0c-fdbd-4b91-955b-7a0ecd3c4400"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:55.064581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-68cca781-2d96-4af8-ad31-0a8d1a660e6a req-c2279c75-4b46-4ac5-8288-61e6c9837e01 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:55.066627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-68cca781-2d96-4af8-ad31-0a8d1a660e6a req-c2279c75-4b46-4ac5-8288-61e6c9837e01 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:55.067397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-68cca781-2d96-4af8-ad31-0a8d1a660e6a req-c2279c75-4b46-4ac5-8288-61e6c9837e01 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:55.086022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a331c814-1f69-40f7-9fbb-bb2eecb0ef54 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:55.086640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a331c814-1f69-40f7-9fbb-bb2eecb0ef54 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:55.087248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a331c814-1f69-40f7-9fbb-bb2eecb0ef54 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:55.090178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a331c814-1f69-40f7-9fbb-bb2eecb0ef54 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:55.090839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a331c814-1f69-40f7-9fbb-bb2eecb0ef54 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:55.091365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a331c814-1f69-40f7-9fbb-bb2eecb0ef54 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:55.093184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-68cca781-2d96-4af8-ad31-0a8d1a660e6a req-c2279c75-4b46-4ac5-8288-61e6c9837e01 service nova] Creating event network-changed:83643e0c-fdbd-4b91-955b-7a0ecd3c4400 for instance 01993e59-9adf-4c96-92ae-801ab1d73546 on hv-cinder-85391 Sep 01 05:15:55.099405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-68cca781-2d96-4af8-ad31-0a8d1a660e6a req-c2279c75-4b46-4ac5-8288-61e6c9837e01 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070199 Sep 01 05:15:55.100824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 118/227] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:55.334353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a331c814-1f69-40f7-9fbb-bb2eecb0ef54 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:55.342685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a331c814-1f69-40f7-9fbb-bb2eecb0ef54 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1314 microversion: 2.1 time: 0.327065 Sep 01 05:15:55.343630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 110/228] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:55 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:56.004112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-222ece3b-06d1-45a6-a524-5442a4eb2fa3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:56.005569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-222ece3b-06d1-45a6-a524-5442a4eb2fa3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:56.015326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-222ece3b-06d1-45a6-a524-5442a4eb2fa3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:56.015818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-222ece3b-06d1-45a6-a524-5442a4eb2fa3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:56.016236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-222ece3b-06d1-45a6-a524-5442a4eb2fa3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:56.016961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-222ece3b-06d1-45a6-a524-5442a4eb2fa3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:56.017577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-222ece3b-06d1-45a6-a524-5442a4eb2fa3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:56.018033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-222ece3b-06d1-45a6-a524-5442a4eb2fa3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:56.167513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-222ece3b-06d1-45a6-a524-5442a4eb2fa3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:56.175867 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-222ece3b-06d1-45a6-a524-5442a4eb2fa3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.176006 Sep 01 05:15:56.176681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 119/229] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:55 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:56.365907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b97b552c-aab3-4fdf-81e7-459f479feeb9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:56.371799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b97b552c-aab3-4fdf-81e7-459f479feeb9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:56.380961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b97b552c-aab3-4fdf-81e7-459f479feeb9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:56.381442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b97b552c-aab3-4fdf-81e7-459f479feeb9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:56.382109 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b97b552c-aab3-4fdf-81e7-459f479feeb9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:56.383213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b97b552c-aab3-4fdf-81e7-459f479feeb9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:56.384059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b97b552c-aab3-4fdf-81e7-459f479feeb9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:56.384565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b97b552c-aab3-4fdf-81e7-459f479feeb9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:56.595826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b97b552c-aab3-4fdf-81e7-459f479feeb9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:56.605768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b97b552c-aab3-4fdf-81e7-459f479feeb9 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1314 microversion: 2.1 time: 0.246133 Sep 01 05:15:56.606337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 111/230] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:56 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:57.198991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e3313fd1-d0c1-4020-bd40-ec3c21bcca0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:57.199687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e3313fd1-d0c1-4020-bd40-ec3c21bcca0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:57.206157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e3313fd1-d0c1-4020-bd40-ec3c21bcca0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:57.206739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e3313fd1-d0c1-4020-bd40-ec3c21bcca0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:57.207922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e3313fd1-d0c1-4020-bd40-ec3c21bcca0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:57.208634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e3313fd1-d0c1-4020-bd40-ec3c21bcca0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:57.209113 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e3313fd1-d0c1-4020-bd40-ec3c21bcca0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:57.209538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e3313fd1-d0c1-4020-bd40-ec3c21bcca0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:57.341705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e3313fd1-d0c1-4020-bd40-ec3c21bcca0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:57.350030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e3313fd1-d0c1-4020-bd40-ec3c21bcca0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.155857 Sep 01 05:15:57.350597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 120/231] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:57 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:57.626411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2cff824c-339d-4c55-a54d-2883c3229089 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:57.627228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2cff824c-339d-4c55-a54d-2883c3229089 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:57.637295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cff824c-339d-4c55-a54d-2883c3229089 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:57.637771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cff824c-339d-4c55-a54d-2883c3229089 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:57.638748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cff824c-339d-4c55-a54d-2883c3229089 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:57.639617 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cff824c-339d-4c55-a54d-2883c3229089 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:57.640359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cff824c-339d-4c55-a54d-2883c3229089 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:57.640968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cff824c-339d-4c55-a54d-2883c3229089 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:57.980642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2cff824c-339d-4c55-a54d-2883c3229089 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:57.992076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2cff824c-339d-4c55-a54d-2883c3229089 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1314 microversion: 2.1 time: 0.369776 Sep 01 05:15:58.001286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 112/232] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:57 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:58.371729 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e342a529-05bc-4b82-80cf-d769bb29e564 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:58.372279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e342a529-05bc-4b82-80cf-d769bb29e564 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:58.378223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e342a529-05bc-4b82-80cf-d769bb29e564 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:58.379287 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e342a529-05bc-4b82-80cf-d769bb29e564 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:58.379937 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e342a529-05bc-4b82-80cf-d769bb29e564 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:58.380821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e342a529-05bc-4b82-80cf-d769bb29e564 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:58.381463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e342a529-05bc-4b82-80cf-d769bb29e564 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:58.382105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e342a529-05bc-4b82-80cf-d769bb29e564 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:58.538526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e342a529-05bc-4b82-80cf-d769bb29e564 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:58.547304 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e342a529-05bc-4b82-80cf-d769bb29e564 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.179714 Sep 01 05:15:58.547960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 121/233] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:58 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:59.012804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3fcb946c-489e-41b1-a62a-31cb596d3336 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:59.013411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3fcb946c-489e-41b1-a62a-31cb596d3336 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:59.019782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3fcb946c-489e-41b1-a62a-31cb596d3336 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:59.020262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3fcb946c-489e-41b1-a62a-31cb596d3336 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:59.020686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3fcb946c-489e-41b1-a62a-31cb596d3336 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:59.021405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3fcb946c-489e-41b1-a62a-31cb596d3336 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:59.021846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3fcb946c-489e-41b1-a62a-31cb596d3336 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:59.022256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3fcb946c-489e-41b1-a62a-31cb596d3336 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:59.150792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3fcb946c-489e-41b1-a62a-31cb596d3336 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:59.158331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3fcb946c-489e-41b1-a62a-31cb596d3336 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1314 microversion: 2.1 time: 0.149396 Sep 01 05:15:59.158887 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 113/234] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:59 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:59.568574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-29cbd6a1-5d83-4361-8c35-b6170a3bb65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:59.569212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-29cbd6a1-5d83-4361-8c35-b6170a3bb65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:59.576011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-29cbd6a1-5d83-4361-8c35-b6170a3bb65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:59.576415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-29cbd6a1-5d83-4361-8c35-b6170a3bb65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:59.576911 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-29cbd6a1-5d83-4361-8c35-b6170a3bb65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:59.577621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-29cbd6a1-5d83-4361-8c35-b6170a3bb65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:59.578071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-29cbd6a1-5d83-4361-8c35-b6170a3bb65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:59.578508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-29cbd6a1-5d83-4361-8c35-b6170a3bb65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:59.719071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-29cbd6a1-5d83-4361-8c35-b6170a3bb65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:59.727345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-29cbd6a1-5d83-4361-8c35-b6170a3bb65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.162697 Sep 01 05:15:59.727919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 122/235] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:59 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:00.179362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-72e046e0-7968-40e4-abd9-f450128de1c4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:00.179976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-72e046e0-7968-40e4-abd9-f450128de1c4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:00.186734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72e046e0-7968-40e4-abd9-f450128de1c4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:00.187216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72e046e0-7968-40e4-abd9-f450128de1c4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:00.187660 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72e046e0-7968-40e4-abd9-f450128de1c4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:00.188529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72e046e0-7968-40e4-abd9-f450128de1c4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:00.189163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72e046e0-7968-40e4-abd9-f450128de1c4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:00.189664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72e046e0-7968-40e4-abd9-f450128de1c4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:00.323899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72e046e0-7968-40e4-abd9-f450128de1c4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:00.336723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-72e046e0-7968-40e4-abd9-f450128de1c4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1314 microversion: 2.1 time: 0.160726 Sep 01 05:16:00.337742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 114/236] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:00 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:00.749540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cefbce35-3746-44d7-b1bb-186cfdb0819b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:00.750235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cefbce35-3746-44d7-b1bb-186cfdb0819b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:00.756962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cefbce35-3746-44d7-b1bb-186cfdb0819b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:00.757585 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cefbce35-3746-44d7-b1bb-186cfdb0819b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:00.758189 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cefbce35-3746-44d7-b1bb-186cfdb0819b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:00.758936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cefbce35-3746-44d7-b1bb-186cfdb0819b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:00.759389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cefbce35-3746-44d7-b1bb-186cfdb0819b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:00.759845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cefbce35-3746-44d7-b1bb-186cfdb0819b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:00.903359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cefbce35-3746-44d7-b1bb-186cfdb0819b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:00.912256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cefbce35-3746-44d7-b1bb-186cfdb0819b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.166494 Sep 01 05:16:00.912971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 123/237] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:00 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:01.358584 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ae72c5cc-7075-4a9f-afe1-dd6c97b3efbc tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:01.359400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ae72c5cc-7075-4a9f-afe1-dd6c97b3efbc tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:01.367479 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae72c5cc-7075-4a9f-afe1-dd6c97b3efbc tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:01.368028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae72c5cc-7075-4a9f-afe1-dd6c97b3efbc tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:01.368659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae72c5cc-7075-4a9f-afe1-dd6c97b3efbc tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:01.369514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae72c5cc-7075-4a9f-afe1-dd6c97b3efbc tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:01.370052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae72c5cc-7075-4a9f-afe1-dd6c97b3efbc tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:01.370541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae72c5cc-7075-4a9f-afe1-dd6c97b3efbc tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:01.508482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ae72c5cc-7075-4a9f-afe1-dd6c97b3efbc tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:01.516552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ae72c5cc-7075-4a9f-afe1-dd6c97b3efbc tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1314 microversion: 2.1 time: 0.161946 Sep 01 05:16:01.517155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 115/238] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:01 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:01.933691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-16ad87e4-92b8-46bb-845e-2383a7b50c1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:01.934395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-16ad87e4-92b8-46bb-845e-2383a7b50c1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:01.936432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:01.937164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=6 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:01.943078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-16ad87e4-92b8-46bb-845e-2383a7b50c1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:01.943562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-16ad87e4-92b8-46bb-845e-2383a7b50c1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:01.943992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-16ad87e4-92b8-46bb-845e-2383a7b50c1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:01.944684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-16ad87e4-92b8-46bb-845e-2383a7b50c1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:01.945158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-16ad87e4-92b8-46bb-845e-2383a7b50c1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:01.945573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-16ad87e4-92b8-46bb-845e-2383a7b50c1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.086557 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-16ad87e4-92b8-46bb-845e-2383a7b50c1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:02.094897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-16ad87e4-92b8-46bb-845e-2383a7b50c1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1522 microversion: 2.1 time: 0.165237 Sep 01 05:16:02.095525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 124/239] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:01 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:02.249580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-cbff350f-6b79-4605-9f08-a1bcf1d92de3 req-4f16315c-a920-4c23-9663-4b2d0dfe4b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01993e59-9adf-4c96-92ae-801ab1d73546", "name": "network-vif-plugged", "status": "completed", "tag": "83643e0c-fdbd-4b91-955b-7a0ecd3c4400"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:02.254904 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:02.261169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-cbff350f-6b79-4605-9f08-a1bcf1d92de3 req-4f16315c-a920-4c23-9663-4b2d0dfe4b62 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.261914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-cbff350f-6b79-4605-9f08-a1bcf1d92de3 req-4f16315c-a920-4c23-9663-4b2d0dfe4b62 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.262508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-cbff350f-6b79-4605-9f08-a1bcf1d92de3 req-4f16315c-a920-4c23-9663-4b2d0dfe4b62 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.275602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-cbff350f-6b79-4605-9f08-a1bcf1d92de3 req-4f16315c-a920-4c23-9663-4b2d0dfe4b62 service nova] Creating event network-vif-plugged:83643e0c-fdbd-4b91-955b-7a0ecd3c4400 for instance 01993e59-9adf-4c96-92ae-801ab1d73546 on hv-cinder-85391 Sep 01 05:16:02.281803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-cbff350f-6b79-4605-9f08-a1bcf1d92de3 req-4f16315c-a920-4c23-9663-4b2d0dfe4b62 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036172 Sep 01 05:16:02.282499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 116/240] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:02.538273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1c6a5102-317d-42a0-90b8-decffb7487e4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:02.539304 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1c6a5102-317d-42a0-90b8-decffb7487e4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:02.547407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c6a5102-317d-42a0-90b8-decffb7487e4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.548183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c6a5102-317d-42a0-90b8-decffb7487e4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.548872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c6a5102-317d-42a0-90b8-decffb7487e4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.549854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c6a5102-317d-42a0-90b8-decffb7487e4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.550603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c6a5102-317d-42a0-90b8-decffb7487e4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.551224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c6a5102-317d-42a0-90b8-decffb7487e4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.775116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1c6a5102-317d-42a0-90b8-decffb7487e4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:02.787813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1c6a5102-317d-42a0-90b8-decffb7487e4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1314 microversion: 2.1 time: 0.253905 Sep 01 05:16:02.788768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 125/241] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:02 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:03.120425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f747b676-2426-4a43-9762-656a6d8e5721 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:03.122046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f747b676-2426-4a43-9762-656a6d8e5721 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:03.130380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f747b676-2426-4a43-9762-656a6d8e5721 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:03.131078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f747b676-2426-4a43-9762-656a6d8e5721 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:03.131680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f747b676-2426-4a43-9762-656a6d8e5721 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:03.132525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f747b676-2426-4a43-9762-656a6d8e5721 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:03.133574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f747b676-2426-4a43-9762-656a6d8e5721 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:03.133993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f747b676-2426-4a43-9762-656a6d8e5721 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:03.322937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f747b676-2426-4a43-9762-656a6d8e5721 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:03.330566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:03.342694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f747b676-2426-4a43-9762-656a6d8e5721 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1502 microversion: 2.1 time: 0.227847 Sep 01 05:16:03.344009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 117/242] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:03 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:03.365788 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9f589161-7289-441c-9e35-d9265fb98a86 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:03.367024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9f589161-7289-441c-9e35-d9265fb98a86 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:03.375586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9f589161-7289-441c-9e35-d9265fb98a86 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:03.376154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9f589161-7289-441c-9e35-d9265fb98a86 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:03.376657 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9f589161-7289-441c-9e35-d9265fb98a86 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:03.377493 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9f589161-7289-441c-9e35-d9265fb98a86 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:03.378005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9f589161-7289-441c-9e35-d9265fb98a86 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:03.379250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9f589161-7289-441c-9e35-d9265fb98a86 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:03.544455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9f589161-7289-441c-9e35-d9265fb98a86 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:03.555775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9f589161-7289-441c-9e35-d9265fb98a86 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1515 microversion: 2.1 time: 0.194761 Sep 01 05:16:03.556499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 126/243] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:03 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:03.819720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2f473950-502c-4481-9e7f-6ac8278c6748 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:03.823361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2f473950-502c-4481-9e7f-6ac8278c6748 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:03.837974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f473950-502c-4481-9e7f-6ac8278c6748 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:03.844569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f473950-502c-4481-9e7f-6ac8278c6748 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:03.845256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f473950-502c-4481-9e7f-6ac8278c6748 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:03.846347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f473950-502c-4481-9e7f-6ac8278c6748 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:03.846808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f473950-502c-4481-9e7f-6ac8278c6748 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:03.847789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f473950-502c-4481-9e7f-6ac8278c6748 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:04.033986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2f473950-502c-4481-9e7f-6ac8278c6748 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:04.042817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2f473950-502c-4481-9e7f-6ac8278c6748 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1314 microversion: 2.1 time: 0.230502 Sep 01 05:16:04.043641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 118/244] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:03 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:05.065371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-31da22c7-6187-4424-8184-69400888b6fe tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:05.066572 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-31da22c7-6187-4424-8184-69400888b6fe tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:05.073190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31da22c7-6187-4424-8184-69400888b6fe tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:05.073674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31da22c7-6187-4424-8184-69400888b6fe tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:05.074102 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31da22c7-6187-4424-8184-69400888b6fe tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:05.074975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31da22c7-6187-4424-8184-69400888b6fe tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:05.075428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31da22c7-6187-4424-8184-69400888b6fe tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:05.075844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31da22c7-6187-4424-8184-69400888b6fe tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:05.266456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-31da22c7-6187-4424-8184-69400888b6fe tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:05.270277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:05.275619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-31da22c7-6187-4424-8184-69400888b6fe tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1314 microversion: 2.1 time: 0.213996 Sep 01 05:16:05.276208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 127/245] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:05 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:06.296997 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d396b815-3468-45ac-bd54-7b65dac56b81 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:06.297537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d396b815-3468-45ac-bd54-7b65dac56b81 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:06.303851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d396b815-3468-45ac-bd54-7b65dac56b81 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:06.304324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d396b815-3468-45ac-bd54-7b65dac56b81 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:06.304749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d396b815-3468-45ac-bd54-7b65dac56b81 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:06.305472 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d396b815-3468-45ac-bd54-7b65dac56b81 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:06.305938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d396b815-3468-45ac-bd54-7b65dac56b81 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:06.306346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d396b815-3468-45ac-bd54-7b65dac56b81 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:06.442115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d396b815-3468-45ac-bd54-7b65dac56b81 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:06.450683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d396b815-3468-45ac-bd54-7b65dac56b81 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1314 microversion: 2.1 time: 0.157482 Sep 01 05:16:06.451567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 119/246] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:06 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:07.473890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d7144b9d-89e9-40b6-ba70-e9cf6fc8d462 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:07.474523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d7144b9d-89e9-40b6-ba70-e9cf6fc8d462 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:07.480350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d7144b9d-89e9-40b6-ba70-e9cf6fc8d462 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:07.480856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d7144b9d-89e9-40b6-ba70-e9cf6fc8d462 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:07.481278 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d7144b9d-89e9-40b6-ba70-e9cf6fc8d462 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:07.481956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d7144b9d-89e9-40b6-ba70-e9cf6fc8d462 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:07.482397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d7144b9d-89e9-40b6-ba70-e9cf6fc8d462 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:07.482809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d7144b9d-89e9-40b6-ba70-e9cf6fc8d462 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:07.792503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d7144b9d-89e9-40b6-ba70-e9cf6fc8d462 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:07.800069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d7144b9d-89e9-40b6-ba70-e9cf6fc8d462 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1499 microversion: 2.1 time: 0.330611 Sep 01 05:16:07.801426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 128/247] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:07 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1499 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:08.219310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2e472eeb-05b9-4285-b032-1f5f1d57fc03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:08.221468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2e472eeb-05b9-4285-b032-1f5f1d57fc03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:08.227712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e472eeb-05b9-4285-b032-1f5f1d57fc03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:08.228181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e472eeb-05b9-4285-b032-1f5f1d57fc03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:08.228607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e472eeb-05b9-4285-b032-1f5f1d57fc03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:08.229311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e472eeb-05b9-4285-b032-1f5f1d57fc03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:08.229756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e472eeb-05b9-4285-b032-1f5f1d57fc03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:08.230167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e472eeb-05b9-4285-b032-1f5f1d57fc03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:08.253029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-2e472eeb-05b9-4285-b032-1f5f1d57fc03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lazy-loading 'flavor' on Instance uuid f9edb178-d264-4269-ae85-e2b524170b64 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:16:08.360665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2e472eeb-05b9-4285-b032-1f5f1d57fc03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "POST /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64/action" status: 200 len: 32 microversion: 2.1 time: 0.145142 Sep 01 05:16:08.361401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 120/248] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:16:08 2022] POST /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64/action => generated 32 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:16:08.371312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5801219a-b22a-4e71-ad6c-b8e0b5aa3e60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:08.371948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5801219a-b22a-4e71-ad6c-b8e0b5aa3e60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:08.378010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5801219a-b22a-4e71-ad6c-b8e0b5aa3e60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:08.379461 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5801219a-b22a-4e71-ad6c-b8e0b5aa3e60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:08.380027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5801219a-b22a-4e71-ad6c-b8e0b5aa3e60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:08.380975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5801219a-b22a-4e71-ad6c-b8e0b5aa3e60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:08.381985 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5801219a-b22a-4e71-ad6c-b8e0b5aa3e60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:08.381985 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5801219a-b22a-4e71-ad6c-b8e0b5aa3e60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:08.513793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5801219a-b22a-4e71-ad6c-b8e0b5aa3e60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:08.521673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5801219a-b22a-4e71-ad6c-b8e0b5aa3e60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.154274 Sep 01 05:16:08.522255 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 129/249] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:08 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:08.635535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6df6ebe2-1f38-4c78-9a2e-4ff9c74d3cd8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:08.637650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6df6ebe2-1f38-4c78-9a2e-4ff9c74d3cd8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:08.645638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6df6ebe2-1f38-4c78-9a2e-4ff9c74d3cd8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:08.645934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6df6ebe2-1f38-4c78-9a2e-4ff9c74d3cd8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:08.646413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6df6ebe2-1f38-4c78-9a2e-4ff9c74d3cd8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:08.647665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6df6ebe2-1f38-4c78-9a2e-4ff9c74d3cd8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:08.648025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6df6ebe2-1f38-4c78-9a2e-4ff9c74d3cd8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:08.649300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6df6ebe2-1f38-4c78-9a2e-4ff9c74d3cd8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:08.679717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6df6ebe2-1f38-4c78-9a2e-4ff9c74d3cd8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:16:08.771744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6df6ebe2-1f38-4c78-9a2e-4ff9c74d3cd8 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "DELETE /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 204 len: 0 microversion: 2.1 time: 0.139535 Sep 01 05:16:08.772822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 121/250] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:16:08 2022] DELETE /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:16:08.781783 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-27410dad-98b1-42b7-8e80-10bb8885d661 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:08.782537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-27410dad-98b1-42b7-8e80-10bb8885d661 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:08.794664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-27410dad-98b1-42b7-8e80-10bb8885d661 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:08.795488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-27410dad-98b1-42b7-8e80-10bb8885d661 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:08.796013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-27410dad-98b1-42b7-8e80-10bb8885d661 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:08.797137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-27410dad-98b1-42b7-8e80-10bb8885d661 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:08.797800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-27410dad-98b1-42b7-8e80-10bb8885d661 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:08.798476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-27410dad-98b1-42b7-8e80-10bb8885d661 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:08.998050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-27410dad-98b1-42b7-8e80-10bb8885d661 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:09.007377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-27410dad-98b1-42b7-8e80-10bb8885d661 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1505 microversion: 2.1 time: 0.229947 Sep 01 05:16:09.008264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 130/251] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:08 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:09.544810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8a252195-5183-4982-86ba-fce3f39cb2c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:09.545508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8a252195-5183-4982-86ba-fce3f39cb2c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:09.552216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a252195-5183-4982-86ba-fce3f39cb2c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:09.552693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a252195-5183-4982-86ba-fce3f39cb2c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:09.553197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a252195-5183-4982-86ba-fce3f39cb2c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:09.554231 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a252195-5183-4982-86ba-fce3f39cb2c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:09.554761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a252195-5183-4982-86ba-fce3f39cb2c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:09.555182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a252195-5183-4982-86ba-fce3f39cb2c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:09.691423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8a252195-5183-4982-86ba-fce3f39cb2c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:09.699373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8a252195-5183-4982-86ba-fce3f39cb2c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.159180 Sep 01 05:16:09.699935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 122/252] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:09 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:10.028877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-de3a9a93-e658-4abe-9e01-82c3619ba8b4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:10.030001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-de3a9a93-e658-4abe-9e01-82c3619ba8b4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:10.036489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de3a9a93-e658-4abe-9e01-82c3619ba8b4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:10.037003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de3a9a93-e658-4abe-9e01-82c3619ba8b4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:10.037430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de3a9a93-e658-4abe-9e01-82c3619ba8b4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:10.038121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de3a9a93-e658-4abe-9e01-82c3619ba8b4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:10.038564 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de3a9a93-e658-4abe-9e01-82c3619ba8b4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:10.039227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de3a9a93-e658-4abe-9e01-82c3619ba8b4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:10.199181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-de3a9a93-e658-4abe-9e01-82c3619ba8b4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:10.207854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-de3a9a93-e658-4abe-9e01-82c3619ba8b4 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1505 microversion: 2.1 time: 0.183043 Sep 01 05:16:10.208611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 131/253] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:10 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:10.720439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-81458c03-9556-4c6a-ae98-88d5802b69b9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:10.721074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-81458c03-9556-4c6a-ae98-88d5802b69b9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:10.728674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81458c03-9556-4c6a-ae98-88d5802b69b9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:10.729191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81458c03-9556-4c6a-ae98-88d5802b69b9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:10.729620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81458c03-9556-4c6a-ae98-88d5802b69b9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:10.730303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81458c03-9556-4c6a-ae98-88d5802b69b9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:10.730778 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81458c03-9556-4c6a-ae98-88d5802b69b9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:10.731229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81458c03-9556-4c6a-ae98-88d5802b69b9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:10.872830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-81458c03-9556-4c6a-ae98-88d5802b69b9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:10.881146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-81458c03-9556-4c6a-ae98-88d5802b69b9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.164435 Sep 01 05:16:10.881700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 123/254] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:10 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:11.229399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d23e086b-fdcc-42eb-89e9-701641283b9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:11.230003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d23e086b-fdcc-42eb-89e9-701641283b9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:11.235909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d23e086b-fdcc-42eb-89e9-701641283b9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:11.236398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d23e086b-fdcc-42eb-89e9-701641283b9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:11.236859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d23e086b-fdcc-42eb-89e9-701641283b9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:11.237647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d23e086b-fdcc-42eb-89e9-701641283b9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:11.238835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d23e086b-fdcc-42eb-89e9-701641283b9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:11.239204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d23e086b-fdcc-42eb-89e9-701641283b9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:11.374488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d23e086b-fdcc-42eb-89e9-701641283b9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:11.383102 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d23e086b-fdcc-42eb-89e9-701641283b9b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1505 microversion: 2.1 time: 0.157438 Sep 01 05:16:11.383671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 132/255] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:11 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:11.903014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-677dc3f7-e2d6-4192-b946-211a89b0e6be tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:11.903630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-677dc3f7-e2d6-4192-b946-211a89b0e6be tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:11.910300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-677dc3f7-e2d6-4192-b946-211a89b0e6be tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:11.910782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-677dc3f7-e2d6-4192-b946-211a89b0e6be tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:11.911407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-677dc3f7-e2d6-4192-b946-211a89b0e6be tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:11.912094 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-677dc3f7-e2d6-4192-b946-211a89b0e6be tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:11.912547 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-677dc3f7-e2d6-4192-b946-211a89b0e6be tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:11.912999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-677dc3f7-e2d6-4192-b946-211a89b0e6be tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:12.057543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-677dc3f7-e2d6-4192-b946-211a89b0e6be tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:12.065585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-677dc3f7-e2d6-4192-b946-211a89b0e6be tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.166374 Sep 01 05:16:12.067065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 124/256] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:11 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:12.405789 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0e561f26-2ce8-4169-80a8-a3fecb1c1a0b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:12.406514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0e561f26-2ce8-4169-80a8-a3fecb1c1a0b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:12.413953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e561f26-2ce8-4169-80a8-a3fecb1c1a0b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:12.414302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e561f26-2ce8-4169-80a8-a3fecb1c1a0b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:12.414793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e561f26-2ce8-4169-80a8-a3fecb1c1a0b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:12.415744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e561f26-2ce8-4169-80a8-a3fecb1c1a0b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:12.415867 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e561f26-2ce8-4169-80a8-a3fecb1c1a0b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:12.416549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e561f26-2ce8-4169-80a8-a3fecb1c1a0b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:12.569320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0e561f26-2ce8-4169-80a8-a3fecb1c1a0b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:12.578131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0e561f26-2ce8-4169-80a8-a3fecb1c1a0b tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1505 microversion: 2.1 time: 0.176270 Sep 01 05:16:12.578813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 133/257] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:12 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:12.885822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-023560cc-a3c5-4c26-8ab1-dd7c733a3556 req-f9aa3420-e658-4d94-8beb-4c0b570eac12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01993e59-9adf-4c96-92ae-801ab1d73546", "name": "network-vif-deleted", "tag": "83643e0c-fdbd-4b91-955b-7a0ecd3c4400"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:12.900829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-023560cc-a3c5-4c26-8ab1-dd7c733a3556 req-f9aa3420-e658-4d94-8beb-4c0b570eac12 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:12.901314 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-023560cc-a3c5-4c26-8ab1-dd7c733a3556 req-f9aa3420-e658-4d94-8beb-4c0b570eac12 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:12.901746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-023560cc-a3c5-4c26-8ab1-dd7c733a3556 req-f9aa3420-e658-4d94-8beb-4c0b570eac12 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:12.926156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-023560cc-a3c5-4c26-8ab1-dd7c733a3556 req-f9aa3420-e658-4d94-8beb-4c0b570eac12 service nova] Creating event network-vif-deleted:83643e0c-fdbd-4b91-955b-7a0ecd3c4400 for instance 01993e59-9adf-4c96-92ae-801ab1d73546 on hv-cinder-85391 Sep 01 05:16:12.932357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-023560cc-a3c5-4c26-8ab1-dd7c733a3556 req-f9aa3420-e658-4d94-8beb-4c0b570eac12 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050098 Sep 01 05:16:12.932975 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 125/258] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:13.088882 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-085411cd-3844-4293-90ba-5cc9fd171543 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:13.089465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-085411cd-3844-4293-90ba-5cc9fd171543 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:13.095921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-085411cd-3844-4293-90ba-5cc9fd171543 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:13.096414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-085411cd-3844-4293-90ba-5cc9fd171543 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:13.096950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-085411cd-3844-4293-90ba-5cc9fd171543 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:13.097641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-085411cd-3844-4293-90ba-5cc9fd171543 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:13.098136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-085411cd-3844-4293-90ba-5cc9fd171543 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:13.098511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-085411cd-3844-4293-90ba-5cc9fd171543 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:13.282781 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-085411cd-3844-4293-90ba-5cc9fd171543 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:13.292385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-085411cd-3844-4293-90ba-5cc9fd171543 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.207251 Sep 01 05:16:13.293778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 134/259] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:13 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:13.601167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:13.601858 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:13.608237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:13.608709 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:13.609152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:13.609827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:13.610268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:13.610683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:13.642392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:13.642862 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:13.643290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:13.643834 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lazy-loading 'fault' on Instance uuid 01993e59-9adf-4c96-92ae-801ab1d73546 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:16:13.683954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:13.692083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-455423d0-85ed-416a-bbc1-22f9ec616f17 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1304 microversion: 2.1 time: 0.095089 Sep 01 05:16:13.692647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 126/260] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:13 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:14.315429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e86a9f01-34cd-4d1a-a842-f52df2199b32 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:14.317336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e86a9f01-34cd-4d1a-a842-f52df2199b32 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:14.323386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e86a9f01-34cd-4d1a-a842-f52df2199b32 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:14.323869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e86a9f01-34cd-4d1a-a842-f52df2199b32 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:14.324310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e86a9f01-34cd-4d1a-a842-f52df2199b32 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:14.325010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e86a9f01-34cd-4d1a-a842-f52df2199b32 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:14.325461 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e86a9f01-34cd-4d1a-a842-f52df2199b32 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:14.325879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e86a9f01-34cd-4d1a-a842-f52df2199b32 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:14.457420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e86a9f01-34cd-4d1a-a842-f52df2199b32 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:14.465386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e86a9f01-34cd-4d1a-a842-f52df2199b32 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.153967 Sep 01 05:16:14.466314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 135/261] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:14 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:14.712000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:14.712609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:14.718968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:14.719493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:14.719870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:14.720543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:14.721013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:14.721431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:14.752827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:14.753505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:14.754048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:14.754489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lazy-loading 'fault' on Instance uuid 01993e59-9adf-4c96-92ae-801ab1d73546 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:16:14.793524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:14.802042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1a393a5f-9b1f-479e-bf46-119c421eb203 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1304 microversion: 2.1 time: 0.093808 Sep 01 05:16:14.802600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 127/262] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:14 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:15.487408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2699e4bf-d97d-4aa6-9691-eadb5a9363f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:15.488008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2699e4bf-d97d-4aa6-9691-eadb5a9363f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:15.494706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2699e4bf-d97d-4aa6-9691-eadb5a9363f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:15.495218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2699e4bf-d97d-4aa6-9691-eadb5a9363f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:15.495641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2699e4bf-d97d-4aa6-9691-eadb5a9363f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:15.496369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2699e4bf-d97d-4aa6-9691-eadb5a9363f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:15.496760 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2699e4bf-d97d-4aa6-9691-eadb5a9363f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:15.497203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2699e4bf-d97d-4aa6-9691-eadb5a9363f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:15.628668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2699e4bf-d97d-4aa6-9691-eadb5a9363f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:15.636221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2699e4bf-d97d-4aa6-9691-eadb5a9363f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.152676 Sep 01 05:16:15.636824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 136/263] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:15 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:15.822741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:15.823273 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:15.829595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:15.830064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:15.830487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:15.831662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:15.832176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:15.832713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:15.863181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:15.863643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:15.864067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:15.864496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lazy-loading 'fault' on Instance uuid 01993e59-9adf-4c96-92ae-801ab1d73546 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:16:15.903996 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075c5a476ec14386afb0f9f16b66f7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f6958ea49445f780bcec5d8b86840d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:15.912310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-74991df8-6422-4a92-88dc-2d1385f6a817 tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 200 len: 1304 microversion: 2.1 time: 0.093428 Sep 01 05:16:15.912895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 128/264] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:15 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:16.657205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2c64409e-1b6a-437c-9a6a-19e3c4996da4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:16.657842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2c64409e-1b6a-437c-9a6a-19e3c4996da4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:16.664348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c64409e-1b6a-437c-9a6a-19e3c4996da4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:16.664849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c64409e-1b6a-437c-9a6a-19e3c4996da4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:16.665283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c64409e-1b6a-437c-9a6a-19e3c4996da4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:16.665964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c64409e-1b6a-437c-9a6a-19e3c4996da4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:16.666412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c64409e-1b6a-437c-9a6a-19e3c4996da4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:16.666832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c64409e-1b6a-437c-9a6a-19e3c4996da4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:16.803192 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2c64409e-1b6a-437c-9a6a-19e3c4996da4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:16.811024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2c64409e-1b6a-437c-9a6a-19e3c4996da4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.157744 Sep 01 05:16:16.811581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 137/265] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:16 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:16.933972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4da25da5-f449-4da5-af92-66c39a0fbfaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:16.934518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4da25da5-f449-4da5-af92-66c39a0fbfaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] [instance: 01993e59-9adf-4c96-92ae-801ab1d73546] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:16.941026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4da25da5-f449-4da5-af92-66c39a0fbfaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:16.941495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4da25da5-f449-4da5-af92-66c39a0fbfaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:16.942197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4da25da5-f449-4da5-af92-66c39a0fbfaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:16.942977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4da25da5-f449-4da5-af92-66c39a0fbfaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:16.943422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4da25da5-f449-4da5-af92-66c39a0fbfaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:16.943832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4da25da5-f449-4da5-af92-66c39a0fbfaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:16.957149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-4da25da5-f449-4da5-af92-66c39a0fbfaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] HTTP exception thrown: Instance 01993e59-9adf-4c96-92ae-801ab1d73546 could not be found. Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4da25da5-f449-4da5-af92-66c39a0fbfaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Request method failure captured: Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 HTTP/1.1 Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED_kQBK6CMkZECCYugiSeha6QDRonwq8G9TF7R3nAC8ExIauUd-hGoSsjUr0AFOms6bUrL2Bpsaq_fvKlOS9iFoy2-_bxfYQWjq9K7kTW5gNqQ5hBghEy0QQN0o8mFLQ0vj-A6QnK2oNGeyb1wv27a_pXBkt5PsPRWXfTW_xTcOxTP0 Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 66f6958ea49445f780bcec5d8b86840d Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-VolumesActionsTest-254228033 Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:16:16.959042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:16:16.960560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_66f6958ea49445f780bcec5d8b86840d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/66f6958ea49445f780bcec5d8b86840d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/66f6958ea49445f780bcec5d8b86840d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/66f6958ea49445f780bcec5d8b86840d"}]}] Sep 01 05:16:16.960560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-VolumesActionsTest-254228033 Sep 01 05:16:16.960560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 66f6958ea49445f780bcec5d8b86840d Sep 01 05:16:16.960560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-VolumesActionsTest-254228033 Sep 01 05:16:16.960560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-VolumesActionsTest-254228033-project Sep 01 05:16:16.960560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:16:16.960560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:16:16.960560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 075c5a476ec14386afb0f9f16b66f7f9 Sep 01 05:16:16.960560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-VolumesActionsTest-254228033-project Sep 01 05:16:16.960560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:16:16.960560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance 01993e59-9adf-4c96-92ae-801ab1d73546 could not be found. Sep 01 05:16:16.960560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '01993e59-9adf-4c96-92ae-801ab1d73546'} Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01993e59-9adf-4c96-92ae-801ab1d73546 could not be found. Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:16:16.961540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01993e59-9adf-4c96-92ae-801ab1d73546 could not be found. Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01993e59-9adf-4c96-92ae-801ab1d73546 could not be found. Sep 01 05:16:16.963321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:16:16.964537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4da25da5-f449-4da5-af92-66c39a0fbfaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] Returning 404 to user: Instance 01993e59-9adf-4c96-92ae-801ab1d73546 could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:16:16.964537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4da25da5-f449-4da5-af92-66c39a0fbfaa tempest-VolumesActionsTest-254228033 tempest-VolumesActionsTest-254228033-project] 10.222.0.49 "GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546" status: 404 len: 111 microversion: 2.1 time: 0.030652 Sep 01 05:16:16.964537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 129/266] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:16 2022] GET /compute/v2.1/servers/01993e59-9adf-4c96-92ae-801ab1d73546 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:16:17.831540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a1f84b91-ecb2-405f-a6a2-827fd9d0ccb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:17.832068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a1f84b91-ecb2-405f-a6a2-827fd9d0ccb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:17.834477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:17.839649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a1f84b91-ecb2-405f-a6a2-827fd9d0ccb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:17.840133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a1f84b91-ecb2-405f-a6a2-827fd9d0ccb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:17.840565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a1f84b91-ecb2-405f-a6a2-827fd9d0ccb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:17.841281 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a1f84b91-ecb2-405f-a6a2-827fd9d0ccb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:17.841732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a1f84b91-ecb2-405f-a6a2-827fd9d0ccb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:17.842153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a1f84b91-ecb2-405f-a6a2-827fd9d0ccb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:17.975181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a1f84b91-ecb2-405f-a6a2-827fd9d0ccb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:17.982721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a1f84b91-ecb2-405f-a6a2-827fd9d0ccb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.155046 Sep 01 05:16:17.983312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 138/267] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:17 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:18.406335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-662c233e-f4a0-442a-8382-6a75be77edd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:18.406842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-662c233e-f4a0-442a-8382-6a75be77edd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:18.414072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-662c233e-f4a0-442a-8382-6a75be77edd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:18.414550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-662c233e-f4a0-442a-8382-6a75be77edd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:18.414988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-662c233e-f4a0-442a-8382-6a75be77edd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:18.415663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-662c233e-f4a0-442a-8382-6a75be77edd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:18.416107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-662c233e-f4a0-442a-8382-6a75be77edd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:18.416528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-662c233e-f4a0-442a-8382-6a75be77edd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:18.440182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-662c233e-f4a0-442a-8382-6a75be77edd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/ips" status: 200 len: 152 microversion: 2.20 time: 0.037730 Sep 01 05:16:18.440731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 130/268] 10.222.0.49 () {60 vars in 1289 bytes} [Thu Sep 1 05:16:18 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:16:19.003380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a0dc1d74-7ec4-41fc-8c1b-d95ae0aff545 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:19.003984 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a0dc1d74-7ec4-41fc-8c1b-d95ae0aff545 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:19.010706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a0dc1d74-7ec4-41fc-8c1b-d95ae0aff545 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:19.011228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a0dc1d74-7ec4-41fc-8c1b-d95ae0aff545 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:19.011664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a0dc1d74-7ec4-41fc-8c1b-d95ae0aff545 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:19.012385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a0dc1d74-7ec4-41fc-8c1b-d95ae0aff545 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:19.012870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a0dc1d74-7ec4-41fc-8c1b-d95ae0aff545 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:19.013296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a0dc1d74-7ec4-41fc-8c1b-d95ae0aff545 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:19.149804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a0dc1d74-7ec4-41fc-8c1b-d95ae0aff545 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:19.157494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a0dc1d74-7ec4-41fc-8c1b-d95ae0aff545 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.158009 Sep 01 05:16:19.158065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 139/269] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:18 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:20.179134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8c98e9cf-16ae-4116-b08b-86689fdaaafe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:20.179738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8c98e9cf-16ae-4116-b08b-86689fdaaafe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:20.186451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c98e9cf-16ae-4116-b08b-86689fdaaafe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:20.186928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c98e9cf-16ae-4116-b08b-86689fdaaafe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:20.187363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c98e9cf-16ae-4116-b08b-86689fdaaafe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:20.188046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c98e9cf-16ae-4116-b08b-86689fdaaafe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:20.188495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c98e9cf-16ae-4116-b08b-86689fdaaafe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:20.188943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c98e9cf-16ae-4116-b08b-86689fdaaafe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:20.205878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:20.324803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8c98e9cf-16ae-4116-b08b-86689fdaaafe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:20.332380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8c98e9cf-16ae-4116-b08b-86689fdaaafe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.157693 Sep 01 05:16:20.333660 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 131/270] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:20 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:21.354878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b7e5f378-328a-4007-9c2c-bfc26c0080df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:21.355481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b7e5f378-328a-4007-9c2c-bfc26c0080df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:21.361491 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7e5f378-328a-4007-9c2c-bfc26c0080df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:21.361965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7e5f378-328a-4007-9c2c-bfc26c0080df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:21.362390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7e5f378-328a-4007-9c2c-bfc26c0080df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:21.363062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7e5f378-328a-4007-9c2c-bfc26c0080df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:21.363504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7e5f378-328a-4007-9c2c-bfc26c0080df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:21.364856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7e5f378-328a-4007-9c2c-bfc26c0080df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:21.492643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b7e5f378-328a-4007-9c2c-bfc26c0080df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:21.500270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b7e5f378-328a-4007-9c2c-bfc26c0080df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.149250 Sep 01 05:16:21.500854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 140/271] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:21 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:22.521805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f25610f0-a6c9-4659-8dea-dd35f5625e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:22.522397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f25610f0-a6c9-4659-8dea-dd35f5625e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:22.528731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f25610f0-a6c9-4659-8dea-dd35f5625e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:22.529223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f25610f0-a6c9-4659-8dea-dd35f5625e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:22.529656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f25610f0-a6c9-4659-8dea-dd35f5625e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:22.530339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f25610f0-a6c9-4659-8dea-dd35f5625e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:22.530786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f25610f0-a6c9-4659-8dea-dd35f5625e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:22.531204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f25610f0-a6c9-4659-8dea-dd35f5625e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:22.664911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f25610f0-a6c9-4659-8dea-dd35f5625e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:22.672612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f25610f0-a6c9-4659-8dea-dd35f5625e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.154866 Sep 01 05:16:22.673195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 132/272] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:22 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:23.550081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d004c8a0-c44b-4cfc-8556-2e13b0cc2a98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:23.551840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d004c8a0-c44b-4cfc-8556-2e13b0cc2a98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:23.558515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d004c8a0-c44b-4cfc-8556-2e13b0cc2a98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:23.559043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d004c8a0-c44b-4cfc-8556-2e13b0cc2a98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:23.559470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d004c8a0-c44b-4cfc-8556-2e13b0cc2a98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:23.560219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d004c8a0-c44b-4cfc-8556-2e13b0cc2a98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:23.560897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d004c8a0-c44b-4cfc-8556-2e13b0cc2a98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:23.561562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d004c8a0-c44b-4cfc-8556-2e13b0cc2a98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:23.587168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-d004c8a0-c44b-4cfc-8556-2e13b0cc2a98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lazy-loading 'flavor' on Instance uuid 2a582556-d184-4047-ac19-285c0edd2fdf {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:16:23.694222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-08808c93-17a3-41f0-b6a1-b6f955799317 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:23.695473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-08808c93-17a3-41f0-b6a1-b6f955799317 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:23.702700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08808c93-17a3-41f0-b6a1-b6f955799317 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:23.703030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08808c93-17a3-41f0-b6a1-b6f955799317 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:23.703495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08808c93-17a3-41f0-b6a1-b6f955799317 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:23.704918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08808c93-17a3-41f0-b6a1-b6f955799317 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:23.705320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08808c93-17a3-41f0-b6a1-b6f955799317 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:23.705742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08808c93-17a3-41f0-b6a1-b6f955799317 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:23.955234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-08808c93-17a3-41f0-b6a1-b6f955799317 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:23.977620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-08808c93-17a3-41f0-b6a1-b6f955799317 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.286530 Sep 01 05:16:23.978788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 133/273] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:23 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:23.985168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d004c8a0-c44b-4cfc-8556-2e13b0cc2a98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "POST /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/action" status: 202 len: 0 microversion: 2.20 time: 0.439417 Sep 01 05:16:23.986198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 141/274] 10.222.0.49 () {62 vars in 1319 bytes} [Thu Sep 1 05:16:23 2022] POST /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:16:24.001947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9c82da1e-b9c5-44d8-b3ab-cf67cc934354 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:24.008098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9c82da1e-b9c5-44d8-b3ab-cf67cc934354 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:24.018990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:24.021624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c82da1e-b9c5-44d8-b3ab-cf67cc934354 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:24.022607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c82da1e-b9c5-44d8-b3ab-cf67cc934354 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:24.023877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c82da1e-b9c5-44d8-b3ab-cf67cc934354 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:24.025783 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c82da1e-b9c5-44d8-b3ab-cf67cc934354 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:24.027029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c82da1e-b9c5-44d8-b3ab-cf67cc934354 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:24.027652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c82da1e-b9c5-44d8-b3ab-cf67cc934354 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:24.231840 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9c82da1e-b9c5-44d8-b3ab-cf67cc934354 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:24.244046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9c82da1e-b9c5-44d8-b3ab-cf67cc934354 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:24.245864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9c82da1e-b9c5-44d8-b3ab-cf67cc934354 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:24.247038 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9c82da1e-b9c5-44d8-b3ab-cf67cc934354 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.253943 Sep 01 05:16:24.248374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 134/275] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:25.005358 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ca2b068b-b0fa-4f4d-8ac3-49302c87d063 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:25.006809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ca2b068b-b0fa-4f4d-8ac3-49302c87d063 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:25.023722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca2b068b-b0fa-4f4d-8ac3-49302c87d063 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:25.024222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca2b068b-b0fa-4f4d-8ac3-49302c87d063 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:25.028728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca2b068b-b0fa-4f4d-8ac3-49302c87d063 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:25.030706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca2b068b-b0fa-4f4d-8ac3-49302c87d063 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:25.032268 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca2b068b-b0fa-4f4d-8ac3-49302c87d063 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:25.034294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca2b068b-b0fa-4f4d-8ac3-49302c87d063 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:25.115845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:25.276720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0562fa01-fb0f-4fbf-92ba-f6d3c043249f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:25.277297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0562fa01-fb0f-4fbf-92ba-f6d3c043249f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:25.290877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0562fa01-fb0f-4fbf-92ba-f6d3c043249f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:25.291366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0562fa01-fb0f-4fbf-92ba-f6d3c043249f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:25.291830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0562fa01-fb0f-4fbf-92ba-f6d3c043249f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:25.297921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0562fa01-fb0f-4fbf-92ba-f6d3c043249f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:25.298552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0562fa01-fb0f-4fbf-92ba-f6d3c043249f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:25.299164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0562fa01-fb0f-4fbf-92ba-f6d3c043249f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:25.309226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ca2b068b-b0fa-4f4d-8ac3-49302c87d063 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:25.320521 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ca2b068b-b0fa-4f4d-8ac3-49302c87d063 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.324552 Sep 01 05:16:25.321236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 142/276] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:24 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:25.629921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0562fa01-fb0f-4fbf-92ba-f6d3c043249f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:25.647938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0562fa01-fb0f-4fbf-92ba-f6d3c043249f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:25.650201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0562fa01-fb0f-4fbf-92ba-f6d3c043249f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:25.657109 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0562fa01-fb0f-4fbf-92ba-f6d3c043249f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.385341 Sep 01 05:16:25.679359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 135/277] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:26.346883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ec33d67e-384a-4d18-8343-08a663d5f257 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:26.348270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ec33d67e-384a-4d18-8343-08a663d5f257 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:26.358579 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec33d67e-384a-4d18-8343-08a663d5f257 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:26.359556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec33d67e-384a-4d18-8343-08a663d5f257 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:26.361019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec33d67e-384a-4d18-8343-08a663d5f257 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:26.362841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec33d67e-384a-4d18-8343-08a663d5f257 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:26.364510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec33d67e-384a-4d18-8343-08a663d5f257 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:26.366129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec33d67e-384a-4d18-8343-08a663d5f257 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:26.589950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ec33d67e-384a-4d18-8343-08a663d5f257 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:26.605098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ec33d67e-384a-4d18-8343-08a663d5f257 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.263116 Sep 01 05:16:26.616309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 143/278] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:26 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:26.690828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3ea86d58-c71f-4529-92eb-d9772e356a2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:26.691466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3ea86d58-c71f-4529-92eb-d9772e356a2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:26.705363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ea86d58-c71f-4529-92eb-d9772e356a2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:26.705363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ea86d58-c71f-4529-92eb-d9772e356a2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:26.705363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ea86d58-c71f-4529-92eb-d9772e356a2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:26.705363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ea86d58-c71f-4529-92eb-d9772e356a2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:26.706028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ea86d58-c71f-4529-92eb-d9772e356a2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:26.706028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ea86d58-c71f-4529-92eb-d9772e356a2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:26.937746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3ea86d58-c71f-4529-92eb-d9772e356a2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:26.950966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3ea86d58-c71f-4529-92eb-d9772e356a2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:26.953090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3ea86d58-c71f-4529-92eb-d9772e356a2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:26.955235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3ea86d58-c71f-4529-92eb-d9772e356a2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.269851 Sep 01 05:16:26.969842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 136/279] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:27.641129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-07dfdd89-725e-4975-818a-494e04d086cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:27.642384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-07dfdd89-725e-4975-818a-494e04d086cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:27.650263 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07dfdd89-725e-4975-818a-494e04d086cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:27.653964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07dfdd89-725e-4975-818a-494e04d086cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:27.654621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07dfdd89-725e-4975-818a-494e04d086cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:27.655754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07dfdd89-725e-4975-818a-494e04d086cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:27.657051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07dfdd89-725e-4975-818a-494e04d086cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:27.657853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07dfdd89-725e-4975-818a-494e04d086cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:27.870339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-07dfdd89-725e-4975-818a-494e04d086cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:27.881117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-07dfdd89-725e-4975-818a-494e04d086cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.244973 Sep 01 05:16:27.884019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 144/280] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:27 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:27.979937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-40ff5787-1ebd-4ffc-bdd1-7b1bb8583c46 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:27.980540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-40ff5787-1ebd-4ffc-bdd1-7b1bb8583c46 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:27.987313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40ff5787-1ebd-4ffc-bdd1-7b1bb8583c46 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:27.987796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40ff5787-1ebd-4ffc-bdd1-7b1bb8583c46 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:27.988219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40ff5787-1ebd-4ffc-bdd1-7b1bb8583c46 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:27.989473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40ff5787-1ebd-4ffc-bdd1-7b1bb8583c46 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:27.989908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40ff5787-1ebd-4ffc-bdd1-7b1bb8583c46 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:27.990318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40ff5787-1ebd-4ffc-bdd1-7b1bb8583c46 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:28.204073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40ff5787-1ebd-4ffc-bdd1-7b1bb8583c46 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:28.215532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40ff5787-1ebd-4ffc-bdd1-7b1bb8583c46 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:28.217398 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40ff5787-1ebd-4ffc-bdd1-7b1bb8583c46 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:28.219518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-40ff5787-1ebd-4ffc-bdd1-7b1bb8583c46 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.243553 Sep 01 05:16:28.220075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 137/281] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:27 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:28.904606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8ebee5e0-91ce-49e4-9ef7-279ebbd32872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:28.905256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8ebee5e0-91ce-49e4-9ef7-279ebbd32872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:28.911682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ebee5e0-91ce-49e4-9ef7-279ebbd32872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:28.912151 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ebee5e0-91ce-49e4-9ef7-279ebbd32872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:28.912580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ebee5e0-91ce-49e4-9ef7-279ebbd32872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:28.913282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ebee5e0-91ce-49e4-9ef7-279ebbd32872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:28.913728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ebee5e0-91ce-49e4-9ef7-279ebbd32872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:28.914146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ebee5e0-91ce-49e4-9ef7-279ebbd32872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:29.064325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8ebee5e0-91ce-49e4-9ef7-279ebbd32872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:29.081041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8ebee5e0-91ce-49e4-9ef7-279ebbd32872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.180091 Sep 01 05:16:29.081847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 145/282] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:28 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:29.247530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f475d2ad-097a-492d-beb3-0baccff026d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:29.248133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f475d2ad-097a-492d-beb3-0baccff026d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:29.255031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f475d2ad-097a-492d-beb3-0baccff026d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:29.255508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f475d2ad-097a-492d-beb3-0baccff026d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:29.255929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f475d2ad-097a-492d-beb3-0baccff026d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:29.256610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f475d2ad-097a-492d-beb3-0baccff026d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:29.257100 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f475d2ad-097a-492d-beb3-0baccff026d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:29.257513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f475d2ad-097a-492d-beb3-0baccff026d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:29.411947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f475d2ad-097a-492d-beb3-0baccff026d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:29.420508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f475d2ad-097a-492d-beb3-0baccff026d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:29.422101 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f475d2ad-097a-492d-beb3-0baccff026d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:29.423327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f475d2ad-097a-492d-beb3-0baccff026d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.179730 Sep 01 05:16:29.423959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 138/283] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:29 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:30.104265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4fa1c775-eb23-4bb1-85d6-c5e34a38b61c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:30.104888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4fa1c775-eb23-4bb1-85d6-c5e34a38b61c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:30.111801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4fa1c775-eb23-4bb1-85d6-c5e34a38b61c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:30.112370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4fa1c775-eb23-4bb1-85d6-c5e34a38b61c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:30.112811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4fa1c775-eb23-4bb1-85d6-c5e34a38b61c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:30.113554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4fa1c775-eb23-4bb1-85d6-c5e34a38b61c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:30.114034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4fa1c775-eb23-4bb1-85d6-c5e34a38b61c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:30.114452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4fa1c775-eb23-4bb1-85d6-c5e34a38b61c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:30.368298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4fa1c775-eb23-4bb1-85d6-c5e34a38b61c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:30.386801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4fa1c775-eb23-4bb1-85d6-c5e34a38b61c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.286252 Sep 01 05:16:30.389502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 146/284] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:30 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:30.463778 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ca8b9925-24c6-45ab-853c-72826cff4fd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:30.464822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ca8b9925-24c6-45ab-853c-72826cff4fd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:30.479026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ca8b9925-24c6-45ab-853c-72826cff4fd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:30.481770 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ca8b9925-24c6-45ab-853c-72826cff4fd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:30.483700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ca8b9925-24c6-45ab-853c-72826cff4fd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:30.484578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ca8b9925-24c6-45ab-853c-72826cff4fd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:30.487291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ca8b9925-24c6-45ab-853c-72826cff4fd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:30.487927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ca8b9925-24c6-45ab-853c-72826cff4fd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:30.633710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ca8b9925-24c6-45ab-853c-72826cff4fd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:30.643762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ca8b9925-24c6-45ab-853c-72826cff4fd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:30.646150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ca8b9925-24c6-45ab-853c-72826cff4fd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:30.647941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ca8b9925-24c6-45ab-853c-72826cff4fd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.193566 Sep 01 05:16:30.648714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 139/285] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:30 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:16:31.419557 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b5378953-6820-45f5-bd78-0e98b4636ced tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:31.420335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b5378953-6820-45f5-bd78-0e98b4636ced tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:31.430737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5378953-6820-45f5-bd78-0e98b4636ced tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:31.432325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5378953-6820-45f5-bd78-0e98b4636ced tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:31.434723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5378953-6820-45f5-bd78-0e98b4636ced tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:31.437436 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5378953-6820-45f5-bd78-0e98b4636ced tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:31.438559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5378953-6820-45f5-bd78-0e98b4636ced tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:31.441146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5378953-6820-45f5-bd78-0e98b4636ced tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:31.673397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5af98c0e-8fa0-451a-b0b1-355c641f2986 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:31.674508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5af98c0e-8fa0-451a-b0b1-355c641f2986 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:31.691497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5af98c0e-8fa0-451a-b0b1-355c641f2986 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:31.692108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5af98c0e-8fa0-451a-b0b1-355c641f2986 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:31.698166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5af98c0e-8fa0-451a-b0b1-355c641f2986 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:31.699679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5af98c0e-8fa0-451a-b0b1-355c641f2986 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:31.712078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5af98c0e-8fa0-451a-b0b1-355c641f2986 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:31.712849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5af98c0e-8fa0-451a-b0b1-355c641f2986 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:31.848556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b5378953-6820-45f5-bd78-0e98b4636ced tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:31.860143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b5378953-6820-45f5-bd78-0e98b4636ced tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.445162 Sep 01 05:16:31.861002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 147/286] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:31 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:31.981277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5af98c0e-8fa0-451a-b0b1-355c641f2986 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:31.990147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5af98c0e-8fa0-451a-b0b1-355c641f2986 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:31.991823 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5af98c0e-8fa0-451a-b0b1-355c641f2986 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:31.993036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5af98c0e-8fa0-451a-b0b1-355c641f2986 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.323552 Sep 01 05:16:31.993594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 140/287] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:32.882240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e4e74c6c-d7b8-4077-91a6-fb71799d8bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:32.882903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e4e74c6c-d7b8-4077-91a6-fb71799d8bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:32.889287 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4e74c6c-d7b8-4077-91a6-fb71799d8bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:32.889999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4e74c6c-d7b8-4077-91a6-fb71799d8bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:32.890443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4e74c6c-d7b8-4077-91a6-fb71799d8bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:32.891145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4e74c6c-d7b8-4077-91a6-fb71799d8bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:32.891596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4e74c6c-d7b8-4077-91a6-fb71799d8bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:32.892021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4e74c6c-d7b8-4077-91a6-fb71799d8bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:33.020321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-34453ba1-66fc-47a0-939d-2fb3c87f89f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:33.021163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-34453ba1-66fc-47a0-939d-2fb3c87f89f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:33.031962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34453ba1-66fc-47a0-939d-2fb3c87f89f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:33.032667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34453ba1-66fc-47a0-939d-2fb3c87f89f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:33.033338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34453ba1-66fc-47a0-939d-2fb3c87f89f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:33.034359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34453ba1-66fc-47a0-939d-2fb3c87f89f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:33.034807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34453ba1-66fc-47a0-939d-2fb3c87f89f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:33.035942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34453ba1-66fc-47a0-939d-2fb3c87f89f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:33.062800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e4e74c6c-d7b8-4077-91a6-fb71799d8bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:33.073145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e4e74c6c-d7b8-4077-91a6-fb71799d8bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.194996 Sep 01 05:16:33.073749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 148/288] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:32 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:33.194960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-34453ba1-66fc-47a0-939d-2fb3c87f89f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:33.208280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-34453ba1-66fc-47a0-939d-2fb3c87f89f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:33.210453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-34453ba1-66fc-47a0-939d-2fb3c87f89f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:33.212233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-34453ba1-66fc-47a0-939d-2fb3c87f89f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.198221 Sep 01 05:16:33.212850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 141/289] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:16:34.100556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-569533eb-1275-4842-afb6-ff04db8bff8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:34.101805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-569533eb-1275-4842-afb6-ff04db8bff8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:34.115674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-569533eb-1275-4842-afb6-ff04db8bff8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:34.116180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-569533eb-1275-4842-afb6-ff04db8bff8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:34.116627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-569533eb-1275-4842-afb6-ff04db8bff8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:34.119155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-569533eb-1275-4842-afb6-ff04db8bff8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:34.119629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-569533eb-1275-4842-afb6-ff04db8bff8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:34.120058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-569533eb-1275-4842-afb6-ff04db8bff8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:34.237400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-44ff099f-4d08-4023-a868-e19109451938 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:34.238005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-44ff099f-4d08-4023-a868-e19109451938 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:34.252500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44ff099f-4d08-4023-a868-e19109451938 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:34.253517 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44ff099f-4d08-4023-a868-e19109451938 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:34.254829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44ff099f-4d08-4023-a868-e19109451938 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:34.256215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44ff099f-4d08-4023-a868-e19109451938 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:34.257630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44ff099f-4d08-4023-a868-e19109451938 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:34.258190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44ff099f-4d08-4023-a868-e19109451938 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:34.415786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-569533eb-1275-4842-afb6-ff04db8bff8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:34.426569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-569533eb-1275-4842-afb6-ff04db8bff8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1501 microversion: 2.1 time: 0.334354 Sep 01 05:16:34.427070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 149/290] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:34 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1501 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:34.449785 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ba188031-4d73-4e2d-ba2c-0f43095be7bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf78b485-b033-44df-802b-00f886ec8b26"}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:34.452246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ba188031-4d73-4e2d-ba2c-0f43095be7bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:34.464356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ba188031-4d73-4e2d-ba2c-0f43095be7bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:34.466382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ba188031-4d73-4e2d-ba2c-0f43095be7bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:34.468143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ba188031-4d73-4e2d-ba2c-0f43095be7bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:34.470427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ba188031-4d73-4e2d-ba2c-0f43095be7bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:34.471569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ba188031-4d73-4e2d-ba2c-0f43095be7bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:34.473955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ba188031-4d73-4e2d-ba2c-0f43095be7bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:34.498251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-44ff099f-4d08-4023-a868-e19109451938 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:34.509382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-44ff099f-4d08-4023-a868-e19109451938 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:34.511355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-44ff099f-4d08-4023-a868-e19109451938 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:34.512936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-44ff099f-4d08-4023-a868-e19109451938 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.281209 Sep 01 05:16:34.513812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 142/291] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:16:34.518879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-ba188031-4d73-4e2d-ba2c-0f43095be7bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] HTTP exception thrown: Cannot 'attach_volume' instance f9edb178-d264-4269-ae85-e2b524170b64 while it is in vm_state rescued Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ba188031-4d73-4e2d-ba2c-0f43095be7bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Request method failure captured: Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: POST /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64/os-volume_attachments HTTP/1.1 Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 74 Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED-3P2h09WzcNHsGu6ok1mj_IMYhqwx77kTgJsKM0gitT6TGjia6EkCndZLHg6xT83N873XLrlpv904xagMSkAmG1Zlxdul2gZ0FhgmaVCEFjcM_TONUvBFrLS_aZBFF8UKoy-4CcOUw9raG-n_hPk892NrcDNscsLrDlZUglZi8whI Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: db6e336d82254a9bafb2443958923d3d Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1376693752 Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:16:34.521215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:16:34.522611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_db6e336d82254a9bafb2443958923d3d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/db6e336d82254a9bafb2443958923d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/db6e336d82254a9bafb2443958923d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/db6e336d82254a9bafb2443958923d3d"}]}] Sep 01 05:16:34.522611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1376693752 Sep 01 05:16:34.522611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: db6e336d82254a9bafb2443958923d3d Sep 01 05:16:34.522611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1376693752 Sep 01 05:16:34.522611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-ServerRescueNegativeTestJSON-1376693752-project Sep 01 05:16:34.522611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:16:34.522611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:16:34.522611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 3f7ca41b422f45a0a62af9fba781a796 Sep 01 05:16:34.522611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1376693752-project Sep 01 05:16:34.522611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Sep 01 05:16:34.522611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {"volumeAttachment": {"volumeId": "cf78b485-b033-44df-802b-00f886ec8b26"}} Sep 01 05:16:34.522611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Cannot 'attach_volume' instance f9edb178-d264-4269-ae85-e2b524170b64 while it is in vm_state rescued Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'server_id': 'f9edb178-d264-4269-ae85-e2b524170b64', 'body': {'volumeAttachment': {'volumeId': 'cf78b485-b033-44df-802b-00f886ec8b26'}}} Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f9edb178-d264-4269-ae85-e2b524170b64 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:16:34.523328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f9edb178-d264-4269-ae85-e2b524170b64 while it is in vm_state rescued Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:16:34.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:16:34.525563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:16:34.525563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:16:34.525563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f9edb178-d264-4269-ae85-e2b524170b64 while it is in vm_state rescued Sep 01 05:16:34.525563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:16:34.527255 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ba188031-4d73-4e2d-ba2c-0f43095be7bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Returning 409 to user: Cannot 'attach_volume' instance f9edb178-d264-4269-ae85-e2b524170b64 while it is in vm_state rescued {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:16:34.531571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ba188031-4d73-4e2d-ba2c-0f43095be7bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "POST /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.086361 Sep 01 05:16:34.532367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 150/292] 10.222.0.49 () {60 vars in 1323 bytes} [Thu Sep 1 05:16:34 2022] POST /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64/os-volume_attachments => generated 152 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:16:34.542282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dad1b91e-a1f8-4880-9575-bee1effc20b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:34.543194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dad1b91e-a1f8-4880-9575-bee1effc20b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:34.550280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dad1b91e-a1f8-4880-9575-bee1effc20b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:34.551290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dad1b91e-a1f8-4880-9575-bee1effc20b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:34.552065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dad1b91e-a1f8-4880-9575-bee1effc20b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:34.552816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dad1b91e-a1f8-4880-9575-bee1effc20b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:34.553359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dad1b91e-a1f8-4880-9575-bee1effc20b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:34.553751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dad1b91e-a1f8-4880-9575-bee1effc20b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:34.635459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dad1b91e-a1f8-4880-9575-bee1effc20b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "POST /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64/action" status: 202 len: 0 microversion: 2.1 time: 0.098063 Sep 01 05:16:34.639217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 143/293] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:16:34 2022] POST /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:16:34.646467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d6be7a3a-1325-4604-a100-1ec189ab7451 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:34.647449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d6be7a3a-1325-4604-a100-1ec189ab7451 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:34.655000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6be7a3a-1325-4604-a100-1ec189ab7451 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:34.655942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6be7a3a-1325-4604-a100-1ec189ab7451 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:34.656581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6be7a3a-1325-4604-a100-1ec189ab7451 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:34.657532 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6be7a3a-1325-4604-a100-1ec189ab7451 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:34.658126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6be7a3a-1325-4604-a100-1ec189ab7451 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:34.658762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6be7a3a-1325-4604-a100-1ec189ab7451 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:34.833897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d6be7a3a-1325-4604-a100-1ec189ab7451 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:34.843321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d6be7a3a-1325-4604-a100-1ec189ab7451 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1509 microversion: 2.1 time: 0.202684 Sep 01 05:16:34.857558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 151/294] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:34 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:35.546883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e3c5046b-1c19-42a1-b455-90962e23b60e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:35.549307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e3c5046b-1c19-42a1-b455-90962e23b60e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:35.574888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3c5046b-1c19-42a1-b455-90962e23b60e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:35.578789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3c5046b-1c19-42a1-b455-90962e23b60e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:35.588115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3c5046b-1c19-42a1-b455-90962e23b60e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:35.591171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3c5046b-1c19-42a1-b455-90962e23b60e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:35.594736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3c5046b-1c19-42a1-b455-90962e23b60e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:35.598084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3c5046b-1c19-42a1-b455-90962e23b60e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:35.821687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e3c5046b-1c19-42a1-b455-90962e23b60e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:35.834405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e3c5046b-1c19-42a1-b455-90962e23b60e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:35.837385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e3c5046b-1c19-42a1-b455-90962e23b60e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:35.839408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e3c5046b-1c19-42a1-b455-90962e23b60e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.304984 Sep 01 05:16:35.840184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 144/295] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:35.866141 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-70f6f50e-da72-49fd-a284-0e02f0eaad05 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:35.866742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-70f6f50e-da72-49fd-a284-0e02f0eaad05 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:35.880422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70f6f50e-da72-49fd-a284-0e02f0eaad05 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:35.881447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70f6f50e-da72-49fd-a284-0e02f0eaad05 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:35.882610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70f6f50e-da72-49fd-a284-0e02f0eaad05 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:35.885038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70f6f50e-da72-49fd-a284-0e02f0eaad05 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:35.886980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70f6f50e-da72-49fd-a284-0e02f0eaad05 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:35.887944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70f6f50e-da72-49fd-a284-0e02f0eaad05 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:36.199328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-70f6f50e-da72-49fd-a284-0e02f0eaad05 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:36.212265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-70f6f50e-da72-49fd-a284-0e02f0eaad05 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1509 microversion: 2.1 time: 0.350085 Sep 01 05:16:36.212994 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 152/296] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:35 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1509 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:36.721624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-704738026", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:36.863987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5cc7e55c-2645-448b-be2d-898982c904b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:36.864598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5cc7e55c-2645-448b-be2d-898982c904b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:36.871992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cc7e55c-2645-448b-be2d-898982c904b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:36.872721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cc7e55c-2645-448b-be2d-898982c904b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:36.872940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cc7e55c-2645-448b-be2d-898982c904b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:36.873641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cc7e55c-2645-448b-be2d-898982c904b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:36.874267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cc7e55c-2645-448b-be2d-898982c904b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:36.874859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cc7e55c-2645-448b-be2d-898982c904b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:37.057673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5cc7e55c-2645-448b-be2d-898982c904b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:37.085818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5cc7e55c-2645-448b-be2d-898982c904b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:37.088664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5cc7e55c-2645-448b-be2d-898982c904b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:37.090321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5cc7e55c-2645-448b-be2d-898982c904b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.230621 Sep 01 05:16:37.091413 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 153/297] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:37.242000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2e2bfe33-2fed-4dfb-bdd2-46e9020d2730 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:37.242736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2e2bfe33-2fed-4dfb-bdd2-46e9020d2730 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:37.254399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e2bfe33-2fed-4dfb-bdd2-46e9020d2730 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:37.254854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e2bfe33-2fed-4dfb-bdd2-46e9020d2730 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:37.255575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e2bfe33-2fed-4dfb-bdd2-46e9020d2730 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:37.256518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e2bfe33-2fed-4dfb-bdd2-46e9020d2730 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:37.258067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e2bfe33-2fed-4dfb-bdd2-46e9020d2730 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:37.259257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e2bfe33-2fed-4dfb-bdd2-46e9020d2730 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:37.524726 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2e2bfe33-2fed-4dfb-bdd2-46e9020d2730 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:37.535117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2e2bfe33-2fed-4dfb-bdd2-46e9020d2730 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1509 microversion: 2.1 time: 0.301814 Sep 01 05:16:37.536485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 154/298] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:37 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1509 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:38.119138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ded53585-f77c-4c46-9142-e8a66300610f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:38.120028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ded53585-f77c-4c46-9142-e8a66300610f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:38.126644 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ded53585-f77c-4c46-9142-e8a66300610f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:38.127246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ded53585-f77c-4c46-9142-e8a66300610f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:38.127800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ded53585-f77c-4c46-9142-e8a66300610f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:38.128596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ded53585-f77c-4c46-9142-e8a66300610f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:38.130414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ded53585-f77c-4c46-9142-e8a66300610f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:38.131152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ded53585-f77c-4c46-9142-e8a66300610f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:38.469344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ded53585-f77c-4c46-9142-e8a66300610f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:38.481874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ded53585-f77c-4c46-9142-e8a66300610f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:38.483525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ded53585-f77c-4c46-9142-e8a66300610f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:38.484618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ded53585-f77c-4c46-9142-e8a66300610f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.369678 Sep 01 05:16:38.485737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 155/299] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:38 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:16:38.559730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0f2f7cfe-b737-4538-9fb2-6f4b0e472a41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:38.560339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0f2f7cfe-b737-4538-9fb2-6f4b0e472a41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:38.566234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f2f7cfe-b737-4538-9fb2-6f4b0e472a41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:38.567431 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f2f7cfe-b737-4538-9fb2-6f4b0e472a41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:38.567950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f2f7cfe-b737-4538-9fb2-6f4b0e472a41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:38.568659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f2f7cfe-b737-4538-9fb2-6f4b0e472a41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:38.569105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f2f7cfe-b737-4538-9fb2-6f4b0e472a41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:38.569526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f2f7cfe-b737-4538-9fb2-6f4b0e472a41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:38.727353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0f2f7cfe-b737-4538-9fb2-6f4b0e472a41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:38.737091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0f2f7cfe-b737-4538-9fb2-6f4b0e472a41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1515 microversion: 2.1 time: 0.181368 Sep 01 05:16:38.737658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 156/300] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:38 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:39.508667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-12994995-6341-4e18-9566-f45058036908 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:39.509370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-12994995-6341-4e18-9566-f45058036908 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:39.528095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-12994995-6341-4e18-9566-f45058036908 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:39.528734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-12994995-6341-4e18-9566-f45058036908 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:39.529270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-12994995-6341-4e18-9566-f45058036908 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:39.530211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-12994995-6341-4e18-9566-f45058036908 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:39.530795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-12994995-6341-4e18-9566-f45058036908 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:39.531379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-12994995-6341-4e18-9566-f45058036908 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:39.694721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-12994995-6341-4e18-9566-f45058036908 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:39.704975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-12994995-6341-4e18-9566-f45058036908 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:39.707540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-12994995-6341-4e18-9566-f45058036908 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:39.709414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-12994995-6341-4e18-9566-f45058036908 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.204568 Sep 01 05:16:39.710195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 157/301] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:39 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:16:39.725898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f8443acc-6332-4322-a3cd-8c754d6ab84c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:39.726864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f8443acc-6332-4322-a3cd-8c754d6ab84c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:39.734408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8443acc-6332-4322-a3cd-8c754d6ab84c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:39.735126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8443acc-6332-4322-a3cd-8c754d6ab84c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:39.735961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8443acc-6332-4322-a3cd-8c754d6ab84c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:39.736824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8443acc-6332-4322-a3cd-8c754d6ab84c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:39.737478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8443acc-6332-4322-a3cd-8c754d6ab84c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:39.738006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8443acc-6332-4322-a3cd-8c754d6ab84c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:39.776183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f8443acc-6332-4322-a3cd-8c754d6ab84c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/ips" status: 200 len: 147 microversion: 2.1 time: 0.064714 Sep 01 05:16:39.777742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 158/302] 10.222.0.49 () {58 vars in 1248 bytes} [Thu Sep 1 05:16:39 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/ips => generated 147 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:40.312508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-22f7aee7-35fd-4448-b630-bd9ce9410926 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Action: 'create', calling method: .version_select at 0x7f9624d97e50>, body: {"keypair": {"name": "tempest-keypair-1464602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2vTaxmzKIPdMDe9ZSlwOk+x9QSbYorNQz59E40TJFgwTdxcGUlUh9WX8zrWd/ch0prMARpm2b6nuTTX56SM/8b/TOdmtbXxsIJPhur1htmkMB9H+vUMQABhg+OR7WhCw=="}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:40.330522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-22f7aee7-35fd-4448-b630-bd9ce9410926 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Getting quotas for project db6e336d82254a9bafb2443958923d3d. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:16:40.335113 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-22f7aee7-35fd-4448-b630-bd9ce9410926 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Getting quotas for user 3f7ca41b422f45a0a62af9fba781a796 and project db6e336d82254a9bafb2443958923d3d. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:16:40.369513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-22f7aee7-35fd-4448-b630-bd9ce9410926 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.060564 Sep 01 05:16:40.371083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 159/303] 10.222.0.49 () {60 vars in 1159 bytes} [Thu Sep 1 05:16:40 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:16:40.736110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b328f963-4ec5-40cf-b15a-ca7375c3bf29 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:40.736920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b328f963-4ec5-40cf-b15a-ca7375c3bf29 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:40.744884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b328f963-4ec5-40cf-b15a-ca7375c3bf29 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:40.746858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b328f963-4ec5-40cf-b15a-ca7375c3bf29 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:40.747474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b328f963-4ec5-40cf-b15a-ca7375c3bf29 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:40.748458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b328f963-4ec5-40cf-b15a-ca7375c3bf29 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:40.749291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b328f963-4ec5-40cf-b15a-ca7375c3bf29 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:40.750074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b328f963-4ec5-40cf-b15a-ca7375c3bf29 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:41.014748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b328f963-4ec5-40cf-b15a-ca7375c3bf29 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:41.020022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:41.036026 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b328f963-4ec5-40cf-b15a-ca7375c3bf29 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:41.038476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b328f963-4ec5-40cf-b15a-ca7375c3bf29 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:41.040717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b328f963-4ec5-40cf-b15a-ca7375c3bf29 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.308186 Sep 01 05:16:41.041354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 160/304] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:16:42.068412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cbcdd247-cf54-4a94-967a-59e1818fe744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:42.069294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cbcdd247-cf54-4a94-967a-59e1818fe744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:42.080915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbcdd247-cf54-4a94-967a-59e1818fe744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:42.086660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbcdd247-cf54-4a94-967a-59e1818fe744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:42.087250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbcdd247-cf54-4a94-967a-59e1818fe744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:42.088340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbcdd247-cf54-4a94-967a-59e1818fe744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:42.088986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbcdd247-cf54-4a94-967a-59e1818fe744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:42.089578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbcdd247-cf54-4a94-967a-59e1818fe744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:42.317484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cbcdd247-cf54-4a94-967a-59e1818fe744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:42.327383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cbcdd247-cf54-4a94-967a-59e1818fe744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:42.329291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cbcdd247-cf54-4a94-967a-59e1818fe744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:42.330926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cbcdd247-cf54-4a94-967a-59e1818fe744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1723 microversion: 2.20 time: 0.267152 Sep 01 05:16:42.345599 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 161/305] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:16:42.480095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dab9f902-493c-4492-be1b-f51e0438d001 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "318706e9-5beb-451f-9a13-083b4780610a"}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:42.483960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dab9f902-493c-4492-be1b-f51e0438d001 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:42.493632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dab9f902-493c-4492-be1b-f51e0438d001 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:42.494477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dab9f902-493c-4492-be1b-f51e0438d001 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:42.495132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dab9f902-493c-4492-be1b-f51e0438d001 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:42.496068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dab9f902-493c-4492-be1b-f51e0438d001 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:42.496754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dab9f902-493c-4492-be1b-f51e0438d001 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:42.497500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dab9f902-493c-4492-be1b-f51e0438d001 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:43.053907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dab9f902-493c-4492-be1b-f51e0438d001 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "POST /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578342 Sep 01 05:16:43.058393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 162/306] 10.222.0.49 () {60 vars in 1323 bytes} [Thu Sep 1 05:16:42 2022] POST /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:43.076204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1870308401", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1b53602-ae6c-4f58-9a76-532a80bdb8eb"}], "security_groups": [{"name": "tempest-securitygroup--869029759"}], "key_name": "tempest-keypair-1464602", "user_data": "}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:45.827847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:46.733480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=23 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:48.083503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.network.neutron [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] validate_networks() for None {{(pid=120673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:16:48.194496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.network.neutron [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] validate_networks() for [('d1b53602-ae6c-4f58-9a76-532a80bdb8eb', None, None, None, None, None)] {{(pid=120674) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:16:48.600352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:48.669181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Flavor limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:16:48.669816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Image limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:16:48.670467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Flavor pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:16:48.671022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Image pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:16:48.671804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:16:48.696619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:48.697451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:48.698081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:48.698993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:48.699597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:48.700167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:48.760588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Getting quotas for project 2ad0860664064d458e631a81012ea795. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:16:48.774758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Getting quotas for user 63fda68a44cc4d3fafe47efeae45b015 and project 2ad0860664064d458e631a81012ea795. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:16:48.797449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Going to run 1 instances... {{(pid=120673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:16:48.805894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:16:48.886617 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-933e3526-f362-4203-9a06-968a405134fd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.168690 Sep 01 05:16:48.887906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 145/307] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:16:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 12171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:16:48.899739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-489959a9-1db2-4b6d-8a5e-4c2b54e8eeaa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:48.900396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-489959a9-1db2-4b6d-8a5e-4c2b54e8eeaa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:48.913462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-489959a9-1db2-4b6d-8a5e-4c2b54e8eeaa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:48.914289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-489959a9-1db2-4b6d-8a5e-4c2b54e8eeaa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:48.914978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-489959a9-1db2-4b6d-8a5e-4c2b54e8eeaa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:48.915882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-489959a9-1db2-4b6d-8a5e-4c2b54e8eeaa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:48.916477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-489959a9-1db2-4b6d-8a5e-4c2b54e8eeaa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:48.917103 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-489959a9-1db2-4b6d-8a5e-4c2b54e8eeaa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:49.008703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Flavor limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:16:49.009352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Image limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:16:49.010006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Flavor pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:16:49.010838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Image pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:16:49.011414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:16:49.027454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:49.030407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:49.033896 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:49.035418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:49.038261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:49.038899 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:49.071724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Getting quotas for project db6e336d82254a9bafb2443958923d3d. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:16:49.077878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Getting quotas for user 3f7ca41b422f45a0a62af9fba781a796 and project db6e336d82254a9bafb2443958923d3d. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:16:49.093534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Going to run 1 instances... {{(pid=120674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:16:49.096151 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:16:49.152380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-489959a9-1db2-4b6d-8a5e-4c2b54e8eeaa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:49.165538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-489959a9-1db2-4b6d-8a5e-4c2b54e8eeaa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:49.168328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-489959a9-1db2-4b6d-8a5e-4c2b54e8eeaa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:49.169827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-489959a9-1db2-4b6d-8a5e-4c2b54e8eeaa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.280018 Sep 01 05:16:49.170731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 146/308] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:49.179196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-767855246", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "networks": [{"uuid": "7c13e97d-6bf4-4984-8d9f-37700a278d04"}]}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:49.196935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8f57602c-6acc-4b44-9af0-91b2ab71ec98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 6.136642 Sep 01 05:16:49.199424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 163/309] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:16:43 2022] POST /compute/v2.1/servers => generated 408 bytes in 6140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:16:49.221704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-75637422-42eb-4a40-ac62-bfd89ebb2bd0 req-e5d1ceeb-6c9f-48be-b6a6-52a0ede30bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a582556-d184-4047-ac19-285c0edd2fdf", "name": "network-vif-plugged", "status": "completed", "tag": "6e571bd8-c64a-432f-894b-026d58cce109"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:49.289085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-75637422-42eb-4a40-ac62-bfd89ebb2bd0 req-e5d1ceeb-6c9f-48be-b6a6-52a0ede30bea service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:49.290329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-75637422-42eb-4a40-ac62-bfd89ebb2bd0 req-e5d1ceeb-6c9f-48be-b6a6-52a0ede30bea service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:49.291266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-75637422-42eb-4a40-ac62-bfd89ebb2bd0 req-e5d1ceeb-6c9f-48be-b6a6-52a0ede30bea service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:49.314935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-75637422-42eb-4a40-ac62-bfd89ebb2bd0 req-e5d1ceeb-6c9f-48be-b6a6-52a0ede30bea service nova] Creating event network-vif-plugged:6e571bd8-c64a-432f-894b-026d58cce109 for instance 2a582556-d184-4047-ac19-285c0edd2fdf on hv-cinder-85391 Sep 01 05:16:49.323022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-75637422-42eb-4a40-ac62-bfd89ebb2bd0 req-e5d1ceeb-6c9f-48be-b6a6-52a0ede30bea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121748 Sep 01 05:16:49.328056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 164/310] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:49.334557 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2059408a-9fdb-46a8-b09e-2a8cdb2f4dc9 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:49.335272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2059408a-9fdb-46a8-b09e-2a8cdb2f4dc9 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:49.477202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2059408a-9fdb-46a8-b09e-2a8cdb2f4dc9 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:49.489056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2059408a-9fdb-46a8-b09e-2a8cdb2f4dc9 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1214 microversion: 2.1 time: 0.156659 Sep 01 05:16:49.496243 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 165/311] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:49 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:49.515410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fe31c5b0-5d78-46f4-afb7-e2ed23101fb9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:49.516035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fe31c5b0-5d78-46f4-afb7-e2ed23101fb9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:49.746637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fe31c5b0-5d78-46f4-afb7-e2ed23101fb9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:49.758964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fe31c5b0-5d78-46f4-afb7-e2ed23101fb9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1243 microversion: 2.1 time: 0.259134 Sep 01 05:16:49.762730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 166/312] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:49 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1243 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:50.205570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9c31ea22-a798-4b8c-8534-b6e64370657e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:50.207257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9c31ea22-a798-4b8c-8534-b6e64370657e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:50.225127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c31ea22-a798-4b8c-8534-b6e64370657e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:50.225687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c31ea22-a798-4b8c-8534-b6e64370657e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:50.226137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c31ea22-a798-4b8c-8534-b6e64370657e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:50.226861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c31ea22-a798-4b8c-8534-b6e64370657e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:50.227483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c31ea22-a798-4b8c-8534-b6e64370657e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:50.240876 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c31ea22-a798-4b8c-8534-b6e64370657e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:50.581607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9c31ea22-a798-4b8c-8534-b6e64370657e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:50.613932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9c31ea22-a798-4b8c-8534-b6e64370657e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:50.615740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9c31ea22-a798-4b8c-8534-b6e64370657e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:50.618044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9c31ea22-a798-4b8c-8534-b6e64370657e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.420134 Sep 01 05:16:50.629338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 167/313] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:16:50.647533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3183a54a-2251-4ac2-9a26-e05aaebb2db5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:50.653748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3183a54a-2251-4ac2-9a26-e05aaebb2db5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:50.665186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3183a54a-2251-4ac2-9a26-e05aaebb2db5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:50.670895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3183a54a-2251-4ac2-9a26-e05aaebb2db5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:50.671949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3183a54a-2251-4ac2-9a26-e05aaebb2db5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:50.678376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3183a54a-2251-4ac2-9a26-e05aaebb2db5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:50.679145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3183a54a-2251-4ac2-9a26-e05aaebb2db5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:50.679759 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3183a54a-2251-4ac2-9a26-e05aaebb2db5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:50.826247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3183a54a-2251-4ac2-9a26-e05aaebb2db5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:50.839363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3183a54a-2251-4ac2-9a26-e05aaebb2db5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1266 microversion: 2.1 time: 0.201661 Sep 01 05:16:50.840288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 168/314] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:50 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:50.854162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ee7a3701-df69-4a27-b24d-5b4ac84cb7cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:50.854871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ee7a3701-df69-4a27-b24d-5b4ac84cb7cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:50.873628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee7a3701-df69-4a27-b24d-5b4ac84cb7cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:50.874381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee7a3701-df69-4a27-b24d-5b4ac84cb7cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:50.875059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee7a3701-df69-4a27-b24d-5b4ac84cb7cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:50.876168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee7a3701-df69-4a27-b24d-5b4ac84cb7cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:50.877080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee7a3701-df69-4a27-b24d-5b4ac84cb7cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:50.877681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee7a3701-df69-4a27-b24d-5b4ac84cb7cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:51.147596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ee7a3701-df69-4a27-b24d-5b4ac84cb7cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:51.163660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ee7a3701-df69-4a27-b24d-5b4ac84cb7cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1295 microversion: 2.1 time: 0.320342 Sep 01 05:16:51.176854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 169/315] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:50 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1295 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:51.176854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6b06f522-f8a3-4bfd-8a0e-b327c4e4af05 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:51.187211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b06f522-f8a3-4bfd-8a0e-b327c4e4af05 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:51.192559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b06f522-f8a3-4bfd-8a0e-b327c4e4af05 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:51.193174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b06f522-f8a3-4bfd-8a0e-b327c4e4af05 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:51.315068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6b06f522-f8a3-4bfd-8a0e-b327c4e4af05 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Going to try to stop instance {{(pid=120674) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:16:51.406919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6b06f522-f8a3-4bfd-8a0e-b327c4e4af05 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "POST /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/action" status: 202 len: 0 microversion: 2.1 time: 0.239657 Sep 01 05:16:51.407907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 170/316] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:16:51 2022] POST /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:16:51.418419 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-45b401fa-3f99-4af1-8426-a42e287b07ae tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:51.419414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-45b401fa-3f99-4af1-8426-a42e287b07ae tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:51.461503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b401fa-3f99-4af1-8426-a42e287b07ae tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:51.462313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b401fa-3f99-4af1-8426-a42e287b07ae tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:51.462917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b401fa-3f99-4af1-8426-a42e287b07ae tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:51.464411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b401fa-3f99-4af1-8426-a42e287b07ae tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:51.464411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b401fa-3f99-4af1-8426-a42e287b07ae tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:51.464881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b401fa-3f99-4af1-8426-a42e287b07ae tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:51.641762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-45b401fa-3f99-4af1-8426-a42e287b07ae tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:51.651556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-45b401fa-3f99-4af1-8426-a42e287b07ae tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.238685 Sep 01 05:16:51.667941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 171/317] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:51 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:51.689104 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-79f9db4d-e823-440a-a0ea-27005e54e94b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:51.691681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-79f9db4d-e823-440a-a0ea-27005e54e94b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:51.708809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-79f9db4d-e823-440a-a0ea-27005e54e94b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:51.711914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-79f9db4d-e823-440a-a0ea-27005e54e94b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:51.713815 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-79f9db4d-e823-440a-a0ea-27005e54e94b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:51.714804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-79f9db4d-e823-440a-a0ea-27005e54e94b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:51.715484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-79f9db4d-e823-440a-a0ea-27005e54e94b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:51.716138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-79f9db4d-e823-440a-a0ea-27005e54e94b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:52.022414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-79f9db4d-e823-440a-a0ea-27005e54e94b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:52.032074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-79f9db4d-e823-440a-a0ea-27005e54e94b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:52.034046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-79f9db4d-e823-440a-a0ea-27005e54e94b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:52.035658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-79f9db4d-e823-440a-a0ea-27005e54e94b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.365213 Sep 01 05:16:52.036409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 172/318] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:51 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:52.043129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-02b47657-ed4d-410b-b131-275267c395fe tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:52.043744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-02b47657-ed4d-410b-b131-275267c395fe tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:52.075423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02b47657-ed4d-410b-b131-275267c395fe tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:52.075939 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02b47657-ed4d-410b-b131-275267c395fe tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:52.076381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02b47657-ed4d-410b-b131-275267c395fe tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:52.083593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02b47657-ed4d-410b-b131-275267c395fe tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:52.084429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02b47657-ed4d-410b-b131-275267c395fe tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:52.084555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02b47657-ed4d-410b-b131-275267c395fe tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:52.273282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-02b47657-ed4d-410b-b131-275267c395fe tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:52.289622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-02b47657-ed4d-410b-b131-275267c395fe tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1284 microversion: 2.1 time: 0.251186 Sep 01 05:16:52.293086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 173/319] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:52 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:52.305980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-78c5ab2b-2673-4d93-b298-1bf0c094dc4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:52.308199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-78c5ab2b-2673-4d93-b298-1bf0c094dc4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:52.326637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78c5ab2b-2673-4d93-b298-1bf0c094dc4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:52.327300 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78c5ab2b-2673-4d93-b298-1bf0c094dc4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:52.327627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78c5ab2b-2673-4d93-b298-1bf0c094dc4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:52.328497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78c5ab2b-2673-4d93-b298-1bf0c094dc4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:52.328973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78c5ab2b-2673-4d93-b298-1bf0c094dc4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:52.331519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78c5ab2b-2673-4d93-b298-1bf0c094dc4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:52.459742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-78c5ab2b-2673-4d93-b298-1bf0c094dc4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:52.468389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-78c5ab2b-2673-4d93-b298-1bf0c094dc4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1301 microversion: 2.1 time: 0.174037 Sep 01 05:16:52.468988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 174/320] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1301 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:52.674721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-492bbaa2-a000-4681-91aa-28f382503b32 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:52.675219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-492bbaa2-a000-4681-91aa-28f382503b32 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:52.682169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-492bbaa2-a000-4681-91aa-28f382503b32 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:52.682655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-492bbaa2-a000-4681-91aa-28f382503b32 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:52.683085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-492bbaa2-a000-4681-91aa-28f382503b32 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:52.683777 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-492bbaa2-a000-4681-91aa-28f382503b32 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:52.684274 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-492bbaa2-a000-4681-91aa-28f382503b32 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:52.684694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-492bbaa2-a000-4681-91aa-28f382503b32 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:52.968913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-492bbaa2-a000-4681-91aa-28f382503b32 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:52.985210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-492bbaa2-a000-4681-91aa-28f382503b32 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.314845 Sep 01 05:16:52.986421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 175/321] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:52 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:53.021676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.network.neutron [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] validate_networks() for [('7c13e97d-6bf4-4984-8d9f-37700a278d04', None, None, None, None, None)] {{(pid=120673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:16:53.062471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0a91abad-8269-4f34-a6bb-573439958022 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:53.063667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0a91abad-8269-4f34-a6bb-573439958022 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:53.075006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a91abad-8269-4f34-a6bb-573439958022 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:53.075775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a91abad-8269-4f34-a6bb-573439958022 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:53.076384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a91abad-8269-4f34-a6bb-573439958022 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:53.077118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a91abad-8269-4f34-a6bb-573439958022 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:53.077716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a91abad-8269-4f34-a6bb-573439958022 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:53.078288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a91abad-8269-4f34-a6bb-573439958022 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:53.269726 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0a91abad-8269-4f34-a6bb-573439958022 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:53.283974 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0a91abad-8269-4f34-a6bb-573439958022 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:53.287049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0a91abad-8269-4f34-a6bb-573439958022 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:53.291921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0a91abad-8269-4f34-a6bb-573439958022 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.230494 Sep 01 05:16:53.293544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 176/322] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:16:53.323517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-844d5c3a-b086-4390-9ee5-03efb053c848 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:53.325264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-844d5c3a-b086-4390-9ee5-03efb053c848 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:53.333625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-844d5c3a-b086-4390-9ee5-03efb053c848 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:53.335547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-844d5c3a-b086-4390-9ee5-03efb053c848 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:53.336187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-844d5c3a-b086-4390-9ee5-03efb053c848 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:53.337242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-844d5c3a-b086-4390-9ee5-03efb053c848 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:53.337997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-844d5c3a-b086-4390-9ee5-03efb053c848 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:53.338672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-844d5c3a-b086-4390-9ee5-03efb053c848 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:53.423854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-844d5c3a-b086-4390-9ee5-03efb053c848 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:53.440545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-844d5c3a-b086-4390-9ee5-03efb053c848 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1272 microversion: 2.1 time: 0.123776 Sep 01 05:16:53.442013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 177/323] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:53 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:53.491490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-518f1fa4-f6ab-44aa-8f4e-8ce77e66b3a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:53.492314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-518f1fa4-f6ab-44aa-8f4e-8ce77e66b3a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:53.499963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-518f1fa4-f6ab-44aa-8f4e-8ce77e66b3a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:53.505703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-518f1fa4-f6ab-44aa-8f4e-8ce77e66b3a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:53.509167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-518f1fa4-f6ab-44aa-8f4e-8ce77e66b3a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:53.513475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-518f1fa4-f6ab-44aa-8f4e-8ce77e66b3a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:53.514165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-518f1fa4-f6ab-44aa-8f4e-8ce77e66b3a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:53.514847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-518f1fa4-f6ab-44aa-8f4e-8ce77e66b3a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:53.553400 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:53.611783 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-518f1fa4-f6ab-44aa-8f4e-8ce77e66b3a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:53.624108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-518f1fa4-f6ab-44aa-8f4e-8ce77e66b3a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1301 microversion: 2.1 time: 0.137003 Sep 01 05:16:53.625874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 178/324] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1301 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:53.994038 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Flavor limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:16:53.994468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Image limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:16:53.994966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Flavor pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:16:53.995337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Image pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:16:53.995749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:16:54.010598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5551ef1b-31b6-4e9b-9a3f-726d1480f598 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:54.011306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5551ef1b-31b6-4e9b-9a3f-726d1480f598 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:54.012190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:54.012685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:54.013154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:54.013888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:54.014340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:54.014768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:54.024549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5551ef1b-31b6-4e9b-9a3f-726d1480f598 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:54.025198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5551ef1b-31b6-4e9b-9a3f-726d1480f598 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:54.025704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5551ef1b-31b6-4e9b-9a3f-726d1480f598 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:54.026494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5551ef1b-31b6-4e9b-9a3f-726d1480f598 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:54.027012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5551ef1b-31b6-4e9b-9a3f-726d1480f598 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:54.027521 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5551ef1b-31b6-4e9b-9a3f-726d1480f598 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:54.084292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Getting quotas for project b5cc7e7b1b9f43a18651ab25d5c2b4ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:16:54.088788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Getting quotas for user 109c732f418442a9bf997fba70669fad and project b5cc7e7b1b9f43a18651ab25d5c2b4ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:16:54.126438 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Going to run 1 instances... {{(pid=120673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:16:54.128683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:16:54.243846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b55a96be-cc7a-433c-aaac-90dfef926496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.071637 Sep 01 05:16:54.250310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 147/325] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:16:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 5079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:16:54.257745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c19e85a2-a692-40e2-9eee-4b87776558df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:54.258370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c19e85a2-a692-40e2-9eee-4b87776558df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:54.355337 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5551ef1b-31b6-4e9b-9a3f-726d1480f598 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:54.370467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5551ef1b-31b6-4e9b-9a3f-726d1480f598 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.363662 Sep 01 05:16:54.371060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 179/326] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:54 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:54.391841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b5b296a2-3f45-4dce-a918-65c061b95361 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:54.401444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b5b296a2-3f45-4dce-a918-65c061b95361 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:54.415522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5b296a2-3f45-4dce-a918-65c061b95361 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:54.416023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5b296a2-3f45-4dce-a918-65c061b95361 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:54.427004 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5b296a2-3f45-4dce-a918-65c061b95361 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:54.427966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5b296a2-3f45-4dce-a918-65c061b95361 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:54.428668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5b296a2-3f45-4dce-a918-65c061b95361 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:54.429281 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5b296a2-3f45-4dce-a918-65c061b95361 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:54.705302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c19e85a2-a692-40e2-9eee-4b87776558df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:54.713408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c19e85a2-a692-40e2-9eee-4b87776558df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1218 microversion: 2.1 time: 0.461960 Sep 01 05:16:54.714312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 148/327] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:54 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1218 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:54.751492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c299bd0c-d473-4751-9f37-9815fb243f48 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:54.752160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c299bd0c-d473-4751-9f37-9815fb243f48 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:54.780084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c299bd0c-d473-4751-9f37-9815fb243f48 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:54.780691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c299bd0c-d473-4751-9f37-9815fb243f48 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:54.781325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c299bd0c-d473-4751-9f37-9815fb243f48 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:54.782392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c299bd0c-d473-4751-9f37-9815fb243f48 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:54.787527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c299bd0c-d473-4751-9f37-9815fb243f48 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:54.788321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c299bd0c-d473-4751-9f37-9815fb243f48 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:54.818771 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b5b296a2-3f45-4dce-a918-65c061b95361 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:54.846917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b5b296a2-3f45-4dce-a918-65c061b95361 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:54.857840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b5b296a2-3f45-4dce-a918-65c061b95361 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:54.864864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b5b296a2-3f45-4dce-a918-65c061b95361 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.477731 Sep 01 05:16:54.867342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 180/328] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:54.885338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-67e181e9-dddd-4551-ad57-824bca3d9910 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:54.885999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-67e181e9-dddd-4551-ad57-824bca3d9910 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:54.901717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67e181e9-dddd-4551-ad57-824bca3d9910 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:54.902712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67e181e9-dddd-4551-ad57-824bca3d9910 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:54.903507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67e181e9-dddd-4551-ad57-824bca3d9910 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:54.904409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67e181e9-dddd-4551-ad57-824bca3d9910 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:54.905055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67e181e9-dddd-4551-ad57-824bca3d9910 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:54.905636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67e181e9-dddd-4551-ad57-824bca3d9910 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:55.089437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-67e181e9-dddd-4551-ad57-824bca3d9910 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:55.100852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-67e181e9-dddd-4551-ad57-824bca3d9910 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.230965 Sep 01 05:16:55.115534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 181/329] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:55.152379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c299bd0c-d473-4751-9f37-9815fb243f48 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:55.171249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c299bd0c-d473-4751-9f37-9815fb243f48 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1314 microversion: 2.1 time: 0.431957 Sep 01 05:16:55.176909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 149/330] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:54 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:55.395994 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c18de901-c871-4a29-b3aa-d20f0030f78d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:55.397028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c18de901-c871-4a29-b3aa-d20f0030f78d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:55.421009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c18de901-c871-4a29-b3aa-d20f0030f78d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:55.422192 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c18de901-c871-4a29-b3aa-d20f0030f78d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:55.422824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c18de901-c871-4a29-b3aa-d20f0030f78d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:55.423776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c18de901-c871-4a29-b3aa-d20f0030f78d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:55.424423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c18de901-c871-4a29-b3aa-d20f0030f78d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:55.425056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c18de901-c871-4a29-b3aa-d20f0030f78d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:55.660225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c18de901-c871-4a29-b3aa-d20f0030f78d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:55.674036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c18de901-c871-4a29-b3aa-d20f0030f78d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.281656 Sep 01 05:16:55.687037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 182/331] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:55 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:55.735164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ae4d6330-fcc9-48c7-ba94-20dfe8dffe0e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:55.735974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ae4d6330-fcc9-48c7-ba94-20dfe8dffe0e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:55.744594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae4d6330-fcc9-48c7-ba94-20dfe8dffe0e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:55.745113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae4d6330-fcc9-48c7-ba94-20dfe8dffe0e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:55.745719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae4d6330-fcc9-48c7-ba94-20dfe8dffe0e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:55.746600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae4d6330-fcc9-48c7-ba94-20dfe8dffe0e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:55.747211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae4d6330-fcc9-48c7-ba94-20dfe8dffe0e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:55.747626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae4d6330-fcc9-48c7-ba94-20dfe8dffe0e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:55.844700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ae4d6330-fcc9-48c7-ba94-20dfe8dffe0e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:55.859043 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ae4d6330-fcc9-48c7-ba94-20dfe8dffe0e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1270 microversion: 2.1 time: 0.127624 Sep 01 05:16:55.859801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 150/332] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:55 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1270 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:55.892179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-22ceedad-9825-4126-a079-cb45f1bd0c50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:55.892952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-22ceedad-9825-4126-a079-cb45f1bd0c50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:55.901975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-22ceedad-9825-4126-a079-cb45f1bd0c50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:55.903165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-22ceedad-9825-4126-a079-cb45f1bd0c50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:55.905146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-22ceedad-9825-4126-a079-cb45f1bd0c50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:55.906445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-22ceedad-9825-4126-a079-cb45f1bd0c50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:55.908878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-22ceedad-9825-4126-a079-cb45f1bd0c50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:55.911069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-22ceedad-9825-4126-a079-cb45f1bd0c50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:56.123793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-22ceedad-9825-4126-a079-cb45f1bd0c50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:56.125625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7791c741-2060-4c56-ba53-a4e5b5693809 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:56.126272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7791c741-2060-4c56-ba53-a4e5b5693809 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:56.132478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-22ceedad-9825-4126-a079-cb45f1bd0c50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:56.133968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-22ceedad-9825-4126-a079-cb45f1bd0c50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:56.135425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-22ceedad-9825-4126-a079-cb45f1bd0c50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.248210 Sep 01 05:16:56.148882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7791c741-2060-4c56-ba53-a4e5b5693809 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:56.148882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7791c741-2060-4c56-ba53-a4e5b5693809 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:56.148882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7791c741-2060-4c56-ba53-a4e5b5693809 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:56.148882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7791c741-2060-4c56-ba53-a4e5b5693809 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:56.149308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7791c741-2060-4c56-ba53-a4e5b5693809 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:56.149308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7791c741-2060-4c56-ba53-a4e5b5693809 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:56.149982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 183/333] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:56.197665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6ed92893-6da0-4d53-b22a-eecb53f26a13 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:56.198284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6ed92893-6da0-4d53-b22a-eecb53f26a13 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:56.206304 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ed92893-6da0-4d53-b22a-eecb53f26a13 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:56.208186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ed92893-6da0-4d53-b22a-eecb53f26a13 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:56.208637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ed92893-6da0-4d53-b22a-eecb53f26a13 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:56.209390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ed92893-6da0-4d53-b22a-eecb53f26a13 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:56.209853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ed92893-6da0-4d53-b22a-eecb53f26a13 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:56.210282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ed92893-6da0-4d53-b22a-eecb53f26a13 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:56.366742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6ed92893-6da0-4d53-b22a-eecb53f26a13 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:56.376468 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6ed92893-6da0-4d53-b22a-eecb53f26a13 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1314 microversion: 2.1 time: 0.183003 Sep 01 05:16:56.377556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 184/334] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:56 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:56.437474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7791c741-2060-4c56-ba53-a4e5b5693809 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:56.448698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7791c741-2060-4c56-ba53-a4e5b5693809 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.329899 Sep 01 05:16:56.451068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 151/335] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:56.618161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-5922a677-c523-4ea4-a771-df397723e11b req-14c54034-bc3c-4354-b10c-26d82a8ac73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd99adb-f38e-4d43-82b1-529010509f72", "tag": "7ce60b54-510b-440d-9175-fd0f98028fab"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:56.643828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5922a677-c523-4ea4-a771-df397723e11b req-14c54034-bc3c-4354-b10c-26d82a8ac73d service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:56.645488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5922a677-c523-4ea4-a771-df397723e11b req-14c54034-bc3c-4354-b10c-26d82a8ac73d service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:56.646146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5922a677-c523-4ea4-a771-df397723e11b req-14c54034-bc3c-4354-b10c-26d82a8ac73d service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:56.660620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-5922a677-c523-4ea4-a771-df397723e11b req-14c54034-bc3c-4354-b10c-26d82a8ac73d service nova] Creating event network-changed:7ce60b54-510b-440d-9175-fd0f98028fab for instance 5fd99adb-f38e-4d43-82b1-529010509f72 on hv-cinder-85391 Sep 01 05:16:56.671344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-5922a677-c523-4ea4-a771-df397723e11b req-14c54034-bc3c-4354-b10c-26d82a8ac73d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058110 Sep 01 05:16:56.673104 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 185/336] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:56.700417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-04eb07d3-4b26-4691-9531-59596d4b6205 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:56.701197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-04eb07d3-4b26-4691-9531-59596d4b6205 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:56.710498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04eb07d3-4b26-4691-9531-59596d4b6205 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:56.716872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04eb07d3-4b26-4691-9531-59596d4b6205 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:56.717917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04eb07d3-4b26-4691-9531-59596d4b6205 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:56.718854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04eb07d3-4b26-4691-9531-59596d4b6205 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:56.719556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04eb07d3-4b26-4691-9531-59596d4b6205 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:56.720192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04eb07d3-4b26-4691-9531-59596d4b6205 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:56.881680 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-046a9188-0102-404b-91e2-7e28e2689079 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:56.882492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-046a9188-0102-404b-91e2-7e28e2689079 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:56.899443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-046a9188-0102-404b-91e2-7e28e2689079 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:56.900157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-046a9188-0102-404b-91e2-7e28e2689079 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:56.900659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-046a9188-0102-404b-91e2-7e28e2689079 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:56.901398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-046a9188-0102-404b-91e2-7e28e2689079 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:56.901867 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-046a9188-0102-404b-91e2-7e28e2689079 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:56.906007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-046a9188-0102-404b-91e2-7e28e2689079 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:57.047669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-046a9188-0102-404b-91e2-7e28e2689079 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:57.063878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-046a9188-0102-404b-91e2-7e28e2689079 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1276 microversion: 2.1 time: 0.186418 Sep 01 05:16:57.066799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 186/337] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:56 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:57.162035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9988172a-2097-4212-a7dc-c7a57773d451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:57.163125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9988172a-2097-4212-a7dc-c7a57773d451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:57.170389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9988172a-2097-4212-a7dc-c7a57773d451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:57.171098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9988172a-2097-4212-a7dc-c7a57773d451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:57.171877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9988172a-2097-4212-a7dc-c7a57773d451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:57.172837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9988172a-2097-4212-a7dc-c7a57773d451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:57.173667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9988172a-2097-4212-a7dc-c7a57773d451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:57.174488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9988172a-2097-4212-a7dc-c7a57773d451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:57.223276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-04eb07d3-4b26-4691-9531-59596d4b6205 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:57.250856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-04eb07d3-4b26-4691-9531-59596d4b6205 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.554962 Sep 01 05:16:57.254551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 152/338] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:56 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:57.403466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b21b583c-04c8-4d58-9b16-fa33152eaa4d tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:57.404400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b21b583c-04c8-4d58-9b16-fa33152eaa4d tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:57.419984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b21b583c-04c8-4d58-9b16-fa33152eaa4d tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:57.420943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b21b583c-04c8-4d58-9b16-fa33152eaa4d tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:57.422988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b21b583c-04c8-4d58-9b16-fa33152eaa4d tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:57.425198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b21b583c-04c8-4d58-9b16-fa33152eaa4d tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:57.427082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b21b583c-04c8-4d58-9b16-fa33152eaa4d tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:57.427856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b21b583c-04c8-4d58-9b16-fa33152eaa4d tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:57.431053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9988172a-2097-4212-a7dc-c7a57773d451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:57.441956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9988172a-2097-4212-a7dc-c7a57773d451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:57.444010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9988172a-2097-4212-a7dc-c7a57773d451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:57.445217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9988172a-2097-4212-a7dc-c7a57773d451 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.287948 Sep 01 05:16:57.446082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 187/339] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:16:57.477995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-df264e45-be1a-41ea-8de1-64b454fffa6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:57.478613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-df264e45-be1a-41ea-8de1-64b454fffa6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:57.487448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df264e45-be1a-41ea-8de1-64b454fffa6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:57.490244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df264e45-be1a-41ea-8de1-64b454fffa6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:57.490919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df264e45-be1a-41ea-8de1-64b454fffa6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:57.491683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df264e45-be1a-41ea-8de1-64b454fffa6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:57.494346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df264e45-be1a-41ea-8de1-64b454fffa6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:57.494818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df264e45-be1a-41ea-8de1-64b454fffa6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:57.935714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b21b583c-04c8-4d58-9b16-fa33152eaa4d tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:57.952368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b21b583c-04c8-4d58-9b16-fa33152eaa4d tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1314 microversion: 2.1 time: 0.554394 Sep 01 05:16:57.965631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 153/340] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:57 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:58.010569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-df264e45-be1a-41ea-8de1-64b454fffa6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:58.023314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-df264e45-be1a-41ea-8de1-64b454fffa6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.551962 Sep 01 05:16:58.043556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 188/341] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:57 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:58.089265 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9707f826-7e99-4cd5-85b9-0457f0daa070 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:58.090237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9707f826-7e99-4cd5-85b9-0457f0daa070 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:58.114709 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9707f826-7e99-4cd5-85b9-0457f0daa070 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:58.116067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9707f826-7e99-4cd5-85b9-0457f0daa070 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:58.117446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9707f826-7e99-4cd5-85b9-0457f0daa070 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:58.122796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9707f826-7e99-4cd5-85b9-0457f0daa070 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:58.123538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9707f826-7e99-4cd5-85b9-0457f0daa070 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:58.128206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9707f826-7e99-4cd5-85b9-0457f0daa070 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:58.276405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-725382bb-b2a0-439d-a80a-02a60d06923f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:58.277550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-725382bb-b2a0-439d-a80a-02a60d06923f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:58.296054 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-725382bb-b2a0-439d-a80a-02a60d06923f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:58.296827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-725382bb-b2a0-439d-a80a-02a60d06923f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:58.298864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-725382bb-b2a0-439d-a80a-02a60d06923f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:58.299850 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-725382bb-b2a0-439d-a80a-02a60d06923f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:58.302221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-725382bb-b2a0-439d-a80a-02a60d06923f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:58.302894 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-725382bb-b2a0-439d-a80a-02a60d06923f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:58.437113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9707f826-7e99-4cd5-85b9-0457f0daa070 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:58.453433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9707f826-7e99-4cd5-85b9-0457f0daa070 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.370040 Sep 01 05:16:58.466860 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 154/342] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:58 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:58.475218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d992d9c4-c219-4617-a14e-ad083ffdc6d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:58.476140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d992d9c4-c219-4617-a14e-ad083ffdc6d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:58.483576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d992d9c4-c219-4617-a14e-ad083ffdc6d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:58.486325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d992d9c4-c219-4617-a14e-ad083ffdc6d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:58.488585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d992d9c4-c219-4617-a14e-ad083ffdc6d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:58.489642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d992d9c4-c219-4617-a14e-ad083ffdc6d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:58.490351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d992d9c4-c219-4617-a14e-ad083ffdc6d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:58.504825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d992d9c4-c219-4617-a14e-ad083ffdc6d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:58.626962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-725382bb-b2a0-439d-a80a-02a60d06923f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:58.642578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-725382bb-b2a0-439d-a80a-02a60d06923f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.371146 Sep 01 05:16:58.643466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 189/343] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:58 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:58.700084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d992d9c4-c219-4617-a14e-ad083ffdc6d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:58.712669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d992d9c4-c219-4617-a14e-ad083ffdc6d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:58.714160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d992d9c4-c219-4617-a14e-ad083ffdc6d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:58.715694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d992d9c4-c219-4617-a14e-ad083ffdc6d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.244777 Sep 01 05:16:58.717019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 155/344] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:58.823283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-82af2507-848d-475e-a715-92f31c0124c4 req-472fee1d-3420-4010-949c-7ef17574eace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "780c2682-f837-4a5e-a2e2-80436ce037bc", "tag": "87bc312d-67fb-4c17-843d-d318bf7a37b0"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:58.854567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-82af2507-848d-475e-a715-92f31c0124c4 req-472fee1d-3420-4010-949c-7ef17574eace service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:58.855989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-82af2507-848d-475e-a715-92f31c0124c4 req-472fee1d-3420-4010-949c-7ef17574eace service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:58.857297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-82af2507-848d-475e-a715-92f31c0124c4 req-472fee1d-3420-4010-949c-7ef17574eace service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:58.884120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-82af2507-848d-475e-a715-92f31c0124c4 req-472fee1d-3420-4010-949c-7ef17574eace service nova] Creating event network-changed:87bc312d-67fb-4c17-843d-d318bf7a37b0 for instance 780c2682-f837-4a5e-a2e2-80436ce037bc on hv-cinder-85391 Sep 01 05:16:58.889186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-82af2507-848d-475e-a715-92f31c0124c4 req-472fee1d-3420-4010-949c-7ef17574eace service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072478 Sep 01 05:16:58.896944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 190/345] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:58.979884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-913a30f2-e195-4d4e-af91-3d3f5a7e7e51 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:58.981288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-913a30f2-e195-4d4e-af91-3d3f5a7e7e51 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:58.995806 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-913a30f2-e195-4d4e-af91-3d3f5a7e7e51 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:58.996625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-913a30f2-e195-4d4e-af91-3d3f5a7e7e51 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:58.997861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-913a30f2-e195-4d4e-af91-3d3f5a7e7e51 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:58.998733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-913a30f2-e195-4d4e-af91-3d3f5a7e7e51 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:58.999999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-913a30f2-e195-4d4e-af91-3d3f5a7e7e51 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:59.000652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-ed4c0810-0757-4184-bd54-92af2bdb129a req-5f02fc6f-2047-4f05-9af0-5082454a2be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6bb9b74-29c0-41d4-ba39-285c01125cdf", "tag": "494e85a1-0d9d-420c-8314-4df8b9a07670"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:59.002003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-913a30f2-e195-4d4e-af91-3d3f5a7e7e51 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:59.023691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-ed4c0810-0757-4184-bd54-92af2bdb129a req-5f02fc6f-2047-4f05-9af0-5082454a2be2 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:59.025293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-ed4c0810-0757-4184-bd54-92af2bdb129a req-5f02fc6f-2047-4f05-9af0-5082454a2be2 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:59.025918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-ed4c0810-0757-4184-bd54-92af2bdb129a req-5f02fc6f-2047-4f05-9af0-5082454a2be2 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:59.070674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:59.084247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-ed4c0810-0757-4184-bd54-92af2bdb129a req-5f02fc6f-2047-4f05-9af0-5082454a2be2 service nova] Creating event network-changed:494e85a1-0d9d-420c-8314-4df8b9a07670 for instance e6bb9b74-29c0-41d4-ba39-285c01125cdf on hv-cinder-85391 Sep 01 05:16:59.105084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-ed4c0810-0757-4184-bd54-92af2bdb129a req-5f02fc6f-2047-4f05-9af0-5082454a2be2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107906 Sep 01 05:16:59.107345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 191/346] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:16:59.128911 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f4dab867-4e4f-4c42-90bc-355e186ee3fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:59.135408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f4dab867-4e4f-4c42-90bc-355e186ee3fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:59.161746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f4dab867-4e4f-4c42-90bc-355e186ee3fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:59.185980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f4dab867-4e4f-4c42-90bc-355e186ee3fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:59.186642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f4dab867-4e4f-4c42-90bc-355e186ee3fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:59.192900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f4dab867-4e4f-4c42-90bc-355e186ee3fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:59.193574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f4dab867-4e4f-4c42-90bc-355e186ee3fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:59.197362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f4dab867-4e4f-4c42-90bc-355e186ee3fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:59.292076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-913a30f2-e195-4d4e-af91-3d3f5a7e7e51 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:59.312580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-913a30f2-e195-4d4e-af91-3d3f5a7e7e51 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1314 microversion: 2.1 time: 0.337572 Sep 01 05:16:59.314903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 156/347] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:58 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:59.460321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f4dab867-4e4f-4c42-90bc-355e186ee3fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:59.470563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f4dab867-4e4f-4c42-90bc-355e186ee3fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.360840 Sep 01 05:16:59.471508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 192/348] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:59 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:59.484638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d0b8924a-1aa9-4ea2-995a-4c8a93e2d7e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:59.485584 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d0b8924a-1aa9-4ea2-995a-4c8a93e2d7e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:59.492483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d0b8924a-1aa9-4ea2-995a-4c8a93e2d7e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:59.493319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d0b8924a-1aa9-4ea2-995a-4c8a93e2d7e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:59.493989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d0b8924a-1aa9-4ea2-995a-4c8a93e2d7e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:59.494874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d0b8924a-1aa9-4ea2-995a-4c8a93e2d7e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:59.495520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d0b8924a-1aa9-4ea2-995a-4c8a93e2d7e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:59.496151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d0b8924a-1aa9-4ea2-995a-4c8a93e2d7e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:59.668041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4181f2fa-0810-47c6-939e-c6e4b8440870 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:59.668972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4181f2fa-0810-47c6-939e-c6e4b8440870 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:59.685807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4181f2fa-0810-47c6-939e-c6e4b8440870 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:59.687073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d0b8924a-1aa9-4ea2-995a-4c8a93e2d7e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:59.689102 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4181f2fa-0810-47c6-939e-c6e4b8440870 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:59.689634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4181f2fa-0810-47c6-939e-c6e4b8440870 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:59.694053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4181f2fa-0810-47c6-939e-c6e4b8440870 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:59.694579 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4181f2fa-0810-47c6-939e-c6e4b8440870 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:59.695500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4181f2fa-0810-47c6-939e-c6e4b8440870 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:59.698203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d0b8924a-1aa9-4ea2-995a-4c8a93e2d7e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.219696 Sep 01 05:16:59.699462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 157/349] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:59 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:59.745277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9db4562c-6c3b-4ce9-828c-e3535a970559 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:59.747243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9db4562c-6c3b-4ce9-828c-e3535a970559 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:59.758830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9db4562c-6c3b-4ce9-828c-e3535a970559 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:59.759432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9db4562c-6c3b-4ce9-828c-e3535a970559 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:59.760098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9db4562c-6c3b-4ce9-828c-e3535a970559 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:59.761029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9db4562c-6c3b-4ce9-828c-e3535a970559 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:59.763344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=14 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:59.764494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9db4562c-6c3b-4ce9-828c-e3535a970559 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:59.765941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9db4562c-6c3b-4ce9-828c-e3535a970559 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:00.001022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9db4562c-6c3b-4ce9-828c-e3535a970559 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:00.021942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9db4562c-6c3b-4ce9-828c-e3535a970559 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:00.024091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9db4562c-6c3b-4ce9-828c-e3535a970559 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:00.025899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9db4562c-6c3b-4ce9-828c-e3535a970559 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.288144 Sep 01 05:17:00.026359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4181f2fa-0810-47c6-939e-c6e4b8440870 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:00.039266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4181f2fa-0810-47c6-939e-c6e4b8440870 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.376252 Sep 01 05:17:00.040104 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 193/350] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:59 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:00.042591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 158/351] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:59 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:00.334902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b83d52bc-a48e-4529-b48f-3ccf3d34a325 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:00.335527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b83d52bc-a48e-4529-b48f-3ccf3d34a325 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:00.347717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b83d52bc-a48e-4529-b48f-3ccf3d34a325 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:00.348259 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b83d52bc-a48e-4529-b48f-3ccf3d34a325 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:00.348708 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b83d52bc-a48e-4529-b48f-3ccf3d34a325 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:00.349485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b83d52bc-a48e-4529-b48f-3ccf3d34a325 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:00.349946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b83d52bc-a48e-4529-b48f-3ccf3d34a325 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:00.354727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b83d52bc-a48e-4529-b48f-3ccf3d34a325 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:00.492747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-984e2c4d-ca37-4424-96dc-f65934423975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:00.493639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-984e2c4d-ca37-4424-96dc-f65934423975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:00.507720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-984e2c4d-ca37-4424-96dc-f65934423975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:00.508222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-984e2c4d-ca37-4424-96dc-f65934423975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:00.508661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-984e2c4d-ca37-4424-96dc-f65934423975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:00.509404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-984e2c4d-ca37-4424-96dc-f65934423975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:00.509857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-984e2c4d-ca37-4424-96dc-f65934423975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:00.510283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-984e2c4d-ca37-4424-96dc-f65934423975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:00.774998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b83d52bc-a48e-4529-b48f-3ccf3d34a325 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:00.782839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b83d52bc-a48e-4529-b48f-3ccf3d34a325 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1314 microversion: 2.1 time: 0.451803 Sep 01 05:17:00.783426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 194/352] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:00 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:00.791704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f12a65dd-a211-4c3c-9b81-e3dcd6f06f2f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:00.792323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f12a65dd-a211-4c3c-9b81-e3dcd6f06f2f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:00.815435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f12a65dd-a211-4c3c-9b81-e3dcd6f06f2f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:00.822140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f12a65dd-a211-4c3c-9b81-e3dcd6f06f2f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:00.822960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f12a65dd-a211-4c3c-9b81-e3dcd6f06f2f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:00.823783 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f12a65dd-a211-4c3c-9b81-e3dcd6f06f2f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:00.826544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f12a65dd-a211-4c3c-9b81-e3dcd6f06f2f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:00.827080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f12a65dd-a211-4c3c-9b81-e3dcd6f06f2f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:01.356558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-984e2c4d-ca37-4424-96dc-f65934423975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:01.371763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-984e2c4d-ca37-4424-96dc-f65934423975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.883555 Sep 01 05:17:01.375671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 159/353] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:01.385489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5c9cb57f-594b-4918-8324-cafe62687d30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:01.389193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5c9cb57f-594b-4918-8324-cafe62687d30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:01.401545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c9cb57f-594b-4918-8324-cafe62687d30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:01.404599 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c9cb57f-594b-4918-8324-cafe62687d30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:01.405340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c9cb57f-594b-4918-8324-cafe62687d30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:01.406552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c9cb57f-594b-4918-8324-cafe62687d30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:01.408255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c9cb57f-594b-4918-8324-cafe62687d30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:01.415689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c9cb57f-594b-4918-8324-cafe62687d30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:01.450080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f12a65dd-a211-4c3c-9b81-e3dcd6f06f2f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:01.459945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f12a65dd-a211-4c3c-9b81-e3dcd6f06f2f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.675471 Sep 01 05:17:01.477307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 195/354] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:00 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:01.492489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-38224a6a-6142-4c67-b84e-6e32228fcc9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:01.493138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-38224a6a-6142-4c67-b84e-6e32228fcc9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:01.526681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38224a6a-6142-4c67-b84e-6e32228fcc9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:01.526681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38224a6a-6142-4c67-b84e-6e32228fcc9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:01.526681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38224a6a-6142-4c67-b84e-6e32228fcc9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:01.526681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38224a6a-6142-4c67-b84e-6e32228fcc9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:01.526995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38224a6a-6142-4c67-b84e-6e32228fcc9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:01.526995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38224a6a-6142-4c67-b84e-6e32228fcc9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:01.686641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5c9cb57f-594b-4918-8324-cafe62687d30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:01.700389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5c9cb57f-594b-4918-8324-cafe62687d30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:01.701869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5c9cb57f-594b-4918-8324-cafe62687d30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:01.703081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5c9cb57f-594b-4918-8324-cafe62687d30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.326231 Sep 01 05:17:01.703648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 160/355] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:01.767723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-38224a6a-6142-4c67-b84e-6e32228fcc9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:01.777754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-38224a6a-6142-4c67-b84e-6e32228fcc9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.299090 Sep 01 05:17:01.778331 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 196/356] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:01 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:01.809521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-351b7b9a-76a2-4933-858a-98803ae2be18 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:01.810384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-351b7b9a-76a2-4933-858a-98803ae2be18 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:01.817463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-351b7b9a-76a2-4933-858a-98803ae2be18 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:01.817950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-351b7b9a-76a2-4933-858a-98803ae2be18 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:01.818385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-351b7b9a-76a2-4933-858a-98803ae2be18 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:01.819079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-351b7b9a-76a2-4933-858a-98803ae2be18 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:01.821700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-351b7b9a-76a2-4933-858a-98803ae2be18 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:01.822138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-351b7b9a-76a2-4933-858a-98803ae2be18 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:01.978380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-351b7b9a-76a2-4933-858a-98803ae2be18 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:01.986094 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-351b7b9a-76a2-4933-858a-98803ae2be18 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1314 microversion: 2.1 time: 0.180652 Sep 01 05:17:01.996855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 161/357] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:01 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:02.396179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fb7dae39-60b7-4ea1-8c13-5ce8cd607cc6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:02.397262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fb7dae39-60b7-4ea1-8c13-5ce8cd607cc6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:02.403742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb7dae39-60b7-4ea1-8c13-5ce8cd607cc6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:02.404397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb7dae39-60b7-4ea1-8c13-5ce8cd607cc6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:02.405236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb7dae39-60b7-4ea1-8c13-5ce8cd607cc6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:02.407857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb7dae39-60b7-4ea1-8c13-5ce8cd607cc6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:02.409288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb7dae39-60b7-4ea1-8c13-5ce8cd607cc6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:02.410565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb7dae39-60b7-4ea1-8c13-5ce8cd607cc6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:02.415267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:02.482335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-85003c01-3666-4134-b49c-65666ab864a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:02.483790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-85003c01-3666-4134-b49c-65666ab864a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:02.494536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85003c01-3666-4134-b49c-65666ab864a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:02.495325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85003c01-3666-4134-b49c-65666ab864a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:02.496944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85003c01-3666-4134-b49c-65666ab864a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:02.497884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85003c01-3666-4134-b49c-65666ab864a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:02.501703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85003c01-3666-4134-b49c-65666ab864a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:02.502392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85003c01-3666-4134-b49c-65666ab864a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:02.591793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fb7dae39-60b7-4ea1-8c13-5ce8cd607cc6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:02.604194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fb7dae39-60b7-4ea1-8c13-5ce8cd607cc6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.212460 Sep 01 05:17:02.605137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 197/358] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:02 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:02.708198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-85003c01-3666-4134-b49c-65666ab864a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:02.728905 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9df7f831-5a12-4e46-8ce3-ce0121bfe383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:02.731440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9df7f831-5a12-4e46-8ce3-ce0121bfe383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:02.743099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-85003c01-3666-4134-b49c-65666ab864a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.265019 Sep 01 05:17:02.747018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9df7f831-5a12-4e46-8ce3-ce0121bfe383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:02.750045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 162/359] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:02 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:02.750578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9df7f831-5a12-4e46-8ce3-ce0121bfe383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:02.752520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9df7f831-5a12-4e46-8ce3-ce0121bfe383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:02.753539 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9df7f831-5a12-4e46-8ce3-ce0121bfe383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:02.754614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9df7f831-5a12-4e46-8ce3-ce0121bfe383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:02.755193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9df7f831-5a12-4e46-8ce3-ce0121bfe383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:02.799627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-882d844d-2e67-401c-a4e2-9d4f1bfd0039 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:02.801158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-882d844d-2e67-401c-a4e2-9d4f1bfd0039 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:02.813053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-882d844d-2e67-401c-a4e2-9d4f1bfd0039 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:02.813541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-882d844d-2e67-401c-a4e2-9d4f1bfd0039 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:02.816925 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-882d844d-2e67-401c-a4e2-9d4f1bfd0039 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:02.818932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-882d844d-2e67-401c-a4e2-9d4f1bfd0039 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:02.819552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-882d844d-2e67-401c-a4e2-9d4f1bfd0039 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:02.820166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-882d844d-2e67-401c-a4e2-9d4f1bfd0039 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:02.987051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9df7f831-5a12-4e46-8ce3-ce0121bfe383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:03.013915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9df7f831-5a12-4e46-8ce3-ce0121bfe383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:03.016648 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9df7f831-5a12-4e46-8ce3-ce0121bfe383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:03.017901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9df7f831-5a12-4e46-8ce3-ce0121bfe383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.293101 Sep 01 05:17:03.018459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 198/360] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:03.023851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-30b2c9fe-529d-4b4f-91d9-5127f9b2bc49 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:03.024550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-30b2c9fe-529d-4b4f-91d9-5127f9b2bc49 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:03.039445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30b2c9fe-529d-4b4f-91d9-5127f9b2bc49 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:03.040152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30b2c9fe-529d-4b4f-91d9-5127f9b2bc49 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:03.040865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30b2c9fe-529d-4b4f-91d9-5127f9b2bc49 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:03.041852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30b2c9fe-529d-4b4f-91d9-5127f9b2bc49 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:03.042371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30b2c9fe-529d-4b4f-91d9-5127f9b2bc49 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:03.042924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30b2c9fe-529d-4b4f-91d9-5127f9b2bc49 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:03.114418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-882d844d-2e67-401c-a4e2-9d4f1bfd0039 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:03.125179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:03.141477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-882d844d-2e67-401c-a4e2-9d4f1bfd0039 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.345941 Sep 01 05:17:03.142736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 163/361] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:02 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:03.236422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-30b2c9fe-529d-4b4f-91d9-5127f9b2bc49 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:03.247586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-30b2c9fe-529d-4b4f-91d9-5127f9b2bc49 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1314 microversion: 2.1 time: 0.225268 Sep 01 05:17:03.248481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 199/362] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:03 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:03.625628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-225d5b20-e24c-4211-b9a0-0abd7876322d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:03.626990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-225d5b20-e24c-4211-b9a0-0abd7876322d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:03.633810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-225d5b20-e24c-4211-b9a0-0abd7876322d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:03.634297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-225d5b20-e24c-4211-b9a0-0abd7876322d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:03.634927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-225d5b20-e24c-4211-b9a0-0abd7876322d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:03.635627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-225d5b20-e24c-4211-b9a0-0abd7876322d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:03.636081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-225d5b20-e24c-4211-b9a0-0abd7876322d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:03.636504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-225d5b20-e24c-4211-b9a0-0abd7876322d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:03.767647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ec91c651-9fce-43d2-98eb-e9a0250a9689 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:03.768270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ec91c651-9fce-43d2-98eb-e9a0250a9689 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:03.776816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec91c651-9fce-43d2-98eb-e9a0250a9689 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:03.777311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec91c651-9fce-43d2-98eb-e9a0250a9689 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:03.777746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec91c651-9fce-43d2-98eb-e9a0250a9689 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:03.778474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec91c651-9fce-43d2-98eb-e9a0250a9689 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:03.779094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec91c651-9fce-43d2-98eb-e9a0250a9689 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:03.779522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec91c651-9fce-43d2-98eb-e9a0250a9689 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:03.781840 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-225d5b20-e24c-4211-b9a0-0abd7876322d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:03.790023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-225d5b20-e24c-4211-b9a0-0abd7876322d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.168719 Sep 01 05:17:03.800916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 164/363] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:03 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:03.929309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ec91c651-9fce-43d2-98eb-e9a0250a9689 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:03.937125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ec91c651-9fce-43d2-98eb-e9a0250a9689 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.173465 Sep 01 05:17:03.937674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 200/364] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:03 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:04.042270 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ff665748-dee4-4acc-9353-1af3b9c3545f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:04.042856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ff665748-dee4-4acc-9353-1af3b9c3545f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:04.044665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=4 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:04.049913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff665748-dee4-4acc-9353-1af3b9c3545f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:04.051015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff665748-dee4-4acc-9353-1af3b9c3545f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:04.051443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff665748-dee4-4acc-9353-1af3b9c3545f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:04.052117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff665748-dee4-4acc-9353-1af3b9c3545f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:04.052557 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff665748-dee4-4acc-9353-1af3b9c3545f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:04.053006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff665748-dee4-4acc-9353-1af3b9c3545f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:04.163508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e626a88a-0ee5-4866-a419-69214b43c366 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:04.164157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e626a88a-0ee5-4866-a419-69214b43c366 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:04.170063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e626a88a-0ee5-4866-a419-69214b43c366 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:04.170549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e626a88a-0ee5-4866-a419-69214b43c366 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:04.170986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e626a88a-0ee5-4866-a419-69214b43c366 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:04.171678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e626a88a-0ee5-4866-a419-69214b43c366 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:04.172134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e626a88a-0ee5-4866-a419-69214b43c366 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:04.172562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e626a88a-0ee5-4866-a419-69214b43c366 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:04.180675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ff665748-dee4-4acc-9353-1af3b9c3545f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:04.189149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ff665748-dee4-4acc-9353-1af3b9c3545f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:04.190773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ff665748-dee4-4acc-9353-1af3b9c3545f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:04.192065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ff665748-dee4-4acc-9353-1af3b9c3545f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.153749 Sep 01 05:17:04.192767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 165/365] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:04.279499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ef1634e2-b903-48e4-bdfd-44e9b9b2ecdd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:04.280104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ef1634e2-b903-48e4-bdfd-44e9b9b2ecdd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:04.286504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ef1634e2-b903-48e4-bdfd-44e9b9b2ecdd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:04.286977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ef1634e2-b903-48e4-bdfd-44e9b9b2ecdd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:04.287511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ef1634e2-b903-48e4-bdfd-44e9b9b2ecdd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:04.288193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ef1634e2-b903-48e4-bdfd-44e9b9b2ecdd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:04.288637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ef1634e2-b903-48e4-bdfd-44e9b9b2ecdd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:04.289078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ef1634e2-b903-48e4-bdfd-44e9b9b2ecdd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:04.306741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e626a88a-0ee5-4866-a419-69214b43c366 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:04.314887 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e626a88a-0ee5-4866-a419-69214b43c366 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.155784 Sep 01 05:17:04.315448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 201/366] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:04 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:04.420762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ef1634e2-b903-48e4-bdfd-44e9b9b2ecdd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:04.429152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ef1634e2-b903-48e4-bdfd-44e9b9b2ecdd tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1314 microversion: 2.1 time: 0.153478 Sep 01 05:17:04.429702 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 166/367] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:04 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:04.822458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c5831f08-162e-416c-ac76-852fa15219fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:04.823233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c5831f08-162e-416c-ac76-852fa15219fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:04.829884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c5831f08-162e-416c-ac76-852fa15219fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:04.830367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c5831f08-162e-416c-ac76-852fa15219fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:04.830800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c5831f08-162e-416c-ac76-852fa15219fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:04.832346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c5831f08-162e-416c-ac76-852fa15219fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:04.833380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c5831f08-162e-416c-ac76-852fa15219fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:04.833810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c5831f08-162e-416c-ac76-852fa15219fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:04.959792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-264cf504-82d1-44bd-b1dc-67b3513da69e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:04.961106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-264cf504-82d1-44bd-b1dc-67b3513da69e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:04.964367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=14 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:04.968234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-264cf504-82d1-44bd-b1dc-67b3513da69e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:04.968721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-264cf504-82d1-44bd-b1dc-67b3513da69e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:04.969189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-264cf504-82d1-44bd-b1dc-67b3513da69e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:04.969882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-264cf504-82d1-44bd-b1dc-67b3513da69e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:04.970329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-264cf504-82d1-44bd-b1dc-67b3513da69e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:04.970744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-264cf504-82d1-44bd-b1dc-67b3513da69e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:04.982066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c5831f08-162e-416c-ac76-852fa15219fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:04.993182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c5831f08-162e-416c-ac76-852fa15219fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.175265 Sep 01 05:17:04.994058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 202/368] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:05.108910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-264cf504-82d1-44bd-b1dc-67b3513da69e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:05.116721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-264cf504-82d1-44bd-b1dc-67b3513da69e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.161950 Sep 01 05:17:05.117303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 167/369] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:04 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:05.214681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-51c014e7-70d9-4559-a2cc-2fa5b7f01830 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:05.215207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-51c014e7-70d9-4559-a2cc-2fa5b7f01830 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:05.221135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-51c014e7-70d9-4559-a2cc-2fa5b7f01830 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:05.221610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-51c014e7-70d9-4559-a2cc-2fa5b7f01830 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:05.222641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-51c014e7-70d9-4559-a2cc-2fa5b7f01830 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:05.223321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-51c014e7-70d9-4559-a2cc-2fa5b7f01830 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:05.223772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-51c014e7-70d9-4559-a2cc-2fa5b7f01830 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:05.224187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-51c014e7-70d9-4559-a2cc-2fa5b7f01830 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:05.335981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-82102f95-187c-40eb-aa0b-4fbf4e71a171 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:05.336599 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-82102f95-187c-40eb-aa0b-4fbf4e71a171 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:05.342487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82102f95-187c-40eb-aa0b-4fbf4e71a171 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:05.342967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82102f95-187c-40eb-aa0b-4fbf4e71a171 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:05.343401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82102f95-187c-40eb-aa0b-4fbf4e71a171 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:05.344087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82102f95-187c-40eb-aa0b-4fbf4e71a171 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:05.344538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82102f95-187c-40eb-aa0b-4fbf4e71a171 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:05.344991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82102f95-187c-40eb-aa0b-4fbf4e71a171 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:05.362732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-51c014e7-70d9-4559-a2cc-2fa5b7f01830 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:05.371348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-51c014e7-70d9-4559-a2cc-2fa5b7f01830 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:05.373112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-51c014e7-70d9-4559-a2cc-2fa5b7f01830 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:05.374920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-51c014e7-70d9-4559-a2cc-2fa5b7f01830 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1739 microversion: 2.20 time: 0.164078 Sep 01 05:17:05.376528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 203/370] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:05.450715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6b58a228-5bf0-46e8-9d86-c3d3fc5ce147 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:05.451318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6b58a228-5bf0-46e8-9d86-c3d3fc5ce147 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:05.453175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:05.459572 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b58a228-5bf0-46e8-9d86-c3d3fc5ce147 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:05.459981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b58a228-5bf0-46e8-9d86-c3d3fc5ce147 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:05.460416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b58a228-5bf0-46e8-9d86-c3d3fc5ce147 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:05.461131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b58a228-5bf0-46e8-9d86-c3d3fc5ce147 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:05.461576 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b58a228-5bf0-46e8-9d86-c3d3fc5ce147 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:05.461991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b58a228-5bf0-46e8-9d86-c3d3fc5ce147 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:05.559259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-82102f95-187c-40eb-aa0b-4fbf4e71a171 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:05.574784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-82102f95-187c-40eb-aa0b-4fbf4e71a171 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.242781 Sep 01 05:17:05.575680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 168/371] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:05 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:05.638006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6b58a228-5bf0-46e8-9d86-c3d3fc5ce147 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:05.648198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6b58a228-5bf0-46e8-9d86-c3d3fc5ce147 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1314 microversion: 2.1 time: 0.202443 Sep 01 05:17:05.652967 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 204/372] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:05 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:06.015526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-99002c87-baf3-404a-bef3-1f0270716aca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:06.016153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-99002c87-baf3-404a-bef3-1f0270716aca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:06.024649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-99002c87-baf3-404a-bef3-1f0270716aca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.025686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-99002c87-baf3-404a-bef3-1f0270716aca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.026140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-99002c87-baf3-404a-bef3-1f0270716aca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.026818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-99002c87-baf3-404a-bef3-1f0270716aca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.028060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-99002c87-baf3-404a-bef3-1f0270716aca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.028494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-99002c87-baf3-404a-bef3-1f0270716aca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.137771 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-353fb5e4-ec0a-4b34-b05c-510867dbc57a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:06.138511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-353fb5e4-ec0a-4b34-b05c-510867dbc57a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:06.146703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-353fb5e4-ec0a-4b34-b05c-510867dbc57a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.148437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-353fb5e4-ec0a-4b34-b05c-510867dbc57a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.149011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-353fb5e4-ec0a-4b34-b05c-510867dbc57a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.149960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-353fb5e4-ec0a-4b34-b05c-510867dbc57a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.150416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-353fb5e4-ec0a-4b34-b05c-510867dbc57a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.151488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-353fb5e4-ec0a-4b34-b05c-510867dbc57a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.262601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-99002c87-baf3-404a-bef3-1f0270716aca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:06.273503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-99002c87-baf3-404a-bef3-1f0270716aca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.261800 Sep 01 05:17:06.274093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 169/373] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:06 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:06.361820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-353fb5e4-ec0a-4b34-b05c-510867dbc57a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:06.369941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-353fb5e4-ec0a-4b34-b05c-510867dbc57a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.236075 Sep 01 05:17:06.370507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 205/374] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:06 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:06.400094 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-72be4846-fc58-4fcd-90d8-f5d2723ddbf1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:06.400701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-72be4846-fc58-4fcd-90d8-f5d2723ddbf1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:06.406493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72be4846-fc58-4fcd-90d8-f5d2723ddbf1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.406977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72be4846-fc58-4fcd-90d8-f5d2723ddbf1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.407425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72be4846-fc58-4fcd-90d8-f5d2723ddbf1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.408105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72be4846-fc58-4fcd-90d8-f5d2723ddbf1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.408549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72be4846-fc58-4fcd-90d8-f5d2723ddbf1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.408993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72be4846-fc58-4fcd-90d8-f5d2723ddbf1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.541888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72be4846-fc58-4fcd-90d8-f5d2723ddbf1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:06.550700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72be4846-fc58-4fcd-90d8-f5d2723ddbf1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:06.552607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72be4846-fc58-4fcd-90d8-f5d2723ddbf1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:06.553785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-72be4846-fc58-4fcd-90d8-f5d2723ddbf1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1721 microversion: 2.20 time: 0.157735 Sep 01 05:17:06.554347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 170/375] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:06.595395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6f7ced1c-67e3-4dbe-8cf0-c06468e6b4a0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:06.595999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6f7ced1c-67e3-4dbe-8cf0-c06468e6b4a0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:06.602655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f7ced1c-67e3-4dbe-8cf0-c06468e6b4a0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.603133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f7ced1c-67e3-4dbe-8cf0-c06468e6b4a0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.603561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f7ced1c-67e3-4dbe-8cf0-c06468e6b4a0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.604244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f7ced1c-67e3-4dbe-8cf0-c06468e6b4a0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.604688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f7ced1c-67e3-4dbe-8cf0-c06468e6b4a0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.605133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f7ced1c-67e3-4dbe-8cf0-c06468e6b4a0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.674324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0b0f09fe-d887-42b2-9d38-edcc318829b4 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:06.675066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0b0f09fe-d887-42b2-9d38-edcc318829b4 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:06.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b0f09fe-d887-42b2-9d38-edcc318829b4 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.682744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b0f09fe-d887-42b2-9d38-edcc318829b4 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.683279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b0f09fe-d887-42b2-9d38-edcc318829b4 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.684212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b0f09fe-d887-42b2-9d38-edcc318829b4 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.684877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b0f09fe-d887-42b2-9d38-edcc318829b4 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.685514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b0f09fe-d887-42b2-9d38-edcc318829b4 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.755669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6f7ced1c-67e3-4dbe-8cf0-c06468e6b4a0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:06.763741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6f7ced1c-67e3-4dbe-8cf0-c06468e6b4a0 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.171856 Sep 01 05:17:06.779153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 206/376] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:06 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:06.848593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0b0f09fe-d887-42b2-9d38-edcc318829b4 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:06.855615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0b0f09fe-d887-42b2-9d38-edcc318829b4 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1314 microversion: 2.1 time: 0.188604 Sep 01 05:17:06.856825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 171/377] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:06 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:06.863524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-f2b20f15-2933-41d4-9eac-7b69c1d9d81b req-b9cbd272-53b4-4ff8-bdbd-feaf82ac1dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780c2682-f837-4a5e-a2e2-80436ce037bc", "name": "network-vif-plugged", "status": "completed", "tag": "87bc312d-67fb-4c17-843d-d318bf7a37b0"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:06.874443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-f2b20f15-2933-41d4-9eac-7b69c1d9d81b req-b9cbd272-53b4-4ff8-bdbd-feaf82ac1dd2 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.874927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-f2b20f15-2933-41d4-9eac-7b69c1d9d81b req-b9cbd272-53b4-4ff8-bdbd-feaf82ac1dd2 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.875360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-f2b20f15-2933-41d4-9eac-7b69c1d9d81b req-b9cbd272-53b4-4ff8-bdbd-feaf82ac1dd2 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.888881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-f2b20f15-2933-41d4-9eac-7b69c1d9d81b req-b9cbd272-53b4-4ff8-bdbd-feaf82ac1dd2 service nova] Creating event network-vif-plugged:87bc312d-67fb-4c17-843d-d318bf7a37b0 for instance 780c2682-f837-4a5e-a2e2-80436ce037bc on hv-cinder-85391 Sep 01 05:17:06.899304 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-f2b20f15-2933-41d4-9eac-7b69c1d9d81b req-b9cbd272-53b4-4ff8-bdbd-feaf82ac1dd2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039816 Sep 01 05:17:06.900258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 207/378] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:07.294699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5cd981d8-ceab-49fe-93bc-2f56ea72d4a5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:07.295273 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5cd981d8-ceab-49fe-93bc-2f56ea72d4a5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:07.301677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cd981d8-ceab-49fe-93bc-2f56ea72d4a5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.302152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cd981d8-ceab-49fe-93bc-2f56ea72d4a5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.302588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cd981d8-ceab-49fe-93bc-2f56ea72d4a5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.303261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cd981d8-ceab-49fe-93bc-2f56ea72d4a5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.303715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cd981d8-ceab-49fe-93bc-2f56ea72d4a5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.304134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cd981d8-ceab-49fe-93bc-2f56ea72d4a5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.392274 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-383a62de-2b0a-41db-a202-1d218bcbf3a2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:07.392997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-383a62de-2b0a-41db-a202-1d218bcbf3a2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:07.400294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-383a62de-2b0a-41db-a202-1d218bcbf3a2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.400821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-383a62de-2b0a-41db-a202-1d218bcbf3a2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.401256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-383a62de-2b0a-41db-a202-1d218bcbf3a2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.401988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-383a62de-2b0a-41db-a202-1d218bcbf3a2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.402471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-383a62de-2b0a-41db-a202-1d218bcbf3a2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.402904 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-383a62de-2b0a-41db-a202-1d218bcbf3a2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.435734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5cd981d8-ceab-49fe-93bc-2f56ea72d4a5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:07.444106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5cd981d8-ceab-49fe-93bc-2f56ea72d4a5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.153505 Sep 01 05:17:07.444679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 172/379] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:07 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:07.535433 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-383a62de-2b0a-41db-a202-1d218bcbf3a2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:07.543078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-383a62de-2b0a-41db-a202-1d218bcbf3a2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.155370 Sep 01 05:17:07.543642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 208/380] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:07 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:07.576783 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d8270b17-003a-46a0-9db4-e9ffab8bae87 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:07.577355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d8270b17-003a-46a0-9db4-e9ffab8bae87 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:07.583282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8270b17-003a-46a0-9db4-e9ffab8bae87 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.583754 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8270b17-003a-46a0-9db4-e9ffab8bae87 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.584183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8270b17-003a-46a0-9db4-e9ffab8bae87 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.584894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8270b17-003a-46a0-9db4-e9ffab8bae87 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.585341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8270b17-003a-46a0-9db4-e9ffab8bae87 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.585760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8270b17-003a-46a0-9db4-e9ffab8bae87 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.712415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d8270b17-003a-46a0-9db4-e9ffab8bae87 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:07.720401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d8270b17-003a-46a0-9db4-e9ffab8bae87 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:07.721913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d8270b17-003a-46a0-9db4-e9ffab8bae87 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:07.723154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d8270b17-003a-46a0-9db4-e9ffab8bae87 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1721 microversion: 2.20 time: 0.150324 Sep 01 05:17:07.723711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 173/381] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:07 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:07.785969 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d28a0258-3c37-4804-ab4e-d5a10c082164 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:07.786580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d28a0258-3c37-4804-ab4e-d5a10c082164 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:07.792485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d28a0258-3c37-4804-ab4e-d5a10c082164 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.792997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d28a0258-3c37-4804-ab4e-d5a10c082164 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.793431 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d28a0258-3c37-4804-ab4e-d5a10c082164 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.794113 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d28a0258-3c37-4804-ab4e-d5a10c082164 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.794565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d28a0258-3c37-4804-ab4e-d5a10c082164 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.794985 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d28a0258-3c37-4804-ab4e-d5a10c082164 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.878399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-56b7adb2-f5de-4026-8117-e9e2aea278ac tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:07.879171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-56b7adb2-f5de-4026-8117-e9e2aea278ac tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:07.885671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56b7adb2-f5de-4026-8117-e9e2aea278ac tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.886094 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56b7adb2-f5de-4026-8117-e9e2aea278ac tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.886534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56b7adb2-f5de-4026-8117-e9e2aea278ac tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.887299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56b7adb2-f5de-4026-8117-e9e2aea278ac tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.887635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56b7adb2-f5de-4026-8117-e9e2aea278ac tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.888050 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56b7adb2-f5de-4026-8117-e9e2aea278ac tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.937546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d28a0258-3c37-4804-ab4e-d5a10c082164 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:07.946553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d28a0258-3c37-4804-ab4e-d5a10c082164 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.164850 Sep 01 05:17:07.947323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 209/382] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:07 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:08.024460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-56b7adb2-f5de-4026-8117-e9e2aea278ac tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:08.032214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-56b7adb2-f5de-4026-8117-e9e2aea278ac tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1314 microversion: 2.1 time: 0.157838 Sep 01 05:17:08.032802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 174/383] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:07 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:08.465075 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d01551d6-92cf-429c-b5e6-d7543247e7d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:08.465706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d01551d6-92cf-429c-b5e6-d7543247e7d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:08.472714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d01551d6-92cf-429c-b5e6-d7543247e7d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.473227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d01551d6-92cf-429c-b5e6-d7543247e7d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.473670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d01551d6-92cf-429c-b5e6-d7543247e7d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.482172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d01551d6-92cf-429c-b5e6-d7543247e7d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.482685 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d01551d6-92cf-429c-b5e6-d7543247e7d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.483149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d01551d6-92cf-429c-b5e6-d7543247e7d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.564508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-87c6d99d-badb-41cb-9205-98cf1bca2d37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:08.565152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-87c6d99d-badb-41cb-9205-98cf1bca2d37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:08.571847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87c6d99d-badb-41cb-9205-98cf1bca2d37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.572324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87c6d99d-badb-41cb-9205-98cf1bca2d37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.572930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87c6d99d-badb-41cb-9205-98cf1bca2d37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.573740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87c6d99d-badb-41cb-9205-98cf1bca2d37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.574198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87c6d99d-badb-41cb-9205-98cf1bca2d37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.574609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87c6d99d-badb-41cb-9205-98cf1bca2d37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.702990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d01551d6-92cf-429c-b5e6-d7543247e7d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:08.712938 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d01551d6-92cf-429c-b5e6-d7543247e7d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.251571 Sep 01 05:17:08.713762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 210/384] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:08 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:08.736656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-87c6d99d-badb-41cb-9205-98cf1bca2d37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:08.745901 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-87c6d99d-badb-41cb-9205-98cf1bca2d37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.185626 Sep 01 05:17:08.746418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9b2af3bf-9174-4154-b806-6ef1d252de72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:08.746854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 175/385] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:08 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:08.747038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9b2af3bf-9174-4154-b806-6ef1d252de72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:08.753786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b2af3bf-9174-4154-b806-6ef1d252de72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.754347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b2af3bf-9174-4154-b806-6ef1d252de72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.754785 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b2af3bf-9174-4154-b806-6ef1d252de72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.755482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b2af3bf-9174-4154-b806-6ef1d252de72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.756108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b2af3bf-9174-4154-b806-6ef1d252de72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.756691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b2af3bf-9174-4154-b806-6ef1d252de72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.895091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9b2af3bf-9174-4154-b806-6ef1d252de72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:08.903377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9b2af3bf-9174-4154-b806-6ef1d252de72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:08.904986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9b2af3bf-9174-4154-b806-6ef1d252de72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:08.906276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9b2af3bf-9174-4154-b806-6ef1d252de72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1724 microversion: 2.20 time: 0.163860 Sep 01 05:17:08.912798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 211/386] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:17:08.930675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-917655a8-334d-42d3-945e-3594d9cfdbf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9a9dbef-f089-4cdd-ab34-7af7f169bfa0"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:08.933526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-917655a8-334d-42d3-945e-3594d9cfdbf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:08.944810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-4c1f7079-ddee-47b5-b005-44b84ed4e8b4 req-6a667680-c007-4a0d-b005-f0bfe7539ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd99adb-f38e-4d43-82b1-529010509f72", "name": "network-vif-plugged", "status": "completed", "tag": "7ce60b54-510b-440d-9175-fd0f98028fab"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:08.949451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-917655a8-334d-42d3-945e-3594d9cfdbf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.951386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-917655a8-334d-42d3-945e-3594d9cfdbf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.951824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-917655a8-334d-42d3-945e-3594d9cfdbf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.954240 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-917655a8-334d-42d3-945e-3594d9cfdbf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.954854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-917655a8-334d-42d3-945e-3594d9cfdbf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.955292 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4c1f7079-ddee-47b5-b005-44b84ed4e8b4 req-6a667680-c007-4a0d-b005-f0bfe7539ed9 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.955614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-917655a8-334d-42d3-945e-3594d9cfdbf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.955821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4c1f7079-ddee-47b5-b005-44b84ed4e8b4 req-6a667680-c007-4a0d-b005-f0bfe7539ed9 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.956878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4c1f7079-ddee-47b5-b005-44b84ed4e8b4 req-6a667680-c007-4a0d-b005-f0bfe7539ed9 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.968793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-4c1f7079-ddee-47b5-b005-44b84ed4e8b4 req-6a667680-c007-4a0d-b005-f0bfe7539ed9 service nova] Creating event network-vif-plugged:7ce60b54-510b-440d-9175-fd0f98028fab for instance 5fd99adb-f38e-4d43-82b1-529010509f72 on hv-cinder-85391 Sep 01 05:17:08.974661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-4c1f7079-ddee-47b5-b005-44b84ed4e8b4 req-6a667680-c007-4a0d-b005-f0bfe7539ed9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034761 Sep 01 05:17:08.976116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 212/387] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:17:08.981842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f69cb1bb-9aed-4684-9f80-aeea6deb7ec8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:08.983294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f69cb1bb-9aed-4684-9f80-aeea6deb7ec8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:08.995465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f69cb1bb-9aed-4684-9f80-aeea6deb7ec8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.996234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f69cb1bb-9aed-4684-9f80-aeea6deb7ec8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.996926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f69cb1bb-9aed-4684-9f80-aeea6deb7ec8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.997633 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f69cb1bb-9aed-4684-9f80-aeea6deb7ec8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.998232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f69cb1bb-9aed-4684-9f80-aeea6deb7ec8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.999022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f69cb1bb-9aed-4684-9f80-aeea6deb7ec8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.191268 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f69cb1bb-9aed-4684-9f80-aeea6deb7ec8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:09.200355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f69cb1bb-9aed-4684-9f80-aeea6deb7ec8 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.222843 Sep 01 05:17:09.200994 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 213/388] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:08 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:09.214790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d221fa0d-3516-481d-9c20-9f81a0f36bd8 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:09.214790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d221fa0d-3516-481d-9c20-9f81a0f36bd8 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:09.222467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d221fa0d-3516-481d-9c20-9f81a0f36bd8 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.223171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d221fa0d-3516-481d-9c20-9f81a0f36bd8 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.224131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d221fa0d-3516-481d-9c20-9f81a0f36bd8 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.234181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d221fa0d-3516-481d-9c20-9f81a0f36bd8 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.234677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d221fa0d-3516-481d-9c20-9f81a0f36bd8 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.235106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d221fa0d-3516-481d-9c20-9f81a0f36bd8 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.407634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d221fa0d-3516-481d-9c20-9f81a0f36bd8 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:09.416311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d221fa0d-3516-481d-9c20-9f81a0f36bd8 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1314 microversion: 2.1 time: 0.214303 Sep 01 05:17:09.428322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-917655a8-334d-42d3-945e-3594d9cfdbf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "POST /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.502019 Sep 01 05:17:09.429198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 214/389] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:09 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:09.429964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 176/390] 10.222.0.49 () {62 vars in 1364 bytes} [Thu Sep 1 05:17:08 2022] POST /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 188 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:17:09.594844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fe63cdfb-b892-4ee6-b269-d0c7a1ac0d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:09.595651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fe63cdfb-b892-4ee6-b269-d0c7a1ac0d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:09.608041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe63cdfb-b892-4ee6-b269-d0c7a1ac0d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.608715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe63cdfb-b892-4ee6-b269-d0c7a1ac0d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.609443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe63cdfb-b892-4ee6-b269-d0c7a1ac0d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.610372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe63cdfb-b892-4ee6-b269-d0c7a1ac0d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.610980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe63cdfb-b892-4ee6-b269-d0c7a1ac0d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.611558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe63cdfb-b892-4ee6-b269-d0c7a1ac0d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.617285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:09.668705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fe63cdfb-b892-4ee6-b269-d0c7a1ac0d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120674) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:17:09.735168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1bf25c8b-3dfc-4fb2-a52d-8d3610d4d187 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:09.735809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1bf25c8b-3dfc-4fb2-a52d-8d3610d4d187 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:09.743522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1bf25c8b-3dfc-4fb2-a52d-8d3610d4d187 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.744008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1bf25c8b-3dfc-4fb2-a52d-8d3610d4d187 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.744432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1bf25c8b-3dfc-4fb2-a52d-8d3610d4d187 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.745147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1bf25c8b-3dfc-4fb2-a52d-8d3610d4d187 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.745451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fe63cdfb-b892-4ee6-b269-d0c7a1ac0d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "POST /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/action" status: 202 len: 0 microversion: 2.20 time: 0.159956 Sep 01 05:17:09.745590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1bf25c8b-3dfc-4fb2-a52d-8d3610d4d187 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.746206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1bf25c8b-3dfc-4fb2-a52d-8d3610d4d187 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.746543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 215/391] 10.222.0.49 () {62 vars in 1319 bytes} [Thu Sep 1 05:17:09 2022] POST /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:09.761254 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-24d6f062-18a9-4188-89dd-a4d2b52ea949 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:09.761952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-24d6f062-18a9-4188-89dd-a4d2b52ea949 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:09.768134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24d6f062-18a9-4188-89dd-a4d2b52ea949 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.768527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24d6f062-18a9-4188-89dd-a4d2b52ea949 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.769118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24d6f062-18a9-4188-89dd-a4d2b52ea949 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.769824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24d6f062-18a9-4188-89dd-a4d2b52ea949 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.770276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24d6f062-18a9-4188-89dd-a4d2b52ea949 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.770693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24d6f062-18a9-4188-89dd-a4d2b52ea949 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.903578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1bf25c8b-3dfc-4fb2-a52d-8d3610d4d187 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:09.907733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:09.916345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1bf25c8b-3dfc-4fb2-a52d-8d3610d4d187 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.185411 Sep 01 05:17:09.917564 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 177/392] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:09 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:09.923279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-aa92342d-4186-4d75-9c01-de741dd81230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:09.924508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-aa92342d-4186-4d75-9c01-de741dd81230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:09.934083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aa92342d-4186-4d75-9c01-de741dd81230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.934889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aa92342d-4186-4d75-9c01-de741dd81230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.935480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aa92342d-4186-4d75-9c01-de741dd81230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.936336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aa92342d-4186-4d75-9c01-de741dd81230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.937001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aa92342d-4186-4d75-9c01-de741dd81230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.937595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aa92342d-4186-4d75-9c01-de741dd81230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.995617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-24d6f062-18a9-4188-89dd-a4d2b52ea949 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:10.008050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-24d6f062-18a9-4188-89dd-a4d2b52ea949 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:10.010505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-24d6f062-18a9-4188-89dd-a4d2b52ea949 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:10.010832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-24d6f062-18a9-4188-89dd-a4d2b52ea949 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1810 microversion: 2.20 time: 0.253998 Sep 01 05:17:10.011374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 216/393] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:09 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1810 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:10.098101 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-aa92342d-4186-4d75-9c01-de741dd81230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:10.106469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-aa92342d-4186-4d75-9c01-de741dd81230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.187705 Sep 01 05:17:10.107107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 178/394] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:09 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:10.222799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a962b27e-216a-4512-9d6b-9c16161ab8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:10.223410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a962b27e-216a-4512-9d6b-9c16161ab8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:10.229287 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a962b27e-216a-4512-9d6b-9c16161ab8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.229769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a962b27e-216a-4512-9d6b-9c16161ab8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.230203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a962b27e-216a-4512-9d6b-9c16161ab8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.230975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a962b27e-216a-4512-9d6b-9c16161ab8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.231431 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a962b27e-216a-4512-9d6b-9c16161ab8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.231915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a962b27e-216a-4512-9d6b-9c16161ab8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.366941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a962b27e-216a-4512-9d6b-9c16161ab8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:10.375455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a962b27e-216a-4512-9d6b-9c16161ab8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.157179 Sep 01 05:17:10.376048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 217/395] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:10 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:10.440020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-511c06f2-6284-4675-a5c8-77f6f0c7594c tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:10.440702 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-511c06f2-6284-4675-a5c8-77f6f0c7594c tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:10.446963 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-511c06f2-6284-4675-a5c8-77f6f0c7594c tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.447450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-511c06f2-6284-4675-a5c8-77f6f0c7594c tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.447881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-511c06f2-6284-4675-a5c8-77f6f0c7594c tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.448561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-511c06f2-6284-4675-a5c8-77f6f0c7594c tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.449045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-511c06f2-6284-4675-a5c8-77f6f0c7594c tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.449461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-511c06f2-6284-4675-a5c8-77f6f0c7594c tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.622588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-511c06f2-6284-4675-a5c8-77f6f0c7594c tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:10.632523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-511c06f2-6284-4675-a5c8-77f6f0c7594c tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1464 microversion: 2.1 time: 0.196170 Sep 01 05:17:10.633552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 179/396] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:10 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1464 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:10.682170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5aeb171c-d576-4735-8b84-5e9854918da5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:10.682884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5aeb171c-d576-4735-8b84-5e9854918da5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:10.693953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5aeb171c-d576-4735-8b84-5e9854918da5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.694913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5aeb171c-d576-4735-8b84-5e9854918da5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.696326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5aeb171c-d576-4735-8b84-5e9854918da5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.697528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5aeb171c-d576-4735-8b84-5e9854918da5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.698128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5aeb171c-d576-4735-8b84-5e9854918da5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.698696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5aeb171c-d576-4735-8b84-5e9854918da5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.736283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5aeb171c-d576-4735-8b84-5e9854918da5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Going to try to terminate instance {{(pid=120674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:17:10.838665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5aeb171c-d576-4735-8b84-5e9854918da5 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "DELETE /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 204 len: 0 microversion: 2.1 time: 0.160686 Sep 01 05:17:10.839240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 218/397] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:17:10 2022] DELETE /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:10.847873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-56b5d60b-070b-41d9-892a-f71af4ce47ef tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:10.848619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-56b5d60b-070b-41d9-892a-f71af4ce47ef tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:10.851747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:10.856378 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56b5d60b-070b-41d9-892a-f71af4ce47ef tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.857001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56b5d60b-070b-41d9-892a-f71af4ce47ef tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.857529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56b5d60b-070b-41d9-892a-f71af4ce47ef tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.858315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56b5d60b-070b-41d9-892a-f71af4ce47ef tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.858856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56b5d60b-070b-41d9-892a-f71af4ce47ef tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.859591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56b5d60b-070b-41d9-892a-f71af4ce47ef tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.943357 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-864260c8-f318-4760-ab65-4404f45940a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:10.944463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-864260c8-f318-4760-ab65-4404f45940a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:10.950963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-864260c8-f318-4760-ab65-4404f45940a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.951536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-864260c8-f318-4760-ab65-4404f45940a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.952035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-864260c8-f318-4760-ab65-4404f45940a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.952845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-864260c8-f318-4760-ab65-4404f45940a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.953294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-864260c8-f318-4760-ab65-4404f45940a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.953708 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-864260c8-f318-4760-ab65-4404f45940a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:11.051398 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-56b5d60b-070b-41d9-892a-f71af4ce47ef tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:11.060754 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-56b5d60b-070b-41d9-892a-f71af4ce47ef tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1470 microversion: 2.1 time: 0.217091 Sep 01 05:17:11.061796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 180/398] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:10 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:11.067912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-1d645b61-b2d5-49bf-9b32-0ef9c87a3b24 req-ffdd332f-6d9f-4daf-8753-64818a16a38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a582556-d184-4047-ac19-285c0edd2fdf", "name": "network-vif-unplugged", "status": "completed", "tag": "6e571bd8-c64a-432f-894b-026d58cce109"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:11.077785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-1d645b61-b2d5-49bf-9b32-0ef9c87a3b24 req-ffdd332f-6d9f-4daf-8753-64818a16a38c service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:11.078723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-1d645b61-b2d5-49bf-9b32-0ef9c87a3b24 req-ffdd332f-6d9f-4daf-8753-64818a16a38c service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:11.078723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-1d645b61-b2d5-49bf-9b32-0ef9c87a3b24 req-ffdd332f-6d9f-4daf-8753-64818a16a38c service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:11.091280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.compute.server_external_events [req-1d645b61-b2d5-49bf-9b32-0ef9c87a3b24 req-ffdd332f-6d9f-4daf-8753-64818a16a38c service nova] Unable to find a host for instance 2a582556-d184-4047-ac19-285c0edd2fdf. Dropping event network-vif-unplugged {{(pid=120673) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 05:17:11.092176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-1d645b61-b2d5-49bf-9b32-0ef9c87a3b24 req-ffdd332f-6d9f-4daf-8753-64818a16a38c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028784 Sep 01 05:17:11.092765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 181/399] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 05:17:11.097438 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-23e4a242-015e-47f0-9fcd-7b12c48efb4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:11.098011 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-23e4a242-015e-47f0-9fcd-7b12c48efb4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:11.103072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-864260c8-f318-4760-ab65-4404f45940a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:11.104243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23e4a242-015e-47f0-9fcd-7b12c48efb4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:11.105049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23e4a242-015e-47f0-9fcd-7b12c48efb4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:11.105484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23e4a242-015e-47f0-9fcd-7b12c48efb4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:11.106532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23e4a242-015e-47f0-9fcd-7b12c48efb4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:11.107577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23e4a242-015e-47f0-9fcd-7b12c48efb4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:11.108639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23e4a242-015e-47f0-9fcd-7b12c48efb4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:11.111504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-864260c8-f318-4760-ab65-4404f45940a0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.173453 Sep 01 05:17:11.112162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 219/400] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:11.131022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9128994b-4939-44f7-a61e-1f0fe3b28351 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:11.131763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9128994b-4939-44f7-a61e-1f0fe3b28351 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:11.139764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9128994b-4939-44f7-a61e-1f0fe3b28351 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:11.140334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9128994b-4939-44f7-a61e-1f0fe3b28351 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:11.140870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9128994b-4939-44f7-a61e-1f0fe3b28351 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:11.141628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9128994b-4939-44f7-a61e-1f0fe3b28351 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:11.142151 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9128994b-4939-44f7-a61e-1f0fe3b28351 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:11.142659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9128994b-4939-44f7-a61e-1f0fe3b28351 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:11.285465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9128994b-4939-44f7-a61e-1f0fe3b28351 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:11.293257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9128994b-4939-44f7-a61e-1f0fe3b28351 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.169231 Sep 01 05:17:11.293827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 220/401] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:11 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:11.308662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-23e4a242-015e-47f0-9fcd-7b12c48efb4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:11.317935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-23e4a242-015e-47f0-9fcd-7b12c48efb4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:11.319492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-23e4a242-015e-47f0-9fcd-7b12c48efb4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:11.320696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-23e4a242-015e-47f0-9fcd-7b12c48efb4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1750 microversion: 2.20 time: 0.227000 Sep 01 05:17:11.321282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 182/402] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1750 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:11.399310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dc858c6e-c7c8-4bc4-ae78-a92d709959fd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:11.400163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dc858c6e-c7c8-4bc4-ae78-a92d709959fd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:11.406413 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc858c6e-c7c8-4bc4-ae78-a92d709959fd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:11.406979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc858c6e-c7c8-4bc4-ae78-a92d709959fd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:11.407483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc858c6e-c7c8-4bc4-ae78-a92d709959fd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:11.408181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc858c6e-c7c8-4bc4-ae78-a92d709959fd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:11.408629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc858c6e-c7c8-4bc4-ae78-a92d709959fd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:11.409086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc858c6e-c7c8-4bc4-ae78-a92d709959fd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:11.554823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dc858c6e-c7c8-4bc4-ae78-a92d709959fd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:11.563927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dc858c6e-c7c8-4bc4-ae78-a92d709959fd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.169667 Sep 01 05:17:11.564826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 221/403] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:11 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:12.084057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-38e4b129-bf66-4968-9438-d784c660b84f tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:12.084586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-38e4b129-bf66-4968-9438-d784c660b84f tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:12.091060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38e4b129-bf66-4968-9438-d784c660b84f tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.091532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38e4b129-bf66-4968-9438-d784c660b84f tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.091964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38e4b129-bf66-4968-9438-d784c660b84f tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.092636 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38e4b129-bf66-4968-9438-d784c660b84f tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.093119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38e4b129-bf66-4968-9438-d784c660b84f tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.093536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38e4b129-bf66-4968-9438-d784c660b84f tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.132599 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-914b2f13-c2e0-4562-9a88-3f0288a4f830 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:12.133248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-914b2f13-c2e0-4562-9a88-3f0288a4f830 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:12.139690 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-914b2f13-c2e0-4562-9a88-3f0288a4f830 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.140172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-914b2f13-c2e0-4562-9a88-3f0288a4f830 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.140607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-914b2f13-c2e0-4562-9a88-3f0288a4f830 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.141343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-914b2f13-c2e0-4562-9a88-3f0288a4f830 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.141793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-914b2f13-c2e0-4562-9a88-3f0288a4f830 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.142213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-914b2f13-c2e0-4562-9a88-3f0288a4f830 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.225718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-38e4b129-bf66-4968-9438-d784c660b84f tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:12.233407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-38e4b129-bf66-4968-9438-d784c660b84f tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1470 microversion: 2.1 time: 0.154354 Sep 01 05:17:12.234132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 183/404] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:12 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:12.276092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-914b2f13-c2e0-4562-9a88-3f0288a4f830 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:12.283660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-914b2f13-c2e0-4562-9a88-3f0288a4f830 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.154870 Sep 01 05:17:12.284302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 222/405] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:12 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:12.314116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7be5e6a3-81d2-493b-b005-289fa6252aa0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:12.314769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7be5e6a3-81d2-493b-b005-289fa6252aa0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:12.321185 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7be5e6a3-81d2-493b-b005-289fa6252aa0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.321668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7be5e6a3-81d2-493b-b005-289fa6252aa0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.322099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7be5e6a3-81d2-493b-b005-289fa6252aa0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.322779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7be5e6a3-81d2-493b-b005-289fa6252aa0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.323228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7be5e6a3-81d2-493b-b005-289fa6252aa0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.323646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7be5e6a3-81d2-493b-b005-289fa6252aa0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.343349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-97206d6f-4ede-4aba-a534-0535ed0f40ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:12.343891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-97206d6f-4ede-4aba-a534-0535ed0f40ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:12.350394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97206d6f-4ede-4aba-a534-0535ed0f40ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.350874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97206d6f-4ede-4aba-a534-0535ed0f40ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.351303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97206d6f-4ede-4aba-a534-0535ed0f40ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.351984 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97206d6f-4ede-4aba-a534-0535ed0f40ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.352519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97206d6f-4ede-4aba-a534-0535ed0f40ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.352978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97206d6f-4ede-4aba-a534-0535ed0f40ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.462804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7be5e6a3-81d2-493b-b005-289fa6252aa0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:12.472447 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7be5e6a3-81d2-493b-b005-289fa6252aa0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.161555 Sep 01 05:17:12.473820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 184/406] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:12 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:12.498392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-97206d6f-4ede-4aba-a534-0535ed0f40ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:12.507393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-97206d6f-4ede-4aba-a534-0535ed0f40ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:12.509061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-97206d6f-4ede-4aba-a534-0535ed0f40ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:12.510520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-97206d6f-4ede-4aba-a534-0535ed0f40ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1750 microversion: 2.20 time: 0.171006 Sep 01 05:17:12.517019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 223/407] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:12 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:17:12.586983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e81a3ee1-cc48-4e75-9dc6-17440fdc94d4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:12.587592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e81a3ee1-cc48-4e75-9dc6-17440fdc94d4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:12.593845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e81a3ee1-cc48-4e75-9dc6-17440fdc94d4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.594263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e81a3ee1-cc48-4e75-9dc6-17440fdc94d4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.594689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e81a3ee1-cc48-4e75-9dc6-17440fdc94d4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.595360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e81a3ee1-cc48-4e75-9dc6-17440fdc94d4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.595796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e81a3ee1-cc48-4e75-9dc6-17440fdc94d4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.596212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e81a3ee1-cc48-4e75-9dc6-17440fdc94d4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.727176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e81a3ee1-cc48-4e75-9dc6-17440fdc94d4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:12.735466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e81a3ee1-cc48-4e75-9dc6-17440fdc94d4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1725 microversion: 2.1 time: 0.152765 Sep 01 05:17:12.736098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 185/408] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:12 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:13.107282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-9254b9b3-a0bd-4179-ab8c-2f9c2a54d389 req-985228ce-02ff-4ca7-a2b2-e1471396cc8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bb9b74-29c0-41d4-ba39-285c01125cdf", "name": "network-vif-plugged", "status": "completed", "tag": "494e85a1-0d9d-420c-8314-4df8b9a07670"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:13.116810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9254b9b3-a0bd-4179-ab8c-2f9c2a54d389 req-985228ce-02ff-4ca7-a2b2-e1471396cc8c service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.117286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9254b9b3-a0bd-4179-ab8c-2f9c2a54d389 req-985228ce-02ff-4ca7-a2b2-e1471396cc8c service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.117712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9254b9b3-a0bd-4179-ab8c-2f9c2a54d389 req-985228ce-02ff-4ca7-a2b2-e1471396cc8c service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.128803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-9254b9b3-a0bd-4179-ab8c-2f9c2a54d389 req-985228ce-02ff-4ca7-a2b2-e1471396cc8c service nova] Creating event network-vif-plugged:494e85a1-0d9d-420c-8314-4df8b9a07670 for instance e6bb9b74-29c0-41d4-ba39-285c01125cdf on hv-cinder-85391 Sep 01 05:17:13.133537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-9254b9b3-a0bd-4179-ab8c-2f9c2a54d389 req-985228ce-02ff-4ca7-a2b2-e1471396cc8c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030123 Sep 01 05:17:13.134128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 224/409] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:13.255346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-575081db-75e0-41cc-ae70-3fcd68053e55 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:13.255984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-575081db-75e0-41cc-ae70-3fcd68053e55 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:13.262546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-575081db-75e0-41cc-ae70-3fcd68053e55 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.263016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-575081db-75e0-41cc-ae70-3fcd68053e55 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.263441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-575081db-75e0-41cc-ae70-3fcd68053e55 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.264117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-575081db-75e0-41cc-ae70-3fcd68053e55 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.264564 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-575081db-75e0-41cc-ae70-3fcd68053e55 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.265008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-575081db-75e0-41cc-ae70-3fcd68053e55 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.306391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9c887f2c-6519-4b4c-b86e-fefcb399c222 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:13.307376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9c887f2c-6519-4b4c-b86e-fefcb399c222 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:13.313621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c887f2c-6519-4b4c-b86e-fefcb399c222 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.314109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c887f2c-6519-4b4c-b86e-fefcb399c222 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.314547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c887f2c-6519-4b4c-b86e-fefcb399c222 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.315241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c887f2c-6519-4b4c-b86e-fefcb399c222 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.316264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c887f2c-6519-4b4c-b86e-fefcb399c222 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.316697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c887f2c-6519-4b4c-b86e-fefcb399c222 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.401695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-575081db-75e0-41cc-ae70-3fcd68053e55 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:13.409652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-575081db-75e0-41cc-ae70-3fcd68053e55 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1470 microversion: 2.1 time: 0.158619 Sep 01 05:17:13.410217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 186/410] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:13 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:13.447482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9c887f2c-6519-4b4c-b86e-fefcb399c222 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:13.455204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9c887f2c-6519-4b4c-b86e-fefcb399c222 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.153436 Sep 01 05:17:13.455754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 225/411] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:13.492792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cda19972-913a-45f0-9060-7ed19d155d2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:13.493422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cda19972-913a-45f0-9060-7ed19d155d2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:13.499210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cda19972-913a-45f0-9060-7ed19d155d2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.499688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cda19972-913a-45f0-9060-7ed19d155d2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.500141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cda19972-913a-45f0-9060-7ed19d155d2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.500842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cda19972-913a-45f0-9060-7ed19d155d2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.501287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cda19972-913a-45f0-9060-7ed19d155d2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.501697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cda19972-913a-45f0-9060-7ed19d155d2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.533135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c1413732-7254-42eb-a112-894f71ea7b48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:13.533846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c1413732-7254-42eb-a112-894f71ea7b48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:13.539909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1413732-7254-42eb-a112-894f71ea7b48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.540387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1413732-7254-42eb-a112-894f71ea7b48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.540834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1413732-7254-42eb-a112-894f71ea7b48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.541517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1413732-7254-42eb-a112-894f71ea7b48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.541962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1413732-7254-42eb-a112-894f71ea7b48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.542378 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1413732-7254-42eb-a112-894f71ea7b48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.635072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cda19972-913a-45f0-9060-7ed19d155d2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:13.642583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cda19972-913a-45f0-9060-7ed19d155d2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.153605 Sep 01 05:17:13.643146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 187/412] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:13 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:13.673999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c1413732-7254-42eb-a112-894f71ea7b48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:13.682743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c1413732-7254-42eb-a112-894f71ea7b48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:13.684181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c1413732-7254-42eb-a112-894f71ea7b48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:13.685363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c1413732-7254-42eb-a112-894f71ea7b48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1752 microversion: 2.20 time: 0.156137 Sep 01 05:17:13.685914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 226/413] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:13 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:17:13.756989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f0a8df66-975c-4eaf-aeb2-9fccc9d7af39 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:13.757594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f0a8df66-975c-4eaf-aeb2-9fccc9d7af39 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:13.763593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0a8df66-975c-4eaf-aeb2-9fccc9d7af39 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.764074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0a8df66-975c-4eaf-aeb2-9fccc9d7af39 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.764493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0a8df66-975c-4eaf-aeb2-9fccc9d7af39 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.765261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0a8df66-975c-4eaf-aeb2-9fccc9d7af39 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.765712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0a8df66-975c-4eaf-aeb2-9fccc9d7af39 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.766126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0a8df66-975c-4eaf-aeb2-9fccc9d7af39 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.897608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f0a8df66-975c-4eaf-aeb2-9fccc9d7af39 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:13.906760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f0a8df66-975c-4eaf-aeb2-9fccc9d7af39 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1702 microversion: 2.1 time: 0.153848 Sep 01 05:17:13.907395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 188/414] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:13 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1702 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:13.930304 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fcf32811-a20a-43c4-8c54-736dabd982fb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:13.936387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fcf32811-a20a-43c4-8c54-736dabd982fb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.936889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fcf32811-a20a-43c4-8c54-736dabd982fb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.937321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fcf32811-a20a-43c4-8c54-736dabd982fb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.960204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fcf32811-a20a-43c4-8c54-736dabd982fb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Going to try to start instance {{(pid=120674) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 05:17:14.007950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fcf32811-a20a-43c4-8c54-736dabd982fb tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "POST /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/action" status: 202 len: 0 microversion: 2.1 time: 0.081454 Sep 01 05:17:14.008642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 227/415] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:17:13 2022] POST /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:17:14.016659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f0507fa6-2a68-467e-9814-a9eaa38f5f2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:14.017300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f0507fa6-2a68-467e-9814-a9eaa38f5f2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:14.025972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0507fa6-2a68-467e-9814-a9eaa38f5f2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:14.026535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0507fa6-2a68-467e-9814-a9eaa38f5f2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:14.027025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0507fa6-2a68-467e-9814-a9eaa38f5f2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.027772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0507fa6-2a68-467e-9814-a9eaa38f5f2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:14.028294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0507fa6-2a68-467e-9814-a9eaa38f5f2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:14.028793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0507fa6-2a68-467e-9814-a9eaa38f5f2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.164935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f0507fa6-2a68-467e-9814-a9eaa38f5f2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:14.173277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f0507fa6-2a68-467e-9814-a9eaa38f5f2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1711 microversion: 2.1 time: 0.160360 Sep 01 05:17:14.173835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 189/416] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:14 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:14.432377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cbb375e6-1935-4701-a9fa-7db05f1b1865 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:14.433110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cbb375e6-1935-4701-a9fa-7db05f1b1865 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:14.439161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbb375e6-1935-4701-a9fa-7db05f1b1865 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:14.439640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbb375e6-1935-4701-a9fa-7db05f1b1865 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:14.440076 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbb375e6-1935-4701-a9fa-7db05f1b1865 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.440855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbb375e6-1935-4701-a9fa-7db05f1b1865 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:14.441308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbb375e6-1935-4701-a9fa-7db05f1b1865 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:14.441725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbb375e6-1935-4701-a9fa-7db05f1b1865 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.481804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e0462be3-1676-4779-9fb3-bafa516d479a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:14.482420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e0462be3-1676-4779-9fb3-bafa516d479a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:14.488433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0462be3-1676-4779-9fb3-bafa516d479a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:14.488970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0462be3-1676-4779-9fb3-bafa516d479a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:14.489400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0462be3-1676-4779-9fb3-bafa516d479a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.490094 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0462be3-1676-4779-9fb3-bafa516d479a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:14.490544 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0462be3-1676-4779-9fb3-bafa516d479a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:14.490965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0462be3-1676-4779-9fb3-bafa516d479a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.573155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cbb375e6-1935-4701-a9fa-7db05f1b1865 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:14.577050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:14.582492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cbb375e6-1935-4701-a9fa-7db05f1b1865 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1470 microversion: 2.1 time: 0.155185 Sep 01 05:17:14.583073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 228/417] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:14 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:14.620261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e0462be3-1676-4779-9fb3-bafa516d479a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:14.629046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e0462be3-1676-4779-9fb3-bafa516d479a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1368 microversion: 2.1 time: 0.155253 Sep 01 05:17:14.629618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 190/418] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:14 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:14.665491 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-185122ed-2e10-4a7d-9de5-e4718399d38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:14.666118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-185122ed-2e10-4a7d-9de5-e4718399d38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:14.673663 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-185122ed-2e10-4a7d-9de5-e4718399d38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:14.674148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-185122ed-2e10-4a7d-9de5-e4718399d38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:14.674584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-185122ed-2e10-4a7d-9de5-e4718399d38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.676107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-185122ed-2e10-4a7d-9de5-e4718399d38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:14.676565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-185122ed-2e10-4a7d-9de5-e4718399d38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:14.677022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-185122ed-2e10-4a7d-9de5-e4718399d38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.708237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-23fe2abd-93ce-4d82-9abf-e8ec3649a524 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:14.708884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-23fe2abd-93ce-4d82-9abf-e8ec3649a524 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:14.714880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23fe2abd-93ce-4d82-9abf-e8ec3649a524 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:14.715360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23fe2abd-93ce-4d82-9abf-e8ec3649a524 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:14.715784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23fe2abd-93ce-4d82-9abf-e8ec3649a524 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.716463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23fe2abd-93ce-4d82-9abf-e8ec3649a524 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:14.716949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23fe2abd-93ce-4d82-9abf-e8ec3649a524 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:14.717442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23fe2abd-93ce-4d82-9abf-e8ec3649a524 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.825563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-185122ed-2e10-4a7d-9de5-e4718399d38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:14.835314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-185122ed-2e10-4a7d-9de5-e4718399d38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.173878 Sep 01 05:17:14.835869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 229/419] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:14 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:14.866328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-23fe2abd-93ce-4d82-9abf-e8ec3649a524 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:14.876916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-23fe2abd-93ce-4d82-9abf-e8ec3649a524 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:14.880639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-23fe2abd-93ce-4d82-9abf-e8ec3649a524 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:14.882776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-23fe2abd-93ce-4d82-9abf-e8ec3649a524 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1752 microversion: 2.20 time: 0.178454 Sep 01 05:17:14.883406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 191/420] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:17:15.195526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8b86ce6f-9c28-4b4e-8a77-97937178d14d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:15.196159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8b86ce6f-9c28-4b4e-8a77-97937178d14d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:15.202167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b86ce6f-9c28-4b4e-8a77-97937178d14d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.202672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b86ce6f-9c28-4b4e-8a77-97937178d14d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.203099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b86ce6f-9c28-4b4e-8a77-97937178d14d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.203769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b86ce6f-9c28-4b4e-8a77-97937178d14d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.204212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b86ce6f-9c28-4b4e-8a77-97937178d14d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.204622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b86ce6f-9c28-4b4e-8a77-97937178d14d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.341576 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8b86ce6f-9c28-4b4e-8a77-97937178d14d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:15.349962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8b86ce6f-9c28-4b4e-8a77-97937178d14d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1711 microversion: 2.1 time: 0.158598 Sep 01 05:17:15.350535 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 230/421] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:15 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1711 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:15.603910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-400ecc57-1539-46f1-8dd2-07a709409411 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:15.604691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-400ecc57-1539-46f1-8dd2-07a709409411 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:15.611323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-400ecc57-1539-46f1-8dd2-07a709409411 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.611811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-400ecc57-1539-46f1-8dd2-07a709409411 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.612247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-400ecc57-1539-46f1-8dd2-07a709409411 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.613673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-400ecc57-1539-46f1-8dd2-07a709409411 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.614133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-400ecc57-1539-46f1-8dd2-07a709409411 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.614587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-400ecc57-1539-46f1-8dd2-07a709409411 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.650161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ec933764-85cd-4c0e-b379-83b1ff9e4ef2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:15.650983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ec933764-85cd-4c0e-b379-83b1ff9e4ef2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:15.658005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec933764-85cd-4c0e-b379-83b1ff9e4ef2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.658526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec933764-85cd-4c0e-b379-83b1ff9e4ef2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.659790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec933764-85cd-4c0e-b379-83b1ff9e4ef2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.660822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec933764-85cd-4c0e-b379-83b1ff9e4ef2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.661453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec933764-85cd-4c0e-b379-83b1ff9e4ef2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.662069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec933764-85cd-4c0e-b379-83b1ff9e4ef2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.762266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-400ecc57-1539-46f1-8dd2-07a709409411 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:15.770867 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-400ecc57-1539-46f1-8dd2-07a709409411 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1470 microversion: 2.1 time: 0.170873 Sep 01 05:17:15.771470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 192/422] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:15 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:15.802280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ec933764-85cd-4c0e-b379-83b1ff9e4ef2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:15.810980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ec933764-85cd-4c0e-b379-83b1ff9e4ef2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1562 microversion: 2.1 time: 0.164838 Sep 01 05:17:15.825169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 231/423] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:15.833568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-abff43eb-d7de-4d64-97fc-60e74b3b5d9c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:15.834143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-abff43eb-d7de-4d64-97fc-60e74b3b5d9c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:15.840059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-abff43eb-d7de-4d64-97fc-60e74b3b5d9c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.840548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-abff43eb-d7de-4d64-97fc-60e74b3b5d9c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.841600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-abff43eb-d7de-4d64-97fc-60e74b3b5d9c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.842503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-abff43eb-d7de-4d64-97fc-60e74b3b5d9c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.843187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-abff43eb-d7de-4d64-97fc-60e74b3b5d9c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.843616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-abff43eb-d7de-4d64-97fc-60e74b3b5d9c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.858442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c89d91a5-6c43-4db6-a827-1215d62f7e70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:15.859568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c89d91a5-6c43-4db6-a827-1215d62f7e70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:15.869386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c89d91a5-6c43-4db6-a827-1215d62f7e70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.870512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c89d91a5-6c43-4db6-a827-1215d62f7e70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.871278 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c89d91a5-6c43-4db6-a827-1215d62f7e70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.873172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c89d91a5-6c43-4db6-a827-1215d62f7e70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.873172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c89d91a5-6c43-4db6-a827-1215d62f7e70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.873886 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c89d91a5-6c43-4db6-a827-1215d62f7e70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.987256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-abff43eb-d7de-4d64-97fc-60e74b3b5d9c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157462 Sep 01 05:17:15.989722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 193/424] 10.222.0.49 () {58 vars in 1275 bytes} [Thu Sep 1 05:17:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:15.994162 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6ee258ab-d83c-4cb7-9e24-286a57a7b373 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:15.995210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6ee258ab-d83c-4cb7-9e24-286a57a7b373 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:16.002350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ee258ab-d83c-4cb7-9e24-286a57a7b373 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:16.003863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ee258ab-d83c-4cb7-9e24-286a57a7b373 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:16.004193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ee258ab-d83c-4cb7-9e24-286a57a7b373 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:16.005149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ee258ab-d83c-4cb7-9e24-286a57a7b373 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:16.005751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ee258ab-d83c-4cb7-9e24-286a57a7b373 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:16.006408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ee258ab-d83c-4cb7-9e24-286a57a7b373 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:16.223777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ee258ab-d83c-4cb7-9e24-286a57a7b373 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:16.232956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ee258ab-d83c-4cb7-9e24-286a57a7b373 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:16.234681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ee258ab-d83c-4cb7-9e24-286a57a7b373 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:16.235851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6ee258ab-d83c-4cb7-9e24-286a57a7b373 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1752 microversion: 2.20 time: 0.245763 Sep 01 05:17:16.236399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 194/425] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1752 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:16.337412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c89d91a5-6c43-4db6-a827-1215d62f7e70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:16.349673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c89d91a5-6c43-4db6-a827-1215d62f7e70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1318 microversion: 2.1 time: 0.496595 Sep 01 05:17:16.350385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 232/426] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:15 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:16.372040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-46d7d662-5cd9-450b-9561-6f432df5df2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:16.372932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-46d7d662-5cd9-450b-9561-6f432df5df2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:16.387677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d7d662-5cd9-450b-9561-6f432df5df2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:16.388424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d7d662-5cd9-450b-9561-6f432df5df2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:16.389068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d7d662-5cd9-450b-9561-6f432df5df2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:16.390721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d7d662-5cd9-450b-9561-6f432df5df2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:16.391875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d7d662-5cd9-450b-9561-6f432df5df2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:16.392465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d7d662-5cd9-450b-9561-6f432df5df2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:16.415158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:16.637208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-a8418a77-3315-42a5-80df-7a4a46f88c7a req-4aeecfb7-edf8-4ba2-afad-6dcc7f7305f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780c2682-f837-4a5e-a2e2-80436ce037bc", "name": "network-vif-deleted", "tag": "87bc312d-67fb-4c17-843d-d318bf7a37b0"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:16.648988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-a8418a77-3315-42a5-80df-7a4a46f88c7a req-4aeecfb7-edf8-4ba2-afad-6dcc7f7305f2 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:16.649663 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-a8418a77-3315-42a5-80df-7a4a46f88c7a req-4aeecfb7-edf8-4ba2-afad-6dcc7f7305f2 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:16.650090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-a8418a77-3315-42a5-80df-7a4a46f88c7a req-4aeecfb7-edf8-4ba2-afad-6dcc7f7305f2 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:16.663457 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-a8418a77-3315-42a5-80df-7a4a46f88c7a req-4aeecfb7-edf8-4ba2-afad-6dcc7f7305f2 service nova] Creating event network-vif-deleted:87bc312d-67fb-4c17-843d-d318bf7a37b0 for instance 780c2682-f837-4a5e-a2e2-80436ce037bc on hv-cinder-85391 Sep 01 05:17:16.669886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-46d7d662-5cd9-450b-9561-6f432df5df2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:16.673043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-a8418a77-3315-42a5-80df-7a4a46f88c7a req-4aeecfb7-edf8-4ba2-afad-6dcc7f7305f2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037127 Sep 01 05:17:16.673950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 233/427] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:17:16.680177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-46d7d662-5cd9-450b-9561-6f432df5df2d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1711 microversion: 2.1 time: 0.312770 Sep 01 05:17:16.685042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 195/428] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:16 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1711 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:16.794136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2092ac64-5848-4eca-9644-f37cee928813 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:16.795376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2092ac64-5848-4eca-9644-f37cee928813 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:16.803154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2092ac64-5848-4eca-9644-f37cee928813 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:16.803962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2092ac64-5848-4eca-9644-f37cee928813 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:16.804470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2092ac64-5848-4eca-9644-f37cee928813 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:16.805271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2092ac64-5848-4eca-9644-f37cee928813 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:16.805803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2092ac64-5848-4eca-9644-f37cee928813 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:16.806552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2092ac64-5848-4eca-9644-f37cee928813 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:16.904035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2092ac64-5848-4eca-9644-f37cee928813 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:16.912353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2092ac64-5848-4eca-9644-f37cee928813 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1428 microversion: 2.1 time: 0.123421 Sep 01 05:17:16.913426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 234/429] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:16 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:17.261497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fda9b653-3470-4d30-bda9-ec7e2053f6c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:17.262357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fda9b653-3470-4d30-bda9-ec7e2053f6c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:17.269929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fda9b653-3470-4d30-bda9-ec7e2053f6c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:17.270899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fda9b653-3470-4d30-bda9-ec7e2053f6c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:17.271843 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fda9b653-3470-4d30-bda9-ec7e2053f6c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:17.272749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fda9b653-3470-4d30-bda9-ec7e2053f6c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:17.273753 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fda9b653-3470-4d30-bda9-ec7e2053f6c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:17.274403 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fda9b653-3470-4d30-bda9-ec7e2053f6c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:17.374250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-be555208-f62f-4483-b8a8-2b0fd17ef0d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:17.375325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-be555208-f62f-4483-b8a8-2b0fd17ef0d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:17.382563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be555208-f62f-4483-b8a8-2b0fd17ef0d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:17.383153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be555208-f62f-4483-b8a8-2b0fd17ef0d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:17.383682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be555208-f62f-4483-b8a8-2b0fd17ef0d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:17.384587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be555208-f62f-4483-b8a8-2b0fd17ef0d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:17.385165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be555208-f62f-4483-b8a8-2b0fd17ef0d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:17.385773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be555208-f62f-4483-b8a8-2b0fd17ef0d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:17.434920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fda9b653-3470-4d30-bda9-ec7e2053f6c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:17.443757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fda9b653-3470-4d30-bda9-ec7e2053f6c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:17.445295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fda9b653-3470-4d30-bda9-ec7e2053f6c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:17.446536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fda9b653-3470-4d30-bda9-ec7e2053f6c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.190395 Sep 01 05:17:17.447171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 196/430] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:17 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:17.585880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-22694963-0a89-4077-811e-76c7104a4a3d req-6ecf0df5-33ca-430e-b6ff-bde2b32fd741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd99adb-f38e-4d43-82b1-529010509f72", "tag": "7ce60b54-510b-440d-9175-fd0f98028fab"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:17.590592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-be555208-f62f-4483-b8a8-2b0fd17ef0d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:17.596046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-22694963-0a89-4077-811e-76c7104a4a3d req-6ecf0df5-33ca-430e-b6ff-bde2b32fd741 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:17.597122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-22694963-0a89-4077-811e-76c7104a4a3d req-6ecf0df5-33ca-430e-b6ff-bde2b32fd741 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:17.597728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-22694963-0a89-4077-811e-76c7104a4a3d req-6ecf0df5-33ca-430e-b6ff-bde2b32fd741 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:17.599069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-be555208-f62f-4483-b8a8-2b0fd17ef0d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1506 microversion: 2.1 time: 0.230248 Sep 01 05:17:17.599650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 235/431] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:17 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:17.609552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-22694963-0a89-4077-811e-76c7104a4a3d req-6ecf0df5-33ca-430e-b6ff-bde2b32fd741 service nova] Creating event network-changed:7ce60b54-510b-440d-9175-fd0f98028fab for instance 5fd99adb-f38e-4d43-82b1-529010509f72 on hv-cinder-85391 Sep 01 05:17:17.615049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-22694963-0a89-4077-811e-76c7104a4a3d req-6ecf0df5-33ca-430e-b6ff-bde2b32fd741 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033662 Sep 01 05:17:17.624743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 197/432] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:17:17.707492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f7f02c23-4851-4d82-8f5e-cfea30f48b0e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:17.708703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f7f02c23-4851-4d82-8f5e-cfea30f48b0e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:17.715750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7f02c23-4851-4d82-8f5e-cfea30f48b0e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:17.717320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7f02c23-4851-4d82-8f5e-cfea30f48b0e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:17.717827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7f02c23-4851-4d82-8f5e-cfea30f48b0e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:17.718601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7f02c23-4851-4d82-8f5e-cfea30f48b0e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:17.720213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7f02c23-4851-4d82-8f5e-cfea30f48b0e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:17.720942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7f02c23-4851-4d82-8f5e-cfea30f48b0e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:17.934870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:17.936198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:17.951449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:17.952297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:17.952959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:17.953845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:17.954623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:17.956993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:18.036683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:18.037197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:18.037639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:18.038084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lazy-loading 'fault' on Instance uuid 780c2682-f837-4a5e-a2e2-80436ce037bc {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:17:18.134105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fda68a44cc4d3fafe47efeae45b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ad0860664064d458e631a81012ea795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:18.153615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e9e8e7b4-29ee-4c94-b1c7-c9c0734234c1 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 200 len: 1304 microversion: 2.1 time: 0.212747 Sep 01 05:17:18.160603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 198/433] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:17 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 1304 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:18.213283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f7f02c23-4851-4d82-8f5e-cfea30f48b0e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:18.224840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f7f02c23-4851-4d82-8f5e-cfea30f48b0e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1711 microversion: 2.1 time: 0.521818 Sep 01 05:17:18.225437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 236/434] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:17 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1711 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:18.470985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fe1c801c-fed1-41da-8c3b-46b4e754e5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:18.471660 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fe1c801c-fed1-41da-8c3b-46b4e754e5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:18.483932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe1c801c-fed1-41da-8c3b-46b4e754e5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:18.484663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe1c801c-fed1-41da-8c3b-46b4e754e5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:18.485151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe1c801c-fed1-41da-8c3b-46b4e754e5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:18.487711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe1c801c-fed1-41da-8c3b-46b4e754e5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:18.489667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe1c801c-fed1-41da-8c3b-46b4e754e5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:18.490111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe1c801c-fed1-41da-8c3b-46b4e754e5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:18.704159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fe1c801c-fed1-41da-8c3b-46b4e754e5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:18.715225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fe1c801c-fed1-41da-8c3b-46b4e754e5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:18.716930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fe1c801c-fed1-41da-8c3b-46b4e754e5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:18.718406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fe1c801c-fed1-41da-8c3b-46b4e754e5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.252195 Sep 01 05:17:18.719110 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 199/435] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:18 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:19.170182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d5801334-f5a5-4c9d-bd0a-ad56e8cdc653 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:19.170787 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d5801334-f5a5-4c9d-bd0a-ad56e8cdc653 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] [instance: 780c2682-f837-4a5e-a2e2-80436ce037bc] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:19.178401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5801334-f5a5-4c9d-bd0a-ad56e8cdc653 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:19.178890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5801334-f5a5-4c9d-bd0a-ad56e8cdc653 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:19.179549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5801334-f5a5-4c9d-bd0a-ad56e8cdc653 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:19.180444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5801334-f5a5-4c9d-bd0a-ad56e8cdc653 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:19.181301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5801334-f5a5-4c9d-bd0a-ad56e8cdc653 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:19.181723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5801334-f5a5-4c9d-bd0a-ad56e8cdc653 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:19.196078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-d5801334-f5a5-4c9d-bd0a-ad56e8cdc653 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] HTTP exception thrown: Instance 780c2682-f837-4a5e-a2e2-80436ce037bc could not be found. Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d5801334-f5a5-4c9d-bd0a-ad56e8cdc653 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Request method failure captured: Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc HTTP/1.1 Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEAyWQ80pdyncXqqy_p2n7IXdStxnjOqfXUJPf2DEMcFLMhvu5mNxsEahGarnEzOB4xoAq5BZKz73shWHk1pZs8AdGHNVbrLctANNrdT2DsGls95UWzpWt6mHQnY9EUx-nOWCneptgkY4853_IDmoPu9_YePA8K0UoLvssuLzsdiWVc Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 2ad0860664064d458e631a81012ea795 Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-VolumesNegativeTest-1807051806 Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:17:19.198846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:17:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2ad0860664064d458e631a81012ea795", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ad0860664064d458e631a81012ea795"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ad0860664064d458e631a81012ea795"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2ad0860664064d458e631a81012ea795"}]}] Sep 01 05:17:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-VolumesNegativeTest-1807051806 Sep 01 05:17:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 2ad0860664064d458e631a81012ea795 Sep 01 05:17:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-VolumesNegativeTest-1807051806 Sep 01 05:17:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-VolumesNegativeTest-1807051806-project Sep 01 05:17:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:17:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:17:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 63fda68a44cc4d3fafe47efeae45b015 Sep 01 05:17:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-VolumesNegativeTest-1807051806-project Sep 01 05:17:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:17:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance 780c2682-f837-4a5e-a2e2-80436ce037bc could not be found. Sep 01 05:17:19.200258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '780c2682-f837-4a5e-a2e2-80436ce037bc'} Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 780c2682-f837-4a5e-a2e2-80436ce037bc could not be found. Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:19.201069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 780c2682-f837-4a5e-a2e2-80436ce037bc could not be found. Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 780c2682-f837-4a5e-a2e2-80436ce037bc could not be found. Sep 01 05:17:19.202338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:17:19.203445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d5801334-f5a5-4c9d-bd0a-ad56e8cdc653 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] Returning 404 to user: Instance 780c2682-f837-4a5e-a2e2-80436ce037bc could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:19.203445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d5801334-f5a5-4c9d-bd0a-ad56e8cdc653 tempest-VolumesNegativeTest-1807051806 tempest-VolumesNegativeTest-1807051806-project] 10.222.0.49 "GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc" status: 404 len: 111 microversion: 2.1 time: 0.034992 Sep 01 05:17:19.203445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 237/436] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:19 2022] GET /compute/v2.1/servers/780c2682-f837-4a5e-a2e2-80436ce037bc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:17:19.247229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0cee5013-5150-44ae-adbb-9c7e00ae02a5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:19.248018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0cee5013-5150-44ae-adbb-9c7e00ae02a5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:19.256042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0cee5013-5150-44ae-adbb-9c7e00ae02a5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:19.256595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0cee5013-5150-44ae-adbb-9c7e00ae02a5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:19.257062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0cee5013-5150-44ae-adbb-9c7e00ae02a5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:19.257781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0cee5013-5150-44ae-adbb-9c7e00ae02a5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:19.258223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0cee5013-5150-44ae-adbb-9c7e00ae02a5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:19.258638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0cee5013-5150-44ae-adbb-9c7e00ae02a5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:19.551882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0cee5013-5150-44ae-adbb-9c7e00ae02a5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:19.561706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0cee5013-5150-44ae-adbb-9c7e00ae02a5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1715 microversion: 2.1 time: 0.319332 Sep 01 05:17:19.562489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 200/437] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:19 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1715 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:19.746237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-06a0e8d0-8241-4b7d-95f0-3e9ab1f4b062 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:19.746847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-06a0e8d0-8241-4b7d-95f0-3e9ab1f4b062 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:19.753665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06a0e8d0-8241-4b7d-95f0-3e9ab1f4b062 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:19.754338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06a0e8d0-8241-4b7d-95f0-3e9ab1f4b062 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:19.755286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06a0e8d0-8241-4b7d-95f0-3e9ab1f4b062 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:19.755997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06a0e8d0-8241-4b7d-95f0-3e9ab1f4b062 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:19.756459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06a0e8d0-8241-4b7d-95f0-3e9ab1f4b062 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:19.756915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06a0e8d0-8241-4b7d-95f0-3e9ab1f4b062 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:19.900676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-06a0e8d0-8241-4b7d-95f0-3e9ab1f4b062 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:19.913614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-06a0e8d0-8241-4b7d-95f0-3e9ab1f4b062 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:19.915117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-06a0e8d0-8241-4b7d-95f0-3e9ab1f4b062 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:19.916321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-06a0e8d0-8241-4b7d-95f0-3e9ab1f4b062 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.174052 Sep 01 05:17:19.916905 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 238/438] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:19 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:20.941212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c16716f9-0342-445e-93e8-a56408b58035 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:20.941828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c16716f9-0342-445e-93e8-a56408b58035 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:20.948625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c16716f9-0342-445e-93e8-a56408b58035 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:20.949147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c16716f9-0342-445e-93e8-a56408b58035 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:20.949593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c16716f9-0342-445e-93e8-a56408b58035 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:20.950286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c16716f9-0342-445e-93e8-a56408b58035 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:20.950740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c16716f9-0342-445e-93e8-a56408b58035 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:20.951162 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c16716f9-0342-445e-93e8-a56408b58035 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:21.096759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c16716f9-0342-445e-93e8-a56408b58035 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:21.105603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c16716f9-0342-445e-93e8-a56408b58035 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:21.107044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c16716f9-0342-445e-93e8-a56408b58035 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:21.108179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c16716f9-0342-445e-93e8-a56408b58035 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.171438 Sep 01 05:17:21.108736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 201/439] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:22.131374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1c3ee2ca-e338-4e19-9f39-b834792b35e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:22.131985 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1c3ee2ca-e338-4e19-9f39-b834792b35e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:22.138524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c3ee2ca-e338-4e19-9f39-b834792b35e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:22.139005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c3ee2ca-e338-4e19-9f39-b834792b35e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:22.139439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c3ee2ca-e338-4e19-9f39-b834792b35e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:22.140121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c3ee2ca-e338-4e19-9f39-b834792b35e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:22.140571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c3ee2ca-e338-4e19-9f39-b834792b35e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:22.141028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c3ee2ca-e338-4e19-9f39-b834792b35e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:22.280437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1c3ee2ca-e338-4e19-9f39-b834792b35e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:22.289686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1c3ee2ca-e338-4e19-9f39-b834792b35e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:22.291126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1c3ee2ca-e338-4e19-9f39-b834792b35e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:22.292271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1c3ee2ca-e338-4e19-9f39-b834792b35e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.164855 Sep 01 05:17:22.292836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 239/440] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:23.315803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4d67f05b-4278-4329-93d0-a95dc8b6a285 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:23.316448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4d67f05b-4278-4329-93d0-a95dc8b6a285 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:23.323611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d67f05b-4278-4329-93d0-a95dc8b6a285 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:23.324092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d67f05b-4278-4329-93d0-a95dc8b6a285 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:23.324522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d67f05b-4278-4329-93d0-a95dc8b6a285 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:23.325255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d67f05b-4278-4329-93d0-a95dc8b6a285 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:23.325711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d67f05b-4278-4329-93d0-a95dc8b6a285 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:23.326131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d67f05b-4278-4329-93d0-a95dc8b6a285 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:23.458093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4d67f05b-4278-4329-93d0-a95dc8b6a285 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:23.466783 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4d67f05b-4278-4329-93d0-a95dc8b6a285 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:23.468220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4d67f05b-4278-4329-93d0-a95dc8b6a285 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:23.469400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4d67f05b-4278-4329-93d0-a95dc8b6a285 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.157521 Sep 01 05:17:23.469962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 202/441] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:24.492664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1ab80301-22fb-41ba-8ce0-64079809661e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:24.493287 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1ab80301-22fb-41ba-8ce0-64079809661e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:24.499815 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ab80301-22fb-41ba-8ce0-64079809661e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:24.500330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ab80301-22fb-41ba-8ce0-64079809661e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:24.500811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ab80301-22fb-41ba-8ce0-64079809661e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:24.501578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ab80301-22fb-41ba-8ce0-64079809661e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:24.502033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ab80301-22fb-41ba-8ce0-64079809661e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:24.502448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ab80301-22fb-41ba-8ce0-64079809661e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:24.649684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1ab80301-22fb-41ba-8ce0-64079809661e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:24.659606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1ab80301-22fb-41ba-8ce0-64079809661e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:24.661084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1ab80301-22fb-41ba-8ce0-64079809661e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:24.662264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1ab80301-22fb-41ba-8ce0-64079809661e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.174447 Sep 01 05:17:24.663408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 240/442] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:25.685946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3e10fd89-b45a-4ed7-a97b-7e63463327bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:25.686507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3e10fd89-b45a-4ed7-a97b-7e63463327bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:25.693504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3e10fd89-b45a-4ed7-a97b-7e63463327bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:25.695032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3e10fd89-b45a-4ed7-a97b-7e63463327bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:25.695283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3e10fd89-b45a-4ed7-a97b-7e63463327bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:25.696000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3e10fd89-b45a-4ed7-a97b-7e63463327bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:25.696455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3e10fd89-b45a-4ed7-a97b-7e63463327bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:25.696917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3e10fd89-b45a-4ed7-a97b-7e63463327bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:25.835318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3e10fd89-b45a-4ed7-a97b-7e63463327bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:25.843835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3e10fd89-b45a-4ed7-a97b-7e63463327bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:25.845289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3e10fd89-b45a-4ed7-a97b-7e63463327bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:25.847130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3e10fd89-b45a-4ed7-a97b-7e63463327bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.164694 Sep 01 05:17:25.847686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 203/443] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:26.874217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-37d214a5-792c-4948-af8c-ba128f59e15a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:26.875294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-37d214a5-792c-4948-af8c-ba128f59e15a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:26.882527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-37d214a5-792c-4948-af8c-ba128f59e15a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:26.883008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-37d214a5-792c-4948-af8c-ba128f59e15a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:26.883442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-37d214a5-792c-4948-af8c-ba128f59e15a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:26.884136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-37d214a5-792c-4948-af8c-ba128f59e15a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:26.884585 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-37d214a5-792c-4948-af8c-ba128f59e15a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:26.885042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-37d214a5-792c-4948-af8c-ba128f59e15a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:27.029111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-37d214a5-792c-4948-af8c-ba128f59e15a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:27.038564 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-37d214a5-792c-4948-af8c-ba128f59e15a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:27.040017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-37d214a5-792c-4948-af8c-ba128f59e15a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:27.041302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-37d214a5-792c-4948-af8c-ba128f59e15a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.171567 Sep 01 05:17:27.041889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 241/444] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:28.066153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-863fa819-4276-4e80-bc26-6b395d012547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:28.066765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-863fa819-4276-4e80-bc26-6b395d012547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:28.073913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-863fa819-4276-4e80-bc26-6b395d012547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:28.074388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-863fa819-4276-4e80-bc26-6b395d012547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:28.074819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-863fa819-4276-4e80-bc26-6b395d012547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:28.075498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-863fa819-4276-4e80-bc26-6b395d012547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:28.075969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-863fa819-4276-4e80-bc26-6b395d012547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:28.076389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-863fa819-4276-4e80-bc26-6b395d012547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:28.216596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-863fa819-4276-4e80-bc26-6b395d012547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:28.225375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-863fa819-4276-4e80-bc26-6b395d012547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:28.226960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-863fa819-4276-4e80-bc26-6b395d012547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:28.228112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-863fa819-4276-4e80-bc26-6b395d012547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.165839 Sep 01 05:17:28.228663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 204/445] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:28 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:29.251629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-af594d22-9e82-4be2-82c7-11410dc2a130 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:29.252227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-af594d22-9e82-4be2-82c7-11410dc2a130 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:29.261234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af594d22-9e82-4be2-82c7-11410dc2a130 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:29.261722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af594d22-9e82-4be2-82c7-11410dc2a130 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:29.262158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af594d22-9e82-4be2-82c7-11410dc2a130 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:29.262863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af594d22-9e82-4be2-82c7-11410dc2a130 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:29.263311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af594d22-9e82-4be2-82c7-11410dc2a130 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:29.263726 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af594d22-9e82-4be2-82c7-11410dc2a130 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:29.404075 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-af594d22-9e82-4be2-82c7-11410dc2a130 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:29.412552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-af594d22-9e82-4be2-82c7-11410dc2a130 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:29.414041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-af594d22-9e82-4be2-82c7-11410dc2a130 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:29.415255 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-af594d22-9e82-4be2-82c7-11410dc2a130 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.167502 Sep 01 05:17:29.416101 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 242/446] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:29 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:30.442676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f5ac6509-afc8-4001-bc37-5684e237ccc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:30.443714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f5ac6509-afc8-4001-bc37-5684e237ccc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:30.451985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f5ac6509-afc8-4001-bc37-5684e237ccc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:30.452536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f5ac6509-afc8-4001-bc37-5684e237ccc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:30.453057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f5ac6509-afc8-4001-bc37-5684e237ccc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:30.454594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f5ac6509-afc8-4001-bc37-5684e237ccc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:30.455066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f5ac6509-afc8-4001-bc37-5684e237ccc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:30.455493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f5ac6509-afc8-4001-bc37-5684e237ccc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:30.593319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f5ac6509-afc8-4001-bc37-5684e237ccc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:30.602613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f5ac6509-afc8-4001-bc37-5684e237ccc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:30.604060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f5ac6509-afc8-4001-bc37-5684e237ccc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:30.605258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f5ac6509-afc8-4001-bc37-5684e237ccc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.167479 Sep 01 05:17:30.605807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 205/447] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:30 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:31.629347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f0c4d2c9-3016-426c-9808-b457f54f229b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:31.630019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f0c4d2c9-3016-426c-9808-b457f54f229b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:31.636597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0c4d2c9-3016-426c-9808-b457f54f229b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:31.637110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0c4d2c9-3016-426c-9808-b457f54f229b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:31.637543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0c4d2c9-3016-426c-9808-b457f54f229b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:31.638221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0c4d2c9-3016-426c-9808-b457f54f229b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:31.638670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0c4d2c9-3016-426c-9808-b457f54f229b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:31.639235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0c4d2c9-3016-426c-9808-b457f54f229b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:31.771248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f0c4d2c9-3016-426c-9808-b457f54f229b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:31.780868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f0c4d2c9-3016-426c-9808-b457f54f229b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:31.782384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f0c4d2c9-3016-426c-9808-b457f54f229b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:31.783636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f0c4d2c9-3016-426c-9808-b457f54f229b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.158911 Sep 01 05:17:31.784175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 243/448] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:32.805864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-689f4c4b-375d-4254-8108-c9ecf1585156 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:32.806705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-689f4c4b-375d-4254-8108-c9ecf1585156 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:32.814319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-689f4c4b-375d-4254-8108-c9ecf1585156 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:32.814793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-689f4c4b-375d-4254-8108-c9ecf1585156 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:32.815217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-689f4c4b-375d-4254-8108-c9ecf1585156 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:32.815893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-689f4c4b-375d-4254-8108-c9ecf1585156 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:32.816337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-689f4c4b-375d-4254-8108-c9ecf1585156 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:32.816750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-689f4c4b-375d-4254-8108-c9ecf1585156 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:32.949609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-689f4c4b-375d-4254-8108-c9ecf1585156 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:32.959291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-689f4c4b-375d-4254-8108-c9ecf1585156 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:32.960733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-689f4c4b-375d-4254-8108-c9ecf1585156 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:32.961908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-689f4c4b-375d-4254-8108-c9ecf1585156 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.159990 Sep 01 05:17:32.962455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 206/449] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:33.988852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a9e5371f-ae98-4359-b382-8ff59b9e51e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:33.989483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a9e5371f-ae98-4359-b382-8ff59b9e51e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:33.998646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a9e5371f-ae98-4359-b382-8ff59b9e51e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:34.000435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a9e5371f-ae98-4359-b382-8ff59b9e51e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:34.001117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a9e5371f-ae98-4359-b382-8ff59b9e51e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:34.002171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a9e5371f-ae98-4359-b382-8ff59b9e51e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:34.002816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a9e5371f-ae98-4359-b382-8ff59b9e51e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:34.003438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a9e5371f-ae98-4359-b382-8ff59b9e51e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:34.201217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a9e5371f-ae98-4359-b382-8ff59b9e51e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:34.213030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a9e5371f-ae98-4359-b382-8ff59b9e51e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:34.214903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a9e5371f-ae98-4359-b382-8ff59b9e51e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:34.217343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a9e5371f-ae98-4359-b382-8ff59b9e51e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.236255 Sep 01 05:17:34.218919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 244/450] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:35.248596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f6fb22fb-7ee0-4593-984a-51549415b7bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:35.249592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f6fb22fb-7ee0-4593-984a-51549415b7bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:35.257709 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f6fb22fb-7ee0-4593-984a-51549415b7bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:35.258395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f6fb22fb-7ee0-4593-984a-51549415b7bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:35.258985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f6fb22fb-7ee0-4593-984a-51549415b7bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:35.260095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f6fb22fb-7ee0-4593-984a-51549415b7bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:35.260701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f6fb22fb-7ee0-4593-984a-51549415b7bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:35.261297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f6fb22fb-7ee0-4593-984a-51549415b7bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:35.427738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f6fb22fb-7ee0-4593-984a-51549415b7bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:35.439041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f6fb22fb-7ee0-4593-984a-51549415b7bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:35.440499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f6fb22fb-7ee0-4593-984a-51549415b7bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:35.442411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f6fb22fb-7ee0-4593-984a-51549415b7bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.198659 Sep 01 05:17:35.449688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 207/451] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:36.475795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-af9af144-adb5-44a1-9547-2962347a0e70 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:36.476843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-af9af144-adb5-44a1-9547-2962347a0e70 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:36.480549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:36.484183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af9af144-adb5-44a1-9547-2962347a0e70 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:36.484928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af9af144-adb5-44a1-9547-2962347a0e70 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:36.485336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af9af144-adb5-44a1-9547-2962347a0e70 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:36.486220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af9af144-adb5-44a1-9547-2962347a0e70 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:36.487160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af9af144-adb5-44a1-9547-2962347a0e70 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:36.487739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af9af144-adb5-44a1-9547-2962347a0e70 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:36.694705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-af9af144-adb5-44a1-9547-2962347a0e70 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:36.705605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-af9af144-adb5-44a1-9547-2962347a0e70 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:36.707585 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-af9af144-adb5-44a1-9547-2962347a0e70 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:36.710257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-af9af144-adb5-44a1-9547-2962347a0e70 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.239598 Sep 01 05:17:36.710928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 245/452] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:37.742717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-32597980-8b2f-4dde-a07f-c9854b834b64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:37.744020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-32597980-8b2f-4dde-a07f-c9854b834b64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:37.751379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32597980-8b2f-4dde-a07f-c9854b834b64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:37.751871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32597980-8b2f-4dde-a07f-c9854b834b64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:37.752300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32597980-8b2f-4dde-a07f-c9854b834b64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:37.753127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32597980-8b2f-4dde-a07f-c9854b834b64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:37.753572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32597980-8b2f-4dde-a07f-c9854b834b64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:37.753991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32597980-8b2f-4dde-a07f-c9854b834b64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:37.900821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-32597980-8b2f-4dde-a07f-c9854b834b64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:37.910789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-32597980-8b2f-4dde-a07f-c9854b834b64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:37.912332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-32597980-8b2f-4dde-a07f-c9854b834b64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:37.913724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-32597980-8b2f-4dde-a07f-c9854b834b64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.181921 Sep 01 05:17:37.914530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 208/453] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:37 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:38.938382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0914852c-b9c5-49e1-ad13-a980ff4518b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:38.938978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0914852c-b9c5-49e1-ad13-a980ff4518b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:38.945341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0914852c-b9c5-49e1-ad13-a980ff4518b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:38.945774 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0914852c-b9c5-49e1-ad13-a980ff4518b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:38.946202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0914852c-b9c5-49e1-ad13-a980ff4518b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:38.946880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0914852c-b9c5-49e1-ad13-a980ff4518b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:38.947327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0914852c-b9c5-49e1-ad13-a980ff4518b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:38.947850 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0914852c-b9c5-49e1-ad13-a980ff4518b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:39.111774 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0914852c-b9c5-49e1-ad13-a980ff4518b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:39.115462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:39.123321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0914852c-b9c5-49e1-ad13-a980ff4518b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:39.126416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0914852c-b9c5-49e1-ad13-a980ff4518b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:39.128260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0914852c-b9c5-49e1-ad13-a980ff4518b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.194544 Sep 01 05:17:39.145092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 246/454] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:38 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:40.151479 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c11e7a54-9ac9-4854-b6e5-d2f2d95b2c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:40.152068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c11e7a54-9ac9-4854-b6e5-d2f2d95b2c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:40.158770 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c11e7a54-9ac9-4854-b6e5-d2f2d95b2c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:40.159244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c11e7a54-9ac9-4854-b6e5-d2f2d95b2c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:40.159668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c11e7a54-9ac9-4854-b6e5-d2f2d95b2c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:40.160337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c11e7a54-9ac9-4854-b6e5-d2f2d95b2c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:40.160803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c11e7a54-9ac9-4854-b6e5-d2f2d95b2c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:40.161213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c11e7a54-9ac9-4854-b6e5-d2f2d95b2c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:40.309825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c11e7a54-9ac9-4854-b6e5-d2f2d95b2c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:40.319342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c11e7a54-9ac9-4854-b6e5-d2f2d95b2c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:40.320814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c11e7a54-9ac9-4854-b6e5-d2f2d95b2c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:40.322007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c11e7a54-9ac9-4854-b6e5-d2f2d95b2c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.174433 Sep 01 05:17:40.322773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 209/455] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:41.345731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c82f30fd-37ab-410f-8dbd-7662a81490f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:41.346297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c82f30fd-37ab-410f-8dbd-7662a81490f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:41.352506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c82f30fd-37ab-410f-8dbd-7662a81490f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:41.353014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c82f30fd-37ab-410f-8dbd-7662a81490f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:41.353442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c82f30fd-37ab-410f-8dbd-7662a81490f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:41.354115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c82f30fd-37ab-410f-8dbd-7662a81490f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:41.354558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c82f30fd-37ab-410f-8dbd-7662a81490f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:41.354974 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c82f30fd-37ab-410f-8dbd-7662a81490f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:41.501005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c82f30fd-37ab-410f-8dbd-7662a81490f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:41.509616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c82f30fd-37ab-410f-8dbd-7662a81490f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:41.511059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c82f30fd-37ab-410f-8dbd-7662a81490f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:41.512218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c82f30fd-37ab-410f-8dbd-7662a81490f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.170837 Sep 01 05:17:41.512761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 247/456] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:42.537224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c929f56d-c1a8-4d7b-bdef-db183aa9e8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:42.537224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c929f56d-c1a8-4d7b-bdef-db183aa9e8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:42.537749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=61 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:42.542735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c929f56d-c1a8-4d7b-bdef-db183aa9e8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:42.543211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c929f56d-c1a8-4d7b-bdef-db183aa9e8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:42.543643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c929f56d-c1a8-4d7b-bdef-db183aa9e8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:42.544521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c929f56d-c1a8-4d7b-bdef-db183aa9e8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:42.545005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c929f56d-c1a8-4d7b-bdef-db183aa9e8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:42.545933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c929f56d-c1a8-4d7b-bdef-db183aa9e8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:42.706711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c929f56d-c1a8-4d7b-bdef-db183aa9e8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:42.716325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c929f56d-c1a8-4d7b-bdef-db183aa9e8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:42.718694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c929f56d-c1a8-4d7b-bdef-db183aa9e8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:42.719958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c929f56d-c1a8-4d7b-bdef-db183aa9e8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.189873 Sep 01 05:17:42.720592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 210/457] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:43.743624 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b6779e55-d705-4eca-bddf-f77ecd6688ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:43.744256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b6779e55-d705-4eca-bddf-f77ecd6688ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:43.750828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6779e55-d705-4eca-bddf-f77ecd6688ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:43.751310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6779e55-d705-4eca-bddf-f77ecd6688ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:43.751745 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6779e55-d705-4eca-bddf-f77ecd6688ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:43.752428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6779e55-d705-4eca-bddf-f77ecd6688ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:43.752906 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6779e55-d705-4eca-bddf-f77ecd6688ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:43.753328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6779e55-d705-4eca-bddf-f77ecd6688ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:43.897603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b6779e55-d705-4eca-bddf-f77ecd6688ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:43.906148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b6779e55-d705-4eca-bddf-f77ecd6688ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:43.907577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b6779e55-d705-4eca-bddf-f77ecd6688ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:43.908723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b6779e55-d705-4eca-bddf-f77ecd6688ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.169164 Sep 01 05:17:43.909291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 248/458] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:44.932028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bfef90a8-dd60-43e5-a49e-730c383a27c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:44.932663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bfef90a8-dd60-43e5-a49e-730c383a27c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:44.940429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfef90a8-dd60-43e5-a49e-730c383a27c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:44.941171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfef90a8-dd60-43e5-a49e-730c383a27c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:44.941603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfef90a8-dd60-43e5-a49e-730c383a27c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:44.942294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfef90a8-dd60-43e5-a49e-730c383a27c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:44.942740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfef90a8-dd60-43e5-a49e-730c383a27c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:44.943157 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfef90a8-dd60-43e5-a49e-730c383a27c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:45.076224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bfef90a8-dd60-43e5-a49e-730c383a27c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:45.086481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bfef90a8-dd60-43e5-a49e-730c383a27c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:45.087913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bfef90a8-dd60-43e5-a49e-730c383a27c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:45.089097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bfef90a8-dd60-43e5-a49e-730c383a27c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.161355 Sep 01 05:17:45.089651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 211/459] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:45.766797 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-72c42316-8c97-4b8a-ada8-e3b7d6bb9d49 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f63b51f-8661-4851-b26e-b5b2b741ec9a", "device": "/dev/sdb"}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:45.770367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-72c42316-8c97-4b8a-ada8-e3b7d6bb9d49 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:45.777251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72c42316-8c97-4b8a-ada8-e3b7d6bb9d49 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:45.777732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72c42316-8c97-4b8a-ada8-e3b7d6bb9d49 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:45.778168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72c42316-8c97-4b8a-ada8-e3b7d6bb9d49 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:45.778857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72c42316-8c97-4b8a-ada8-e3b7d6bb9d49 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:45.779308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72c42316-8c97-4b8a-ada8-e3b7d6bb9d49 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:45.779760 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72c42316-8c97-4b8a-ada8-e3b7d6bb9d49 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:46.113499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5588e658-8eef-4efa-b058-949469ad9b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:46.114649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5588e658-8eef-4efa-b058-949469ad9b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:46.121104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5588e658-8eef-4efa-b058-949469ad9b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:46.121587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5588e658-8eef-4efa-b058-949469ad9b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:46.122018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5588e658-8eef-4efa-b058-949469ad9b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:46.122698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5588e658-8eef-4efa-b058-949469ad9b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:46.123145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5588e658-8eef-4efa-b058-949469ad9b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:46.124142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5588e658-8eef-4efa-b058-949469ad9b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:46.142907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:46.267503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5588e658-8eef-4efa-b058-949469ad9b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:46.276634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5588e658-8eef-4efa-b058-949469ad9b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:46.278103 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5588e658-8eef-4efa-b058-949469ad9b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:46.279253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5588e658-8eef-4efa-b058-949469ad9b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.169660 Sep 01 05:17:46.280961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 212/460] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:17:47.304013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-004d7a76-9bd8-4cf9-ad4e-73288c9b2b38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:47.304630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-004d7a76-9bd8-4cf9-ad4e-73288c9b2b38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:47.311773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-004d7a76-9bd8-4cf9-ad4e-73288c9b2b38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.312253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-004d7a76-9bd8-4cf9-ad4e-73288c9b2b38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.312677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-004d7a76-9bd8-4cf9-ad4e-73288c9b2b38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.313381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-004d7a76-9bd8-4cf9-ad4e-73288c9b2b38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.313824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-004d7a76-9bd8-4cf9-ad4e-73288c9b2b38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.314242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-004d7a76-9bd8-4cf9-ad4e-73288c9b2b38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.445756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-004d7a76-9bd8-4cf9-ad4e-73288c9b2b38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:47.454363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-004d7a76-9bd8-4cf9-ad4e-73288c9b2b38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:47.455793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-004d7a76-9bd8-4cf9-ad4e-73288c9b2b38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:47.456979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-004d7a76-9bd8-4cf9-ad4e-73288c9b2b38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.157049 Sep 01 05:17:47.457531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 213/461] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:47 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:17:48.479870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a1717d79-366c-4179-8e0a-3fe955c751a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:48.480478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a1717d79-366c-4179-8e0a-3fe955c751a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:48.490183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1717d79-366c-4179-8e0a-3fe955c751a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:48.490669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1717d79-366c-4179-8e0a-3fe955c751a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:48.491099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1717d79-366c-4179-8e0a-3fe955c751a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:48.491777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1717d79-366c-4179-8e0a-3fe955c751a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:48.492220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1717d79-366c-4179-8e0a-3fe955c751a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:48.492632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1717d79-366c-4179-8e0a-3fe955c751a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:48.638787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a1717d79-366c-4179-8e0a-3fe955c751a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:48.651877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a1717d79-366c-4179-8e0a-3fe955c751a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:48.653390 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a1717d79-366c-4179-8e0a-3fe955c751a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:48.655440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a1717d79-366c-4179-8e0a-3fe955c751a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.178709 Sep 01 05:17:48.656267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 214/462] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:17:48.770485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-72c42316-8c97-4b8a-ada8-e3b7d6bb9d49 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "POST /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.006854 Sep 01 05:17:48.771342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 249/463] 10.222.0.49 () {60 vars in 1323 bytes} [Thu Sep 1 05:17:45 2022] POST /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf/os-volume_attachments => generated 194 bytes in 3009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:49.678502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2347aa04-1f81-4ff2-86a5-df09739e2ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:49.679113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2347aa04-1f81-4ff2-86a5-df09739e2ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:49.685676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2347aa04-1f81-4ff2-86a5-df09739e2ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:49.686871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2347aa04-1f81-4ff2-86a5-df09739e2ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:49.687375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2347aa04-1f81-4ff2-86a5-df09739e2ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:49.688054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2347aa04-1f81-4ff2-86a5-df09739e2ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:49.688502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2347aa04-1f81-4ff2-86a5-df09739e2ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:49.688950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2347aa04-1f81-4ff2-86a5-df09739e2ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:49.824328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2347aa04-1f81-4ff2-86a5-df09739e2ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:49.833921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2347aa04-1f81-4ff2-86a5-df09739e2ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:49.835366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2347aa04-1f81-4ff2-86a5-df09739e2ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:49.836525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2347aa04-1f81-4ff2-86a5-df09739e2ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.161901 Sep 01 05:17:49.837127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 215/464] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:49 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:50.861672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a86b1179-68dc-4b81-b32e-83521ee5ddb7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:50.862418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a86b1179-68dc-4b81-b32e-83521ee5ddb7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:50.869098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a86b1179-68dc-4b81-b32e-83521ee5ddb7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:50.869578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a86b1179-68dc-4b81-b32e-83521ee5ddb7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:50.870001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a86b1179-68dc-4b81-b32e-83521ee5ddb7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:50.870677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a86b1179-68dc-4b81-b32e-83521ee5ddb7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:50.871118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a86b1179-68dc-4b81-b32e-83521ee5ddb7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:50.871558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a86b1179-68dc-4b81-b32e-83521ee5ddb7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:51.020539 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a86b1179-68dc-4b81-b32e-83521ee5ddb7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:51.029196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a86b1179-68dc-4b81-b32e-83521ee5ddb7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:51.030693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a86b1179-68dc-4b81-b32e-83521ee5ddb7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:51.031846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a86b1179-68dc-4b81-b32e-83521ee5ddb7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.175691 Sep 01 05:17:51.032395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 250/465] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:52.055294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-21ebd448-c8f9-4ed0-bd1e-38695b6633e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:52.055937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-21ebd448-c8f9-4ed0-bd1e-38695b6633e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:52.063086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21ebd448-c8f9-4ed0-bd1e-38695b6633e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:52.063567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21ebd448-c8f9-4ed0-bd1e-38695b6633e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:52.063995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21ebd448-c8f9-4ed0-bd1e-38695b6633e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:52.064678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21ebd448-c8f9-4ed0-bd1e-38695b6633e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:52.065156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21ebd448-c8f9-4ed0-bd1e-38695b6633e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:52.065577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21ebd448-c8f9-4ed0-bd1e-38695b6633e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:52.197704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-21ebd448-c8f9-4ed0-bd1e-38695b6633e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:52.206859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-21ebd448-c8f9-4ed0-bd1e-38695b6633e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:52.208287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-21ebd448-c8f9-4ed0-bd1e-38695b6633e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:52.209464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-21ebd448-c8f9-4ed0-bd1e-38695b6633e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.158111 Sep 01 05:17:52.210024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 216/466] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:53.231594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e0cac729-50e5-44a5-8268-47fa8835d14f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:53.232202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e0cac729-50e5-44a5-8268-47fa8835d14f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:53.239552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0cac729-50e5-44a5-8268-47fa8835d14f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:53.240034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0cac729-50e5-44a5-8268-47fa8835d14f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:53.240469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0cac729-50e5-44a5-8268-47fa8835d14f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:53.241183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0cac729-50e5-44a5-8268-47fa8835d14f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:53.241632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0cac729-50e5-44a5-8268-47fa8835d14f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:53.242050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0cac729-50e5-44a5-8268-47fa8835d14f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:53.377506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e0cac729-50e5-44a5-8268-47fa8835d14f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:53.386170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e0cac729-50e5-44a5-8268-47fa8835d14f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:53.387725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e0cac729-50e5-44a5-8268-47fa8835d14f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:53.388940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e0cac729-50e5-44a5-8268-47fa8835d14f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.161254 Sep 01 05:17:53.389515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 251/467] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:54.412060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-22d6d59d-18cf-41fc-91b1-5718004a6e83 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:54.412654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-22d6d59d-18cf-41fc-91b1-5718004a6e83 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:54.419084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22d6d59d-18cf-41fc-91b1-5718004a6e83 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:54.419559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22d6d59d-18cf-41fc-91b1-5718004a6e83 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:54.421123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22d6d59d-18cf-41fc-91b1-5718004a6e83 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:54.421817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22d6d59d-18cf-41fc-91b1-5718004a6e83 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:54.422258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22d6d59d-18cf-41fc-91b1-5718004a6e83 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:54.422672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22d6d59d-18cf-41fc-91b1-5718004a6e83 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:54.574149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-22d6d59d-18cf-41fc-91b1-5718004a6e83 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:54.583001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-22d6d59d-18cf-41fc-91b1-5718004a6e83 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:54.584463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-22d6d59d-18cf-41fc-91b1-5718004a6e83 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:54.585650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-22d6d59d-18cf-41fc-91b1-5718004a6e83 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.177531 Sep 01 05:17:54.586240 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 217/468] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:55.608401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d012a873-7923-4577-9ce2-527c655b585f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:55.609741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d012a873-7923-4577-9ce2-527c655b585f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:55.616550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d012a873-7923-4577-9ce2-527c655b585f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:55.617064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d012a873-7923-4577-9ce2-527c655b585f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:55.617502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d012a873-7923-4577-9ce2-527c655b585f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:55.618198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d012a873-7923-4577-9ce2-527c655b585f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:55.618643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d012a873-7923-4577-9ce2-527c655b585f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:55.619106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d012a873-7923-4577-9ce2-527c655b585f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:55.754685 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d012a873-7923-4577-9ce2-527c655b585f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:55.763303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d012a873-7923-4577-9ce2-527c655b585f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:55.765779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d012a873-7923-4577-9ce2-527c655b585f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:55.766945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d012a873-7923-4577-9ce2-527c655b585f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.162825 Sep 01 05:17:55.767503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 252/469] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:56.789873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fdf83906-fdfc-4786-871b-0db47ca04197 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:56.790688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fdf83906-fdfc-4786-871b-0db47ca04197 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:56.798316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fdf83906-fdfc-4786-871b-0db47ca04197 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.798887 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fdf83906-fdfc-4786-871b-0db47ca04197 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.799327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fdf83906-fdfc-4786-871b-0db47ca04197 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:56.800024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fdf83906-fdfc-4786-871b-0db47ca04197 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.800469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fdf83906-fdfc-4786-871b-0db47ca04197 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.800939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fdf83906-fdfc-4786-871b-0db47ca04197 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:56.938324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fdf83906-fdfc-4786-871b-0db47ca04197 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:56.946987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fdf83906-fdfc-4786-871b-0db47ca04197 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:56.948652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fdf83906-fdfc-4786-871b-0db47ca04197 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:56.949972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fdf83906-fdfc-4786-871b-0db47ca04197 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.163963 Sep 01 05:17:56.950916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 218/470] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:57.973538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8efbc2b9-dcfe-4ba7-84ae-c57e6607c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:57.974137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8efbc2b9-dcfe-4ba7-84ae-c57e6607c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:57.980707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8efbc2b9-dcfe-4ba7-84ae-c57e6607c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:57.981221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8efbc2b9-dcfe-4ba7-84ae-c57e6607c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:57.981651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8efbc2b9-dcfe-4ba7-84ae-c57e6607c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:57.982331 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8efbc2b9-dcfe-4ba7-84ae-c57e6607c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:57.982929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8efbc2b9-dcfe-4ba7-84ae-c57e6607c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:57.983351 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8efbc2b9-dcfe-4ba7-84ae-c57e6607c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:58.111447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8efbc2b9-dcfe-4ba7-84ae-c57e6607c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:58.119916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8efbc2b9-dcfe-4ba7-84ae-c57e6607c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:58.121379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8efbc2b9-dcfe-4ba7-84ae-c57e6607c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:58.122529 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8efbc2b9-dcfe-4ba7-84ae-c57e6607c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.152873 Sep 01 05:17:58.123088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 253/471] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:17:58.645383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-f4e5a7b3-3fc7-40d7-a53c-8bf9fa66bfb8 req-f74f43f6-5083-4b6b-8516-13513eda1e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a582556-d184-4047-ac19-285c0edd2fdf", "name": "network-vif-plugged", "status": "completed", "tag": "6e571bd8-c64a-432f-894b-026d58cce109"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:58.655956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-f4e5a7b3-3fc7-40d7-a53c-8bf9fa66bfb8 req-f74f43f6-5083-4b6b-8516-13513eda1e1e service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:58.656460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-f4e5a7b3-3fc7-40d7-a53c-8bf9fa66bfb8 req-f74f43f6-5083-4b6b-8516-13513eda1e1e service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:58.657071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-f4e5a7b3-3fc7-40d7-a53c-8bf9fa66bfb8 req-f74f43f6-5083-4b6b-8516-13513eda1e1e service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:58.672003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-f4e5a7b3-3fc7-40d7-a53c-8bf9fa66bfb8 req-f74f43f6-5083-4b6b-8516-13513eda1e1e service nova] Creating event network-vif-plugged:6e571bd8-c64a-432f-894b-026d58cce109 for instance 2a582556-d184-4047-ac19-285c0edd2fdf on hv-cinder-85391 Sep 01 05:17:58.676910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-f4e5a7b3-3fc7-40d7-a53c-8bf9fa66bfb8 req-f74f43f6-5083-4b6b-8516-13513eda1e1e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035556 Sep 01 05:17:58.677515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 219/472] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:59.146496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-af1b05a6-4561-466a-9b56-62bc4ef0c68a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:59.147610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-af1b05a6-4561-466a-9b56-62bc4ef0c68a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:59.156970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af1b05a6-4561-466a-9b56-62bc4ef0c68a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:59.157457 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af1b05a6-4561-466a-9b56-62bc4ef0c68a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:59.157893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af1b05a6-4561-466a-9b56-62bc4ef0c68a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:59.158596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af1b05a6-4561-466a-9b56-62bc4ef0c68a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:59.159033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af1b05a6-4561-466a-9b56-62bc4ef0c68a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:59.159455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-af1b05a6-4561-466a-9b56-62bc4ef0c68a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:59.292605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-af1b05a6-4561-466a-9b56-62bc4ef0c68a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:59.302381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-af1b05a6-4561-466a-9b56-62bc4ef0c68a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:59.303833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-af1b05a6-4561-466a-9b56-62bc4ef0c68a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:59.305046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-af1b05a6-4561-466a-9b56-62bc4ef0c68a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.163657 Sep 01 05:17:59.305605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 254/473] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:17:59 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:00.329391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-08ded578-f4da-4896-b14c-473d76ac64db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:00.330093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-08ded578-f4da-4896-b14c-473d76ac64db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:00.336327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08ded578-f4da-4896-b14c-473d76ac64db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:00.336826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08ded578-f4da-4896-b14c-473d76ac64db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:00.337261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08ded578-f4da-4896-b14c-473d76ac64db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:00.337937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08ded578-f4da-4896-b14c-473d76ac64db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:00.338381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08ded578-f4da-4896-b14c-473d76ac64db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:00.338805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08ded578-f4da-4896-b14c-473d76ac64db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:00.467940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-08ded578-f4da-4896-b14c-473d76ac64db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:00.477192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-08ded578-f4da-4896-b14c-473d76ac64db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:00.478640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-08ded578-f4da-4896-b14c-473d76ac64db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:00.479795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-08ded578-f4da-4896-b14c-473d76ac64db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.155122 Sep 01 05:18:00.480345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 220/474] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:00 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:01.503047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a1e3a097-92b2-46ea-95f7-90ae9d38c5a8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:01.503657 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a1e3a097-92b2-46ea-95f7-90ae9d38c5a8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:01.510089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a1e3a097-92b2-46ea-95f7-90ae9d38c5a8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:01.510569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a1e3a097-92b2-46ea-95f7-90ae9d38c5a8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:01.511000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a1e3a097-92b2-46ea-95f7-90ae9d38c5a8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:01.511679 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a1e3a097-92b2-46ea-95f7-90ae9d38c5a8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:01.512128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a1e3a097-92b2-46ea-95f7-90ae9d38c5a8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:01.512550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a1e3a097-92b2-46ea-95f7-90ae9d38c5a8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:01.641502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a1e3a097-92b2-46ea-95f7-90ae9d38c5a8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:01.650072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a1e3a097-92b2-46ea-95f7-90ae9d38c5a8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:01.651498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a1e3a097-92b2-46ea-95f7-90ae9d38c5a8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:01.652638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a1e3a097-92b2-46ea-95f7-90ae9d38c5a8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.154107 Sep 01 05:18:01.653228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 255/475] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:02.676093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-708aec3d-cc0a-41ab-b78e-3c2df27e4693 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:02.676696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-708aec3d-cc0a-41ab-b78e-3c2df27e4693 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:02.683309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-708aec3d-cc0a-41ab-b78e-3c2df27e4693 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.683777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-708aec3d-cc0a-41ab-b78e-3c2df27e4693 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.684202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-708aec3d-cc0a-41ab-b78e-3c2df27e4693 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.684907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-708aec3d-cc0a-41ab-b78e-3c2df27e4693 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.685350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-708aec3d-cc0a-41ab-b78e-3c2df27e4693 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.685761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-708aec3d-cc0a-41ab-b78e-3c2df27e4693 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.815828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-708aec3d-cc0a-41ab-b78e-3c2df27e4693 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:02.824731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-708aec3d-cc0a-41ab-b78e-3c2df27e4693 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:02.826189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-708aec3d-cc0a-41ab-b78e-3c2df27e4693 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:02.827341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-708aec3d-cc0a-41ab-b78e-3c2df27e4693 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.155788 Sep 01 05:18:02.828016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 221/476] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:03.850398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1963ff81-ca9a-46f1-9b30-b26b816010ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:03.850921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1963ff81-ca9a-46f1-9b30-b26b816010ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:03.857692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1963ff81-ca9a-46f1-9b30-b26b816010ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:03.858184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1963ff81-ca9a-46f1-9b30-b26b816010ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:03.858620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1963ff81-ca9a-46f1-9b30-b26b816010ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:03.859313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1963ff81-ca9a-46f1-9b30-b26b816010ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:03.859788 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1963ff81-ca9a-46f1-9b30-b26b816010ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:03.860211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1963ff81-ca9a-46f1-9b30-b26b816010ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:03.992218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1963ff81-ca9a-46f1-9b30-b26b816010ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:04.001950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1963ff81-ca9a-46f1-9b30-b26b816010ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:04.003447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1963ff81-ca9a-46f1-9b30-b26b816010ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:04.004596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1963ff81-ca9a-46f1-9b30-b26b816010ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.158206 Sep 01 05:18:04.005176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 256/477] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:05.028213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-92458f8f-d4bb-4e2c-a6c8-b336549de182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:05.028848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-92458f8f-d4bb-4e2c-a6c8-b336549de182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:05.035280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92458f8f-d4bb-4e2c-a6c8-b336549de182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.035763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92458f8f-d4bb-4e2c-a6c8-b336549de182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.036189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92458f8f-d4bb-4e2c-a6c8-b336549de182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.037097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92458f8f-d4bb-4e2c-a6c8-b336549de182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.037706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92458f8f-d4bb-4e2c-a6c8-b336549de182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.038131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92458f8f-d4bb-4e2c-a6c8-b336549de182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.184880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-92458f8f-d4bb-4e2c-a6c8-b336549de182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:05.194729 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-92458f8f-d4bb-4e2c-a6c8-b336549de182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:05.196279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-92458f8f-d4bb-4e2c-a6c8-b336549de182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:05.197570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-92458f8f-d4bb-4e2c-a6c8-b336549de182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1808 microversion: 2.20 time: 0.173702 Sep 01 05:18:05.198112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 222/478] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:06.220619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2c2aeb66-c6b8-479f-95c0-9bb2f6f5bfbf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:06.221262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2c2aeb66-c6b8-479f-95c0-9bb2f6f5bfbf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:06.227752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c2aeb66-c6b8-479f-95c0-9bb2f6f5bfbf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.228236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c2aeb66-c6b8-479f-95c0-9bb2f6f5bfbf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.228671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c2aeb66-c6b8-479f-95c0-9bb2f6f5bfbf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.229391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c2aeb66-c6b8-479f-95c0-9bb2f6f5bfbf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.229849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c2aeb66-c6b8-479f-95c0-9bb2f6f5bfbf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.230288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c2aeb66-c6b8-479f-95c0-9bb2f6f5bfbf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.365594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2c2aeb66-c6b8-479f-95c0-9bb2f6f5bfbf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:06.374331 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2c2aeb66-c6b8-479f-95c0-9bb2f6f5bfbf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:06.375797 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2c2aeb66-c6b8-479f-95c0-9bb2f6f5bfbf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:06.376986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2c2aeb66-c6b8-479f-95c0-9bb2f6f5bfbf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1795 microversion: 2.20 time: 0.160466 Sep 01 05:18:06.377533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 257/479] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1795 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:12.727996 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cac4c200-27bf-456f-a755-cf0c99072748 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:12.729253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cac4c200-27bf-456f-a755-cf0c99072748 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:12.742236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=26 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:12.746401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cac4c200-27bf-456f-a755-cf0c99072748 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:12.747732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cac4c200-27bf-456f-a755-cf0c99072748 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:12.748998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cac4c200-27bf-456f-a755-cf0c99072748 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:12.752279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cac4c200-27bf-456f-a755-cf0c99072748 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:12.752993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cac4c200-27bf-456f-a755-cf0c99072748 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:12.753646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cac4c200-27bf-456f-a755-cf0c99072748 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:12.980496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-cac4c200-27bf-456f-a755-cf0c99072748 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lazy-loading 'services' on Instance uuid e6bb9b74-29c0-41d4-ba39-285c01125cdf {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:18:13.130861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cac4c200-27bf-456f-a755-cf0c99072748 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf/os-volume_attachments/6f63b51f-8661-4851-b26e-b5b2b741ec9a" status: 202 len: 0 microversion: 2.1 time: 0.406390 Sep 01 05:18:13.132153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 223/480] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 05:18:12 2022] DELETE /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf/os-volume_attachments/6f63b51f-8661-4851-b26e-b5b2b741ec9a => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:14.353262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-03d223bb-ce0c-40ab-8b41-95c95fed72e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:14.357882 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-03d223bb-ce0c-40ab-8b41-95c95fed72e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:14.380389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=26 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:14.387547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03d223bb-ce0c-40ab-8b41-95c95fed72e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:14.388394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03d223bb-ce0c-40ab-8b41-95c95fed72e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:14.389313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03d223bb-ce0c-40ab-8b41-95c95fed72e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:14.390479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03d223bb-ce0c-40ab-8b41-95c95fed72e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:14.391335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03d223bb-ce0c-40ab-8b41-95c95fed72e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:14.391988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03d223bb-ce0c-40ab-8b41-95c95fed72e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:14.397679 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:14.440797 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-03d223bb-ce0c-40ab-8b41-95c95fed72e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Going to try to terminate instance {{(pid=120674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:18:14.560954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-03d223bb-ce0c-40ab-8b41-95c95fed72e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 204 len: 0 microversion: 2.1 time: 0.222976 Sep 01 05:18:14.561850 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 258/481] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:18:14 2022] DELETE /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:14.571367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-59e8fdfc-4eb3-4719-b120-9d701185e9e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:14.572954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-59e8fdfc-4eb3-4719-b120-9d701185e9e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:14.580842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-59e8fdfc-4eb3-4719-b120-9d701185e9e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:14.581340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-59e8fdfc-4eb3-4719-b120-9d701185e9e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:14.581778 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-59e8fdfc-4eb3-4719-b120-9d701185e9e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:14.582483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-59e8fdfc-4eb3-4719-b120-9d701185e9e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:14.582937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-59e8fdfc-4eb3-4719-b120-9d701185e9e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:14.583363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-59e8fdfc-4eb3-4719-b120-9d701185e9e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:14.825612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-59e8fdfc-4eb3-4719-b120-9d701185e9e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:14.833918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-59e8fdfc-4eb3-4719-b120-9d701185e9e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1512 microversion: 2.1 time: 0.267249 Sep 01 05:18:14.834504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 224/482] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:14 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:15.856459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2075f422-0f55-4171-ae0e-4cac5e2c6426 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:15.857455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2075f422-0f55-4171-ae0e-4cac5e2c6426 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:15.865524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2075f422-0f55-4171-ae0e-4cac5e2c6426 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:15.866535 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2075f422-0f55-4171-ae0e-4cac5e2c6426 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:15.867131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2075f422-0f55-4171-ae0e-4cac5e2c6426 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:15.868009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2075f422-0f55-4171-ae0e-4cac5e2c6426 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:15.868620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2075f422-0f55-4171-ae0e-4cac5e2c6426 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:15.869345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2075f422-0f55-4171-ae0e-4cac5e2c6426 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:16.077973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2075f422-0f55-4171-ae0e-4cac5e2c6426 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:16.087790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2075f422-0f55-4171-ae0e-4cac5e2c6426 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1512 microversion: 2.1 time: 0.235703 Sep 01 05:18:16.088319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 259/483] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:15 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:16.233127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c4a97c9d-0466-4b63-86fe-c27f0ad918e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Action: 'create', calling method: .version_select at 0x7f9624d3d430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1597487025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8JtUSDuoYNzspI2W2YrgdKwjDTxL7SDABWHlorTK/sRXykvwZXoiqy/VBU2JYHRaDjPDj31Ozu+xoBokOpVFe9lEIlPPorGFJyHu885Xn56z8a2anK2E0+7SYg66592g=="}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:16.264995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-c4a97c9d-0466-4b63-86fe-c27f0ad918e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Getting quotas for project f83248d1861c4e6cbb480e5af9733575. Resources: {'key_pairs'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:18:16.269848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-c4a97c9d-0466-4b63-86fe-c27f0ad918e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Getting quotas for user 73516e6aed494ab597cb824180a617a3 and project f83248d1861c4e6cbb480e5af9733575. Resources: {'key_pairs'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:18:16.310098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c4a97c9d-0466-4b63-86fe-c27f0ad918e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.341502 Sep 01 05:18:16.310713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 225/484] 10.222.0.49 () {60 vars in 1159 bytes} [Thu Sep 1 05:18:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:18:17.110863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9de27c2a-477e-4cb2-bffc-5fab62075f7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:17.111478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9de27c2a-477e-4cb2-bffc-5fab62075f7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:17.118348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9de27c2a-477e-4cb2-bffc-5fab62075f7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.118858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9de27c2a-477e-4cb2-bffc-5fab62075f7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.119290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9de27c2a-477e-4cb2-bffc-5fab62075f7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:17.119978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9de27c2a-477e-4cb2-bffc-5fab62075f7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.120420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9de27c2a-477e-4cb2-bffc-5fab62075f7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.121057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9de27c2a-477e-4cb2-bffc-5fab62075f7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:17.337853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9de27c2a-477e-4cb2-bffc-5fab62075f7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:17.345591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-309d020c-bc93-456c-9038-829a75ebf5ab req-3b1bf507-a8bb-4042-a5c3-cbae75895a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bb9b74-29c0-41d4-ba39-285c01125cdf", "name": "network-vif-deleted", "tag": "494e85a1-0d9d-420c-8314-4df8b9a07670"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:17.352015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9de27c2a-477e-4cb2-bffc-5fab62075f7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 200 len: 1512 microversion: 2.1 time: 0.245286 Sep 01 05:18:17.352608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 260/485] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:17 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:17.367900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-309d020c-bc93-456c-9038-829a75ebf5ab req-3b1bf507-a8bb-4042-a5c3-cbae75895a98 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.368373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-309d020c-bc93-456c-9038-829a75ebf5ab req-3b1bf507-a8bb-4042-a5c3-cbae75895a98 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.368921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-309d020c-bc93-456c-9038-829a75ebf5ab req-3b1bf507-a8bb-4042-a5c3-cbae75895a98 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:17.377929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:17.399225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-309d020c-bc93-456c-9038-829a75ebf5ab req-3b1bf507-a8bb-4042-a5c3-cbae75895a98 service nova] Creating event network-vif-deleted:494e85a1-0d9d-420c-8314-4df8b9a07670 for instance e6bb9b74-29c0-41d4-ba39-285c01125cdf on hv-cinder-85391 Sep 01 05:18:17.404416 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-309d020c-bc93-456c-9038-829a75ebf5ab req-3b1bf507-a8bb-4042-a5c3-cbae75895a98 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063545 Sep 01 05:18:17.405800 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 226/486] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:18:18.374946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-59f05391-899f-4400-a5a1-f90d3af0da36 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:18.375539 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-59f05391-899f-4400-a5a1-f90d3af0da36 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: e6bb9b74-29c0-41d4-ba39-285c01125cdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:18.382545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-59f05391-899f-4400-a5a1-f90d3af0da36 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.383033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-59f05391-899f-4400-a5a1-f90d3af0da36 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.383469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-59f05391-899f-4400-a5a1-f90d3af0da36 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.384168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-59f05391-899f-4400-a5a1-f90d3af0da36 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.384623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-59f05391-899f-4400-a5a1-f90d3af0da36 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.385083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-59f05391-899f-4400-a5a1-f90d3af0da36 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.400381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-59f05391-899f-4400-a5a1-f90d3af0da36 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] HTTP exception thrown: Instance e6bb9b74-29c0-41d4-ba39-285c01125cdf could not be found. Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-59f05391-899f-4400-a5a1-f90d3af0da36 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Request method failure captured: Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf HTTP/1.1 Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEA-0zvNVK73-ALKeJr_5BlD7gBwFkeCmpRZuQ2-FbFfpQaBXn38V988IsG8t3AIT_schfErIuaP_I61pz-ciNdxJrFqSVAVyd96EVscv5ER27TitSYRkM5CcsHoNtTwSV2TQLi4EEvkq-cfQi5IxMb799EA2wy4y5xPtO-Bvj-bNEk Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: b5cc7e7b1b9f43a18651ab25d5c2b4ae Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:18:18.402325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:18:18.403780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5cc7e7b1b9f43a18651ab25d5c2b4ae", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}] Sep 01 05:18:18.403780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:18:18.403780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: b5cc7e7b1b9f43a18651ab25d5c2b4ae Sep 01 05:18:18.403780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:18:18.403780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-VolumesSnapshotTestJSON-1059052017-project Sep 01 05:18:18.403780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:18:18.403780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:18:18.403780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 109c732f418442a9bf997fba70669fad Sep 01 05:18:18.403780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-VolumesSnapshotTestJSON-1059052017-project Sep 01 05:18:18.403780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:18:18.403780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance e6bb9b74-29c0-41d4-ba39-285c01125cdf could not be found. Sep 01 05:18:18.403780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': 'e6bb9b74-29c0-41d4-ba39-285c01125cdf'} Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6bb9b74-29c0-41d4-ba39-285c01125cdf could not be found. Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:18.404591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6bb9b74-29c0-41d4-ba39-285c01125cdf could not be found. Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6bb9b74-29c0-41d4-ba39-285c01125cdf could not be found. Sep 01 05:18:18.406014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:18:18.407912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-59f05391-899f-4400-a5a1-f90d3af0da36 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Returning 404 to user: Instance e6bb9b74-29c0-41d4-ba39-285c01125cdf could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:18.407912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-59f05391-899f-4400-a5a1-f90d3af0da36 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf" status: 404 len: 111 microversion: 2.1 time: 0.033170 Sep 01 05:18:18.407912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 261/487] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:18 2022] GET /compute/v2.1/servers/e6bb9b74-29c0-41d4-ba39-285c01125cdf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:18:18.751746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-50ffdd89-9c63-4013-9bed-cc11d855f81a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:18.752397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-50ffdd89-9c63-4013-9bed-cc11d855f81a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:18.759286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-50ffdd89-9c63-4013-9bed-cc11d855f81a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.759772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-50ffdd89-9c63-4013-9bed-cc11d855f81a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.760210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-50ffdd89-9c63-4013-9bed-cc11d855f81a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.761005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-50ffdd89-9c63-4013-9bed-cc11d855f81a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.761462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-50ffdd89-9c63-4013-9bed-cc11d855f81a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.761886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-50ffdd89-9c63-4013-9bed-cc11d855f81a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.851460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-50ffdd89-9c63-4013-9bed-cc11d855f81a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lazy-loading 'services' on Instance uuid 3674edea-d05c-428c-896e-938f3891acc1 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:18:18.937623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-50ffdd89-9c63-4013-9bed-cc11d855f81a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/os-volume_attachments/318706e9-5beb-451f-9a13-083b4780610a" status: 202 len: 0 microversion: 2.1 time: 0.191337 Sep 01 05:18:18.941812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 227/488] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 05:18:18 2022] DELETE /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/os-volume_attachments/318706e9-5beb-451f-9a13-083b4780610a => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:20.496710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a5816d9b-cf25-4c03-8bd9-b6c2bd036f2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e593ac89-7421-4692-962f-80f6f95d7236"}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:20.499359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a5816d9b-cf25-4c03-8bd9-b6c2bd036f2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:20.506218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5816d9b-cf25-4c03-8bd9-b6c2bd036f2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:20.506791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5816d9b-cf25-4c03-8bd9-b6c2bd036f2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:20.507299 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5816d9b-cf25-4c03-8bd9-b6c2bd036f2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:20.508076 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5816d9b-cf25-4c03-8bd9-b6c2bd036f2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:20.508603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5816d9b-cf25-4c03-8bd9-b6c2bd036f2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:20.509121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5816d9b-cf25-4c03-8bd9-b6c2bd036f2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:21.871279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a5816d9b-cf25-4c03-8bd9-b6c2bd036f2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "POST /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.378511 Sep 01 05:18:21.871950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 262/489] 10.222.0.49 () {60 vars in 1323 bytes} [Thu Sep 1 05:18:20 2022] POST /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 194 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:18:23.244460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e6766e6b-f6f4-4f15-8cfe-0d1500542d85 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:23.250624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6766e6b-f6f4-4f15-8cfe-0d1500542d85 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:23.251104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6766e6b-f6f4-4f15-8cfe-0d1500542d85 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:23.251722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6766e6b-f6f4-4f15-8cfe-0d1500542d85 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:23.320452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e6766e6b-f6f4-4f15-8cfe-0d1500542d85 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Going to try to stop instance {{(pid=120673) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:18:23.384549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e6766e6b-f6f4-4f15-8cfe-0d1500542d85 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "POST /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/action" status: 202 len: 0 microversion: 2.1 time: 0.144632 Sep 01 05:18:23.385252 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 228/490] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:23 2022] POST /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:23.394802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8fd06324-34a7-4c53-8bd7-c394455af995 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:23.395728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8fd06324-34a7-4c53-8bd7-c394455af995 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:23.402596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fd06324-34a7-4c53-8bd7-c394455af995 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:23.403085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fd06324-34a7-4c53-8bd7-c394455af995 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:23.403522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fd06324-34a7-4c53-8bd7-c394455af995 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:23.404319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fd06324-34a7-4c53-8bd7-c394455af995 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:23.404841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fd06324-34a7-4c53-8bd7-c394455af995 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:23.405270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fd06324-34a7-4c53-8bd7-c394455af995 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:23.557279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8fd06324-34a7-4c53-8bd7-c394455af995 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:23.565272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8fd06324-34a7-4c53-8bd7-c394455af995 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.175162 Sep 01 05:18:23.565855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 263/491] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:23 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:24.587376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-28f238b5-c9d0-4572-a858-62e529fa1314 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:24.588061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-28f238b5-c9d0-4572-a858-62e529fa1314 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:24.594540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28f238b5-c9d0-4572-a858-62e529fa1314 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:24.595183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28f238b5-c9d0-4572-a858-62e529fa1314 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:24.596352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28f238b5-c9d0-4572-a858-62e529fa1314 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:24.597174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28f238b5-c9d0-4572-a858-62e529fa1314 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:24.597692 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28f238b5-c9d0-4572-a858-62e529fa1314 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:24.598117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28f238b5-c9d0-4572-a858-62e529fa1314 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:24.739802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-28f238b5-c9d0-4572-a858-62e529fa1314 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:24.747383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-28f238b5-c9d0-4572-a858-62e529fa1314 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.164701 Sep 01 05:18:24.747941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 229/492] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:24 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:25.768800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6ad56ece-557e-484a-bad3-8dffc22925d5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:25.769459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6ad56ece-557e-484a-bad3-8dffc22925d5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:25.776115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ad56ece-557e-484a-bad3-8dffc22925d5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:25.776605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ad56ece-557e-484a-bad3-8dffc22925d5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:25.777080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ad56ece-557e-484a-bad3-8dffc22925d5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:25.777781 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ad56ece-557e-484a-bad3-8dffc22925d5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:25.778233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ad56ece-557e-484a-bad3-8dffc22925d5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:25.778659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ad56ece-557e-484a-bad3-8dffc22925d5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:25.920827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6ad56ece-557e-484a-bad3-8dffc22925d5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:25.928756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6ad56ece-557e-484a-bad3-8dffc22925d5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.164339 Sep 01 05:18:25.929335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 264/493] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:25 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:26.950913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a40ab1d3-ea53-44c0-bb48-02fc1f616913 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:26.951529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a40ab1d3-ea53-44c0-bb48-02fc1f616913 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:26.953945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=4 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:26.959972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a40ab1d3-ea53-44c0-bb48-02fc1f616913 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:26.960435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a40ab1d3-ea53-44c0-bb48-02fc1f616913 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:26.960915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a40ab1d3-ea53-44c0-bb48-02fc1f616913 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:26.961664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a40ab1d3-ea53-44c0-bb48-02fc1f616913 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:26.962129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a40ab1d3-ea53-44c0-bb48-02fc1f616913 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:26.962552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a40ab1d3-ea53-44c0-bb48-02fc1f616913 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:27.093188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a40ab1d3-ea53-44c0-bb48-02fc1f616913 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:27.105907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a40ab1d3-ea53-44c0-bb48-02fc1f616913 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.158408 Sep 01 05:18:27.107042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 230/494] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:26 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:28.128305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5b65ca15-e307-4962-8757-054b252ce04e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:28.128950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5b65ca15-e307-4962-8757-054b252ce04e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:28.135818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5b65ca15-e307-4962-8757-054b252ce04e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:28.136315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5b65ca15-e307-4962-8757-054b252ce04e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:28.136756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5b65ca15-e307-4962-8757-054b252ce04e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:28.137491 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5b65ca15-e307-4962-8757-054b252ce04e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:28.137945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5b65ca15-e307-4962-8757-054b252ce04e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:28.138371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5b65ca15-e307-4962-8757-054b252ce04e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:28.277061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5b65ca15-e307-4962-8757-054b252ce04e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:28.286066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5b65ca15-e307-4962-8757-054b252ce04e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.161722 Sep 01 05:18:28.286628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 265/495] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:28 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:28.353669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-758812662", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "networks": [{"uuid": "7c13e97d-6bf4-4984-8d9f-37700a278d04"}]}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:28.408006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.network.neutron [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] validate_networks() for [('7c13e97d-6bf4-4984-8d9f-37700a278d04', None, None, None, None, None)] {{(pid=120673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:18:28.767958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Flavor limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:18:28.768918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Image limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:18:28.769327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Flavor pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:18:28.769749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Image pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:18:28.770166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:18:28.778934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:28.779354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:28.779783 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:28.780509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:28.780992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:28.781415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:28.798239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Getting quotas for project b5cc7e7b1b9f43a18651ab25d5c2b4ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:18:28.802920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Getting quotas for user 109c732f418442a9bf997fba70669fad and project b5cc7e7b1b9f43a18651ab25d5c2b4ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:18:28.813948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Going to run 1 instances... {{(pid=120673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:18:28.817020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:18:28.864514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b1b1df88-5e7f-4cff-831c-01f93ddfd2df tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514650 Sep 01 05:18:28.865220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 231/496] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:18:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:18:28.876135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bbd3a37b-cc6b-41c9-b097-23fbf06b03ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:28.876747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bbd3a37b-cc6b-41c9-b097-23fbf06b03ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:28.943389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bbd3a37b-cc6b-41c9-b097-23fbf06b03ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:28.950482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bbd3a37b-cc6b-41c9-b097-23fbf06b03ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1218 microversion: 2.1 time: 0.078157 Sep 01 05:18:28.951053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 266/497] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:28 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:29.307833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fc6ef52c-9c8d-442a-a5dc-32b83a2ffdd2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:29.308451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fc6ef52c-9c8d-442a-a5dc-32b83a2ffdd2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:29.319047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc6ef52c-9c8d-442a-a5dc-32b83a2ffdd2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.319530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc6ef52c-9c8d-442a-a5dc-32b83a2ffdd2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.320153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc6ef52c-9c8d-442a-a5dc-32b83a2ffdd2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.320889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc6ef52c-9c8d-442a-a5dc-32b83a2ffdd2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.321344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc6ef52c-9c8d-442a-a5dc-32b83a2ffdd2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.321961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc6ef52c-9c8d-442a-a5dc-32b83a2ffdd2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.450394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-52e47af2-3aa0-4c44-9686-c76d77d2265b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:29.452662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-52e47af2-3aa0-4c44-9686-c76d77d2265b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:29.460944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-52e47af2-3aa0-4c44-9686-c76d77d2265b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.461429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-52e47af2-3aa0-4c44-9686-c76d77d2265b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.461858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-52e47af2-3aa0-4c44-9686-c76d77d2265b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.462543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-52e47af2-3aa0-4c44-9686-c76d77d2265b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.462987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-52e47af2-3aa0-4c44-9686-c76d77d2265b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.463401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-52e47af2-3aa0-4c44-9686-c76d77d2265b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.479858 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fc6ef52c-9c8d-442a-a5dc-32b83a2ffdd2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:29.488056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fc6ef52c-9c8d-442a-a5dc-32b83a2ffdd2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.184509 Sep 01 05:18:29.493615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-52e47af2-3aa0-4c44-9686-c76d77d2265b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lazy-loading 'flavor' on Instance uuid 5fd99adb-f38e-4d43-82b1-529010509f72 {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:18:29.501368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 232/498] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:29 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:29.633322 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-52e47af2-3aa0-4c44-9686-c76d77d2265b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "POST /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/action" status: 200 len: 32 microversion: 2.1 time: 0.186646 Sep 01 05:18:29.634214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 267/499] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:29 2022] POST /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 05:18:29.643621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a9a9901a-492b-4c8f-956f-a358a1cf079a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:29.644606 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a9a9901a-492b-4c8f-956f-a358a1cf079a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:29.656537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9a9901a-492b-4c8f-956f-a358a1cf079a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.657894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9a9901a-492b-4c8f-956f-a358a1cf079a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.658474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9a9901a-492b-4c8f-956f-a358a1cf079a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.660067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9a9901a-492b-4c8f-956f-a358a1cf079a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.660646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9a9901a-492b-4c8f-956f-a358a1cf079a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.661033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9a9901a-492b-4c8f-956f-a358a1cf079a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.872061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a9a9901a-492b-4c8f-956f-a358a1cf079a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:29.881335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a9a9901a-492b-4c8f-956f-a358a1cf079a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.241756 Sep 01 05:18:29.881985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 233/500] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:29 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:29.972297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-243bd243-1d85-4550-8926-317c68f3b67b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:29.973030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-243bd243-1d85-4550-8926-317c68f3b67b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:29.979364 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-243bd243-1d85-4550-8926-317c68f3b67b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.979842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-243bd243-1d85-4550-8926-317c68f3b67b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.980274 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-243bd243-1d85-4550-8926-317c68f3b67b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.980983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-243bd243-1d85-4550-8926-317c68f3b67b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.981430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-243bd243-1d85-4550-8926-317c68f3b67b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.981855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-243bd243-1d85-4550-8926-317c68f3b67b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:30.047723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-243bd243-1d85-4550-8926-317c68f3b67b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:30.058022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-243bd243-1d85-4550-8926-317c68f3b67b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1270 microversion: 2.1 time: 0.090084 Sep 01 05:18:30.058968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 268/501] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:29 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:30.509556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e8222a39-15c7-451e-ab34-1c8f03674087 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:30.510460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e8222a39-15c7-451e-ab34-1c8f03674087 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:30.517511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8222a39-15c7-451e-ab34-1c8f03674087 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:30.519077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8222a39-15c7-451e-ab34-1c8f03674087 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:30.520092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8222a39-15c7-451e-ab34-1c8f03674087 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:30.521399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8222a39-15c7-451e-ab34-1c8f03674087 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:30.522154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8222a39-15c7-451e-ab34-1c8f03674087 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:30.523046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8222a39-15c7-451e-ab34-1c8f03674087 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:30.866120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e8222a39-15c7-451e-ab34-1c8f03674087 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:30.875270 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e8222a39-15c7-451e-ab34-1c8f03674087 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.369486 Sep 01 05:18:30.876105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 234/502] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:30 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:30.904290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3fd864f4-dd91-4dea-942c-4b6f00df3193 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:30.905204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3fd864f4-dd91-4dea-942c-4b6f00df3193 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:30.912069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3fd864f4-dd91-4dea-942c-4b6f00df3193 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:30.912661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3fd864f4-dd91-4dea-942c-4b6f00df3193 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:30.913182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3fd864f4-dd91-4dea-942c-4b6f00df3193 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:30.913942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3fd864f4-dd91-4dea-942c-4b6f00df3193 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:30.914489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3fd864f4-dd91-4dea-942c-4b6f00df3193 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:30.915293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3fd864f4-dd91-4dea-942c-4b6f00df3193 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:31.079641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-017087db-6027-406f-9f41-7c53546245ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:31.081296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-017087db-6027-406f-9f41-7c53546245ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:31.089607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-017087db-6027-406f-9f41-7c53546245ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:31.090991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-017087db-6027-406f-9f41-7c53546245ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:31.091541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-017087db-6027-406f-9f41-7c53546245ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:31.092412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-017087db-6027-406f-9f41-7c53546245ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:31.093158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-017087db-6027-406f-9f41-7c53546245ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:31.093688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-017087db-6027-406f-9f41-7c53546245ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:31.189526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3fd864f4-dd91-4dea-942c-4b6f00df3193 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:31.199628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3fd864f4-dd91-4dea-942c-4b6f00df3193 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.299863 Sep 01 05:18:31.200121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 269/503] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:30 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:31.331459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-017087db-6027-406f-9f41-7c53546245ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:31.340562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-017087db-6027-406f-9f41-7c53546245ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1318 microversion: 2.1 time: 0.264829 Sep 01 05:18:31.341264 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 235/504] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:31 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:31.536528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-f865143e-2b48-46d2-8e08-bb0e49c380bd req-bb528d5c-2fe9-420c-9665-e28590660ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad1a0f8-dc03-4662-8e60-d9b7995d1f73", "tag": "88da57a0-b17d-4528-bf1f-950f12d1e685"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:31.546928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-f865143e-2b48-46d2-8e08-bb0e49c380bd req-bb528d5c-2fe9-420c-9665-e28590660ddf service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:31.547506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-f865143e-2b48-46d2-8e08-bb0e49c380bd req-bb528d5c-2fe9-420c-9665-e28590660ddf service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:31.547992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-f865143e-2b48-46d2-8e08-bb0e49c380bd req-bb528d5c-2fe9-420c-9665-e28590660ddf service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:31.562174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-f865143e-2b48-46d2-8e08-bb0e49c380bd req-bb528d5c-2fe9-420c-9665-e28590660ddf service nova] Creating event network-changed:88da57a0-b17d-4528-bf1f-950f12d1e685 for instance 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 on hv-cinder-85391 Sep 01 05:18:31.566834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-f865143e-2b48-46d2-8e08-bb0e49c380bd req-bb528d5c-2fe9-420c-9665-e28590660ddf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034643 Sep 01 05:18:31.567423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 270/505] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:18:31.898207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c1b6bb78-5012-4c70-b3fe-852ea1cb4e18 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:31.898950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c1b6bb78-5012-4c70-b3fe-852ea1cb4e18 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:31.905383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1b6bb78-5012-4c70-b3fe-852ea1cb4e18 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:31.905864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1b6bb78-5012-4c70-b3fe-852ea1cb4e18 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:31.906297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1b6bb78-5012-4c70-b3fe-852ea1cb4e18 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:31.906986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1b6bb78-5012-4c70-b3fe-852ea1cb4e18 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:31.907436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1b6bb78-5012-4c70-b3fe-852ea1cb4e18 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:31.907854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1b6bb78-5012-4c70-b3fe-852ea1cb4e18 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:32.043736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c1b6bb78-5012-4c70-b3fe-852ea1cb4e18 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:32.051579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c1b6bb78-5012-4c70-b3fe-852ea1cb4e18 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.158406 Sep 01 05:18:32.052146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 236/506] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:31 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:32.222864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8ee5a47a-df11-46b0-aa8e-00cfc3285171 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:32.223556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8ee5a47a-df11-46b0-aa8e-00cfc3285171 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:32.229638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ee5a47a-df11-46b0-aa8e-00cfc3285171 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:32.230113 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ee5a47a-df11-46b0-aa8e-00cfc3285171 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:32.230544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ee5a47a-df11-46b0-aa8e-00cfc3285171 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:32.231219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ee5a47a-df11-46b0-aa8e-00cfc3285171 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:32.231666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ee5a47a-df11-46b0-aa8e-00cfc3285171 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:32.232081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ee5a47a-df11-46b0-aa8e-00cfc3285171 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:32.362425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8ee5a47a-df11-46b0-aa8e-00cfc3285171 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:32.363079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4d1585e5-aebd-432c-b685-581de0de7056 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:32.363682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4d1585e5-aebd-432c-b685-581de0de7056 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:32.369473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d1585e5-aebd-432c-b685-581de0de7056 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:32.369951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d1585e5-aebd-432c-b685-581de0de7056 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:32.370374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d1585e5-aebd-432c-b685-581de0de7056 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:32.370661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8ee5a47a-df11-46b0-aa8e-00cfc3285171 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152627 Sep 01 05:18:32.371047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d1585e5-aebd-432c-b685-581de0de7056 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:32.376895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 271/507] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:32 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:32.377046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d1585e5-aebd-432c-b685-581de0de7056 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:32.377046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d1585e5-aebd-432c-b685-581de0de7056 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:32.497928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4d1585e5-aebd-432c-b685-581de0de7056 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:32.505477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4d1585e5-aebd-432c-b685-581de0de7056 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1318 microversion: 2.1 time: 0.146663 Sep 01 05:18:32.506039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 237/508] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:32 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:33.073509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0ec71fef-7d8c-46c6-8054-ff957fcc62be tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:33.074111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0ec71fef-7d8c-46c6-8054-ff957fcc62be tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:33.080156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ec71fef-7d8c-46c6-8054-ff957fcc62be tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:33.080664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ec71fef-7d8c-46c6-8054-ff957fcc62be tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:33.081294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ec71fef-7d8c-46c6-8054-ff957fcc62be tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:33.081978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ec71fef-7d8c-46c6-8054-ff957fcc62be tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:33.082421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ec71fef-7d8c-46c6-8054-ff957fcc62be tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:33.082841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ec71fef-7d8c-46c6-8054-ff957fcc62be tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:33.085448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:33.307407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0ec71fef-7d8c-46c6-8054-ff957fcc62be tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:33.315709 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0ec71fef-7d8c-46c6-8054-ff957fcc62be tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.245469 Sep 01 05:18:33.316278 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 272/509] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:33 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:33.392497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-09994573-5dc8-4bdc-b518-ff8c3d15f071 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:33.393229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-09994573-5dc8-4bdc-b518-ff8c3d15f071 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:33.400122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09994573-5dc8-4bdc-b518-ff8c3d15f071 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:33.400613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09994573-5dc8-4bdc-b518-ff8c3d15f071 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:33.401117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09994573-5dc8-4bdc-b518-ff8c3d15f071 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:33.401798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09994573-5dc8-4bdc-b518-ff8c3d15f071 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:33.402241 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09994573-5dc8-4bdc-b518-ff8c3d15f071 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:33.402655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09994573-5dc8-4bdc-b518-ff8c3d15f071 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:33.526671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-01ceab61-79fe-4e9b-a1eb-278811b07a1f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:33.527574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-01ceab61-79fe-4e9b-a1eb-278811b07a1f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:33.533544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01ceab61-79fe-4e9b-a1eb-278811b07a1f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:33.534730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01ceab61-79fe-4e9b-a1eb-278811b07a1f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:33.535161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01ceab61-79fe-4e9b-a1eb-278811b07a1f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:33.536077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01ceab61-79fe-4e9b-a1eb-278811b07a1f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:33.536527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01ceab61-79fe-4e9b-a1eb-278811b07a1f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:33.536978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01ceab61-79fe-4e9b-a1eb-278811b07a1f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:33.544331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-09994573-5dc8-4bdc-b518-ff8c3d15f071 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:33.553156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-09994573-5dc8-4bdc-b518-ff8c3d15f071 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.164383 Sep 01 05:18:33.553989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 238/510] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:33.734778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-01ceab61-79fe-4e9b-a1eb-278811b07a1f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:33.744455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-01ceab61-79fe-4e9b-a1eb-278811b07a1f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1318 microversion: 2.1 time: 0.221575 Sep 01 05:18:33.745082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 273/511] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:33 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:34.337446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8002f6b9-3706-4a43-b135-5e87ea4d7a67 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:34.338063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8002f6b9-3706-4a43-b135-5e87ea4d7a67 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:34.343866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8002f6b9-3706-4a43-b135-5e87ea4d7a67 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:34.344347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8002f6b9-3706-4a43-b135-5e87ea4d7a67 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:34.344797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8002f6b9-3706-4a43-b135-5e87ea4d7a67 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:34.345485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8002f6b9-3706-4a43-b135-5e87ea4d7a67 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:34.345933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8002f6b9-3706-4a43-b135-5e87ea4d7a67 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:34.346853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8002f6b9-3706-4a43-b135-5e87ea4d7a67 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:34.474696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8002f6b9-3706-4a43-b135-5e87ea4d7a67 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:34.482385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8002f6b9-3706-4a43-b135-5e87ea4d7a67 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.148852 Sep 01 05:18:34.482948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 239/512] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:34 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:34.575137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0a04fedb-ab63-48ac-8fb5-77e698c7bb76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:34.575677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0a04fedb-ab63-48ac-8fb5-77e698c7bb76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:34.582469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a04fedb-ab63-48ac-8fb5-77e698c7bb76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:34.582943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a04fedb-ab63-48ac-8fb5-77e698c7bb76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:34.583368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a04fedb-ab63-48ac-8fb5-77e698c7bb76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:34.584041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a04fedb-ab63-48ac-8fb5-77e698c7bb76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:34.584484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a04fedb-ab63-48ac-8fb5-77e698c7bb76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:34.584928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a04fedb-ab63-48ac-8fb5-77e698c7bb76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:34.717341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0a04fedb-ab63-48ac-8fb5-77e698c7bb76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:34.726594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0a04fedb-ab63-48ac-8fb5-77e698c7bb76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155333 Sep 01 05:18:34.727180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 274/513] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:34.765116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b3daf90f-095d-424e-80ed-aa00c9b2b68f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:34.765844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b3daf90f-095d-424e-80ed-aa00c9b2b68f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:34.772299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b3daf90f-095d-424e-80ed-aa00c9b2b68f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:34.772792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b3daf90f-095d-424e-80ed-aa00c9b2b68f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:34.773250 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b3daf90f-095d-424e-80ed-aa00c9b2b68f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:34.773928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b3daf90f-095d-424e-80ed-aa00c9b2b68f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:34.774382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b3daf90f-095d-424e-80ed-aa00c9b2b68f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:34.774803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b3daf90f-095d-424e-80ed-aa00c9b2b68f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:34.905863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b3daf90f-095d-424e-80ed-aa00c9b2b68f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:34.913970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b3daf90f-095d-424e-80ed-aa00c9b2b68f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1318 microversion: 2.1 time: 0.152672 Sep 01 05:18:34.914767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 240/514] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:34 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:35.128675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-140576064", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1597487025", "security_groups": [{"name": "tempest-secgroup-smoke-1967294210"}], "block_device_mapping_v2": [{"uuid": "3d16db11-5495-4cfa-a3f6-38fe713bde4d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a062db2f-00b2-443f-8b53-f0d35d611365"}]}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:35.240748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.network.neutron [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] validate_networks() for [('a062db2f-00b2-443f-8b53-f0d35d611365', None, None, None, None, None)] {{(pid=120674) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:18:35.504282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d1b020ad-7767-4c01-87bd-2be15f35793d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:35.504925 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d1b020ad-7767-4c01-87bd-2be15f35793d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:35.511248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1b020ad-7767-4c01-87bd-2be15f35793d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.511732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1b020ad-7767-4c01-87bd-2be15f35793d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.512168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1b020ad-7767-4c01-87bd-2be15f35793d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.512877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1b020ad-7767-4c01-87bd-2be15f35793d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.513333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1b020ad-7767-4c01-87bd-2be15f35793d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.513753 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1b020ad-7767-4c01-87bd-2be15f35793d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.599368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Flavor limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:18:35.599899 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Image limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:18:35.600455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Flavor pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:18:35.600968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Image pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:18:35.601448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:18:35.610216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.610773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.611274 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.612139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.612664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.613187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.630706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Getting quotas for project f83248d1861c4e6cbb480e5af9733575. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:18:35.634776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Getting quotas for user 73516e6aed494ab597cb824180a617a3 and project f83248d1861c4e6cbb480e5af9733575. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:18:35.642189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d1b020ad-7767-4c01-87bd-2be15f35793d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:35.650276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d1b020ad-7767-4c01-87bd-2be15f35793d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.150421 Sep 01 05:18:35.652457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 241/515] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:35 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:35.692093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Going to run 1 instances... {{(pid=120674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:18:35.694244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d16db11-5495-4cfa-a3f6-38fe713bde4d',volume_size=None,volume_type=None)] {{(pid=120674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:18:35.747700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-23bf5b81-20af-4868-9b66-5c9c4cba7a8e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:35.748428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-23bf5b81-20af-4868-9b66-5c9c4cba7a8e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:35.754471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23bf5b81-20af-4868-9b66-5c9c4cba7a8e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.754955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23bf5b81-20af-4868-9b66-5c9c4cba7a8e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.755469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23bf5b81-20af-4868-9b66-5c9c4cba7a8e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.756161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23bf5b81-20af-4868-9b66-5c9c4cba7a8e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.756609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23bf5b81-20af-4868-9b66-5c9c4cba7a8e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.757052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23bf5b81-20af-4868-9b66-5c9c4cba7a8e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.772210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:35.847426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9944e07a-1ef9-4553-85cf-fb7f18daf5d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722712 Sep 01 05:18:35.848080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 275/516] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:18:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:18:35.862889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-586cc880-26e4-466d-a21b-600374a428c6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:35.866087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-586cc880-26e4-466d-a21b-600374a428c6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:35.908199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-23bf5b81-20af-4868-9b66-5c9c4cba7a8e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:35.927022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-23bf5b81-20af-4868-9b66-5c9c4cba7a8e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.183029 Sep 01 05:18:35.941323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 242/517] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:35 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:35.942907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-586cc880-26e4-466d-a21b-600374a428c6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:35.950214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7f9a500a-b302-4f18-9100-b3ded19fe656 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:35.950502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-586cc880-26e4-466d-a21b-600374a428c6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1094 microversion: 2.1 time: 0.094789 Sep 01 05:18:35.951462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7f9a500a-b302-4f18-9100-b3ded19fe656 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:35.952260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 276/518] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:35 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:35.960432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f9a500a-b302-4f18-9100-b3ded19fe656 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.961396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f9a500a-b302-4f18-9100-b3ded19fe656 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.961567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-5013d4f4-c012-4a3c-b8dc-e426ca728687 req-69ea3829-3ef3-4325-bf7e-91477f6082b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad1a0f8-dc03-4662-8e60-d9b7995d1f73", "name": "network-vif-plugged", "status": "completed", "tag": "88da57a0-b17d-4528-bf1f-950f12d1e685"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:35.962092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f9a500a-b302-4f18-9100-b3ded19fe656 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.962928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f9a500a-b302-4f18-9100-b3ded19fe656 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.963585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f9a500a-b302-4f18-9100-b3ded19fe656 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.964418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f9a500a-b302-4f18-9100-b3ded19fe656 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.973265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5013d4f4-c012-4a3c-b8dc-e426ca728687 req-69ea3829-3ef3-4325-bf7e-91477f6082b7 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.973745 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5013d4f4-c012-4a3c-b8dc-e426ca728687 req-69ea3829-3ef3-4325-bf7e-91477f6082b7 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.974272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5013d4f4-c012-4a3c-b8dc-e426ca728687 req-69ea3829-3ef3-4325-bf7e-91477f6082b7 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.987487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-5013d4f4-c012-4a3c-b8dc-e426ca728687 req-69ea3829-3ef3-4325-bf7e-91477f6082b7 service nova] Creating event network-vif-plugged:88da57a0-b17d-4528-bf1f-950f12d1e685 for instance 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 on hv-cinder-85391 Sep 01 05:18:35.993546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-5013d4f4-c012-4a3c-b8dc-e426ca728687 req-69ea3829-3ef3-4325-bf7e-91477f6082b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040152 Sep 01 05:18:35.994163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 277/519] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:18:36.133937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7f9a500a-b302-4f18-9100-b3ded19fe656 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:36.144341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7f9a500a-b302-4f18-9100-b3ded19fe656 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1318 microversion: 2.1 time: 0.201644 Sep 01 05:18:36.157135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 243/520] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:35 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:36.673516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d9867058-0627-4435-8723-8262b162c791 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:36.674213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d9867058-0627-4435-8723-8262b162c791 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:36.680593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9867058-0627-4435-8723-8262b162c791 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.681132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9867058-0627-4435-8723-8262b162c791 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.681817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9867058-0627-4435-8723-8262b162c791 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.682497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9867058-0627-4435-8723-8262b162c791 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.682941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9867058-0627-4435-8723-8262b162c791 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.683356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9867058-0627-4435-8723-8262b162c791 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.949866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3609d821-63fd-433d-bf3c-ef825e8f68bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:36.950482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3609d821-63fd-433d-bf3c-ef825e8f68bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:36.957548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3609d821-63fd-433d-bf3c-ef825e8f68bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.958040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3609d821-63fd-433d-bf3c-ef825e8f68bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.958476 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3609d821-63fd-433d-bf3c-ef825e8f68bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.959192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3609d821-63fd-433d-bf3c-ef825e8f68bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.959889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3609d821-63fd-433d-bf3c-ef825e8f68bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.960319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3609d821-63fd-433d-bf3c-ef825e8f68bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:37.037432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d9867058-0627-4435-8723-8262b162c791 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:37.045124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d9867058-0627-4435-8723-8262b162c791 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.376483 Sep 01 05:18:37.045692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 278/521] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:36 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:37.051703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-64019683-01c6-4d9f-a2f5-9139f13ab3f2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:37.052310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-64019683-01c6-4d9f-a2f5-9139f13ab3f2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:37.059598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64019683-01c6-4d9f-a2f5-9139f13ab3f2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:37.060159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64019683-01c6-4d9f-a2f5-9139f13ab3f2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:37.060590 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64019683-01c6-4d9f-a2f5-9139f13ab3f2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:37.061303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64019683-01c6-4d9f-a2f5-9139f13ab3f2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:37.061753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64019683-01c6-4d9f-a2f5-9139f13ab3f2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:37.062167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64019683-01c6-4d9f-a2f5-9139f13ab3f2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:37.125639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-64019683-01c6-4d9f-a2f5-9139f13ab3f2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:37.130142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3609d821-63fd-433d-bf3c-ef825e8f68bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:37.137185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-64019683-01c6-4d9f-a2f5-9139f13ab3f2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1192 microversion: 2.1 time: 0.090131 Sep 01 05:18:37.138899 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 279/522] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:37 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:37.139025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3609d821-63fd-433d-bf3c-ef825e8f68bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.192702 Sep 01 05:18:37.139581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 244/523] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:36 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:37.169108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-69f40822-a914-4ea9-900a-cf7e8a9ad856 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:37.169818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-69f40822-a914-4ea9-900a-cf7e8a9ad856 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:37.177002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-69f40822-a914-4ea9-900a-cf7e8a9ad856 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:37.177543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-69f40822-a914-4ea9-900a-cf7e8a9ad856 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:37.177976 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-69f40822-a914-4ea9-900a-cf7e8a9ad856 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:37.178664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-69f40822-a914-4ea9-900a-cf7e8a9ad856 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:37.179141 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-69f40822-a914-4ea9-900a-cf7e8a9ad856 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:37.179589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-69f40822-a914-4ea9-900a-cf7e8a9ad856 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:37.311869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-69f40822-a914-4ea9-900a-cf7e8a9ad856 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:37.319601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-69f40822-a914-4ea9-900a-cf7e8a9ad856 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1318 microversion: 2.1 time: 0.155720 Sep 01 05:18:37.320161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 280/524] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:37 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:38.068323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-158c3887-85f7-4ab4-b002-40c33f8237b5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:38.069055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-158c3887-85f7-4ab4-b002-40c33f8237b5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:38.075237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-158c3887-85f7-4ab4-b002-40c33f8237b5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.075899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-158c3887-85f7-4ab4-b002-40c33f8237b5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.076468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-158c3887-85f7-4ab4-b002-40c33f8237b5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.077219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-158c3887-85f7-4ab4-b002-40c33f8237b5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.077871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-158c3887-85f7-4ab4-b002-40c33f8237b5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.078297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-158c3887-85f7-4ab4-b002-40c33f8237b5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.163454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-20344dff-2d20-407c-8514-9e211a3a1a22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:38.164153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-20344dff-2d20-407c-8514-9e211a3a1a22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:38.173834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20344dff-2d20-407c-8514-9e211a3a1a22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.174620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20344dff-2d20-407c-8514-9e211a3a1a22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.175835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20344dff-2d20-407c-8514-9e211a3a1a22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.176704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20344dff-2d20-407c-8514-9e211a3a1a22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.177336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20344dff-2d20-407c-8514-9e211a3a1a22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.177936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20344dff-2d20-407c-8514-9e211a3a1a22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.224032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-158c3887-85f7-4ab4-b002-40c33f8237b5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:38.231565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-158c3887-85f7-4ab4-b002-40c33f8237b5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.168012 Sep 01 05:18:38.232132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 245/525] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:38 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:38.237480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a6c08a30-d3cb-4dfb-b407-8222ffd9fcef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:38.238311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a6c08a30-d3cb-4dfb-b407-8222ffd9fcef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:38.245366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6c08a30-d3cb-4dfb-b407-8222ffd9fcef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.245780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6c08a30-d3cb-4dfb-b407-8222ffd9fcef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.246211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6c08a30-d3cb-4dfb-b407-8222ffd9fcef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.246889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6c08a30-d3cb-4dfb-b407-8222ffd9fcef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.247334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6c08a30-d3cb-4dfb-b407-8222ffd9fcef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.247776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6c08a30-d3cb-4dfb-b407-8222ffd9fcef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.280320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-20344dff-2d20-407c-8514-9e211a3a1a22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:38.289055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-20344dff-2d20-407c-8514-9e211a3a1a22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1210 microversion: 2.1 time: 0.131762 Sep 01 05:18:38.289732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 281/526] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:38 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:38.341711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5cad1f94-504c-4b1d-8ad7-d5c5c692d1a3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:38.342549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5cad1f94-504c-4b1d-8ad7-d5c5c692d1a3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:38.349870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cad1f94-504c-4b1d-8ad7-d5c5c692d1a3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.350584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cad1f94-504c-4b1d-8ad7-d5c5c692d1a3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.351212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cad1f94-504c-4b1d-8ad7-d5c5c692d1a3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.352178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cad1f94-504c-4b1d-8ad7-d5c5c692d1a3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.352733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cad1f94-504c-4b1d-8ad7-d5c5c692d1a3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.353210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cad1f94-504c-4b1d-8ad7-d5c5c692d1a3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.387287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a6c08a30-d3cb-4dfb-b407-8222ffd9fcef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:38.397828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a6c08a30-d3cb-4dfb-b407-8222ffd9fcef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.164219 Sep 01 05:18:38.398643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 246/527] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:38 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:38.581567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5cad1f94-504c-4b1d-8ad7-d5c5c692d1a3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:38.594707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5cad1f94-504c-4b1d-8ad7-d5c5c692d1a3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1506 microversion: 2.1 time: 0.257134 Sep 01 05:18:38.595916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 282/528] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:38 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:38.617628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1fc90810-bb97-4df0-8b9f-9bfc7f2c9117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f57f61f5-2ba8-4f7c-a117-f58bf54b91cd", "device": "/dev/sdb"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:38.620633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1fc90810-bb97-4df0-8b9f-9bfc7f2c9117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:38.627275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fc90810-bb97-4df0-8b9f-9bfc7f2c9117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.628395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fc90810-bb97-4df0-8b9f-9bfc7f2c9117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.629255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fc90810-bb97-4df0-8b9f-9bfc7f2c9117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.629948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fc90810-bb97-4df0-8b9f-9bfc7f2c9117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.630402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fc90810-bb97-4df0-8b9f-9bfc7f2c9117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.630828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fc90810-bb97-4df0-8b9f-9bfc7f2c9117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.789065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:38.809980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=6 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:38.920034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1fc90810-bb97-4df0-8b9f-9bfc7f2c9117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "POST /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306161 Sep 01 05:18:38.920711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 247/529] 10.222.0.49 () {60 vars in 1323 bytes} [Thu Sep 1 05:18:38 2022] POST /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:18:39.253569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-26bd7d5c-2344-4cae-9386-d7bf4084476b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:39.254265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-26bd7d5c-2344-4cae-9386-d7bf4084476b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:39.260974 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26bd7d5c-2344-4cae-9386-d7bf4084476b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.261545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26bd7d5c-2344-4cae-9386-d7bf4084476b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.262044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26bd7d5c-2344-4cae-9386-d7bf4084476b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.262799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26bd7d5c-2344-4cae-9386-d7bf4084476b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.263555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26bd7d5c-2344-4cae-9386-d7bf4084476b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.263948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26bd7d5c-2344-4cae-9386-d7bf4084476b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.312449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0a087544-2e0c-4eab-aab1-d4f7196add18 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:39.313156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0a087544-2e0c-4eab-aab1-d4f7196add18 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:39.319475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a087544-2e0c-4eab-aab1-d4f7196add18 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.320134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a087544-2e0c-4eab-aab1-d4f7196add18 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.320574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a087544-2e0c-4eab-aab1-d4f7196add18 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.321929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a087544-2e0c-4eab-aab1-d4f7196add18 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.322381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a087544-2e0c-4eab-aab1-d4f7196add18 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.322818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a087544-2e0c-4eab-aab1-d4f7196add18 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.474299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0a087544-2e0c-4eab-aab1-d4f7196add18 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:39.481921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0a087544-2e0c-4eab-aab1-d4f7196add18 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.174151 Sep 01 05:18:39.482679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 248/530] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:39 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:39.489119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-04c0c4f0-386e-48d4-bea9-5fb871a7578e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:39.489933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-04c0c4f0-386e-48d4-bea9-5fb871a7578e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:39.496096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04c0c4f0-386e-48d4-bea9-5fb871a7578e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.496699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04c0c4f0-386e-48d4-bea9-5fb871a7578e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.497200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04c0c4f0-386e-48d4-bea9-5fb871a7578e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.497892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04c0c4f0-386e-48d4-bea9-5fb871a7578e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.498590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04c0c4f0-386e-48d4-bea9-5fb871a7578e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.499068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04c0c4f0-386e-48d4-bea9-5fb871a7578e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.506914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-26bd7d5c-2344-4cae-9386-d7bf4084476b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:39.514707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-26bd7d5c-2344-4cae-9386-d7bf4084476b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.265076 Sep 01 05:18:39.515598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 283/531] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:39 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:39.634011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-0fa8a29c-988f-4a69-824d-159a2cb091ff req-dbe6402f-fa12-4a3d-9956-8611ff9831ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d673fb27-cefb-470e-85e8-9189c59d1c5c", "tag": "08c5bdfa-3bfb-49da-bc35-8290867af5b9"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:39.644834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-0fa8a29c-988f-4a69-824d-159a2cb091ff req-dbe6402f-fa12-4a3d-9956-8611ff9831ce service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.645319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-0fa8a29c-988f-4a69-824d-159a2cb091ff req-dbe6402f-fa12-4a3d-9956-8611ff9831ce service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.645979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-0fa8a29c-988f-4a69-824d-159a2cb091ff req-dbe6402f-fa12-4a3d-9956-8611ff9831ce service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.657114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-0fa8a29c-988f-4a69-824d-159a2cb091ff req-dbe6402f-fa12-4a3d-9956-8611ff9831ce service nova] Creating event network-changed:08c5bdfa-3bfb-49da-bc35-8290867af5b9 for instance d673fb27-cefb-470e-85e8-9189c59d1c5c on hv-cinder-85391 Sep 01 05:18:39.661885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-0fa8a29c-988f-4a69-824d-159a2cb091ff req-dbe6402f-fa12-4a3d-9956-8611ff9831ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031581 Sep 01 05:18:39.662484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 284/532] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:18:39.666036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-04c0c4f0-386e-48d4-bea9-5fb871a7578e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:39.674432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-04c0c4f0-386e-48d4-bea9-5fb871a7578e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.188980 Sep 01 05:18:39.675112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 249/533] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:40.504593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bb425d6d-d93a-48c9-8af8-754f9a86e049 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:40.505498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bb425d6d-d93a-48c9-8af8-754f9a86e049 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:40.511750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb425d6d-d93a-48c9-8af8-754f9a86e049 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:40.512232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb425d6d-d93a-48c9-8af8-754f9a86e049 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:40.512660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb425d6d-d93a-48c9-8af8-754f9a86e049 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:40.513367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb425d6d-d93a-48c9-8af8-754f9a86e049 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:40.513810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb425d6d-d93a-48c9-8af8-754f9a86e049 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:40.514224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb425d6d-d93a-48c9-8af8-754f9a86e049 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:40.537474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5d21dff0-6e14-46b9-afe6-551fe74ee405 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:40.538729 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5d21dff0-6e14-46b9-afe6-551fe74ee405 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:40.545634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d21dff0-6e14-46b9-afe6-551fe74ee405 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:40.546120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d21dff0-6e14-46b9-afe6-551fe74ee405 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:40.546583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d21dff0-6e14-46b9-afe6-551fe74ee405 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:40.547312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d21dff0-6e14-46b9-afe6-551fe74ee405 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:40.547761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d21dff0-6e14-46b9-afe6-551fe74ee405 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:40.548207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d21dff0-6e14-46b9-afe6-551fe74ee405 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:40.680892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5d21dff0-6e14-46b9-afe6-551fe74ee405 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:40.688864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5d21dff0-6e14-46b9-afe6-551fe74ee405 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.156548 Sep 01 05:18:40.689532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 250/534] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:40 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:40.708200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-83ed7772-e992-4cff-9971-d0d2436f8db4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:40.708826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-83ed7772-e992-4cff-9971-d0d2436f8db4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:40.714559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-83ed7772-e992-4cff-9971-d0d2436f8db4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:40.715035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-83ed7772-e992-4cff-9971-d0d2436f8db4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:40.715459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-83ed7772-e992-4cff-9971-d0d2436f8db4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:40.716135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-83ed7772-e992-4cff-9971-d0d2436f8db4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:40.716578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-83ed7772-e992-4cff-9971-d0d2436f8db4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:40.717019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-83ed7772-e992-4cff-9971-d0d2436f8db4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:40.735098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bb425d6d-d93a-48c9-8af8-754f9a86e049 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:40.744336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bb425d6d-d93a-48c9-8af8-754f9a86e049 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.244494 Sep 01 05:18:40.745045 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 285/535] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:40 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:40.856423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-83ed7772-e992-4cff-9971-d0d2436f8db4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:40.865924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-83ed7772-e992-4cff-9971-d0d2436f8db4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.162122 Sep 01 05:18:40.866495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 251/536] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:40 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:41.709715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fb426968-8566-4697-8ec3-14d646fe3ca2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:41.710320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fb426968-8566-4697-8ec3-14d646fe3ca2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:41.716698 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb426968-8566-4697-8ec3-14d646fe3ca2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.717218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb426968-8566-4697-8ec3-14d646fe3ca2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.717644 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb426968-8566-4697-8ec3-14d646fe3ca2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.718319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb426968-8566-4697-8ec3-14d646fe3ca2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.718767 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb426968-8566-4697-8ec3-14d646fe3ca2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.719180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb426968-8566-4697-8ec3-14d646fe3ca2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.765854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-00e3f276-b9da-4a2c-96bc-9bde5863e31b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:41.766471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-00e3f276-b9da-4a2c-96bc-9bde5863e31b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:41.773078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-00e3f276-b9da-4a2c-96bc-9bde5863e31b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.773559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-00e3f276-b9da-4a2c-96bc-9bde5863e31b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.774103 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-00e3f276-b9da-4a2c-96bc-9bde5863e31b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.774793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-00e3f276-b9da-4a2c-96bc-9bde5863e31b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.775245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-00e3f276-b9da-4a2c-96bc-9bde5863e31b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.775697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-00e3f276-b9da-4a2c-96bc-9bde5863e31b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.852192 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fb426968-8566-4697-8ec3-14d646fe3ca2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:41.860035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fb426968-8566-4697-8ec3-14d646fe3ca2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.154288 Sep 01 05:18:41.860685 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 286/537] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:41 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:41.887224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cf42e07d-10a2-4825-924f-e97fb7ed3c77 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:41.887837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cf42e07d-10a2-4825-924f-e97fb7ed3c77 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:41.894031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf42e07d-10a2-4825-924f-e97fb7ed3c77 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.894483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf42e07d-10a2-4825-924f-e97fb7ed3c77 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.894920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf42e07d-10a2-4825-924f-e97fb7ed3c77 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.895619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf42e07d-10a2-4825-924f-e97fb7ed3c77 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.896071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf42e07d-10a2-4825-924f-e97fb7ed3c77 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.896885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf42e07d-10a2-4825-924f-e97fb7ed3c77 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.910346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-00e3f276-b9da-4a2c-96bc-9bde5863e31b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:41.918890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-00e3f276-b9da-4a2c-96bc-9bde5863e31b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.156795 Sep 01 05:18:41.919790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 252/538] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:41 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:42.024282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cf42e07d-10a2-4825-924f-e97fb7ed3c77 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:42.032477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cf42e07d-10a2-4825-924f-e97fb7ed3c77 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149044 Sep 01 05:18:42.033074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 287/539] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:42.882570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7eab6d2b-3737-476a-9113-92a26239d336 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:42.883174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7eab6d2b-3737-476a-9113-92a26239d336 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:42.885612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:42.890779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7eab6d2b-3737-476a-9113-92a26239d336 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:42.891257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7eab6d2b-3737-476a-9113-92a26239d336 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:42.891683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7eab6d2b-3737-476a-9113-92a26239d336 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:42.892361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7eab6d2b-3737-476a-9113-92a26239d336 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:42.892825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7eab6d2b-3737-476a-9113-92a26239d336 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:42.893242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7eab6d2b-3737-476a-9113-92a26239d336 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:42.939314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-54a62e6f-dde1-4805-804f-e316c0060128 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:42.940520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-54a62e6f-dde1-4805-804f-e316c0060128 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:42.947074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-54a62e6f-dde1-4805-804f-e316c0060128 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:42.947555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-54a62e6f-dde1-4805-804f-e316c0060128 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:42.947981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-54a62e6f-dde1-4805-804f-e316c0060128 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:42.948659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-54a62e6f-dde1-4805-804f-e316c0060128 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:42.949134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-54a62e6f-dde1-4805-804f-e316c0060128 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:42.949551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-54a62e6f-dde1-4805-804f-e316c0060128 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:43.028139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7eab6d2b-3737-476a-9113-92a26239d336 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:43.035917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7eab6d2b-3737-476a-9113-92a26239d336 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1679 microversion: 2.1 time: 0.157153 Sep 01 05:18:43.036481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 253/540] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:42 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:43.055602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0054143f-2e1f-40a7-9816-5331d198164e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:43.056323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0054143f-2e1f-40a7-9816-5331d198164e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:43.062539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0054143f-2e1f-40a7-9816-5331d198164e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:43.063108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0054143f-2e1f-40a7-9816-5331d198164e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:43.063608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0054143f-2e1f-40a7-9816-5331d198164e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:43.064359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0054143f-2e1f-40a7-9816-5331d198164e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:43.065671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0054143f-2e1f-40a7-9816-5331d198164e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:43.066442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0054143f-2e1f-40a7-9816-5331d198164e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:43.078987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-54a62e6f-dde1-4805-804f-e316c0060128 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:43.086880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-54a62e6f-dde1-4805-804f-e316c0060128 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.151347 Sep 01 05:18:43.087482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 288/541] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:42 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:43.197532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0054143f-2e1f-40a7-9816-5331d198164e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:43.206004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0054143f-2e1f-40a7-9816-5331d198164e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154053 Sep 01 05:18:43.206727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 254/542] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:43 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:44.058510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e8464c41-7c3e-4475-9a61-db8be63eb8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:44.059030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e8464c41-7c3e-4475-9a61-db8be63eb8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:44.066020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8464c41-7c3e-4475-9a61-db8be63eb8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:44.066489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8464c41-7c3e-4475-9a61-db8be63eb8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:44.066929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8464c41-7c3e-4475-9a61-db8be63eb8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:44.067616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8464c41-7c3e-4475-9a61-db8be63eb8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:44.068070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8464c41-7c3e-4475-9a61-db8be63eb8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:44.068494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8464c41-7c3e-4475-9a61-db8be63eb8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:44.107898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-92b533b3-488f-465b-9d7b-a2c25f521386 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:44.108509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-92b533b3-488f-465b-9d7b-a2c25f521386 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:44.114928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92b533b3-488f-465b-9d7b-a2c25f521386 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:44.115401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92b533b3-488f-465b-9d7b-a2c25f521386 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:44.115857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92b533b3-488f-465b-9d7b-a2c25f521386 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:44.116538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92b533b3-488f-465b-9d7b-a2c25f521386 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:44.117298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92b533b3-488f-465b-9d7b-a2c25f521386 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:44.117719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92b533b3-488f-465b-9d7b-a2c25f521386 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:44.202693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e8464c41-7c3e-4475-9a61-db8be63eb8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:44.210745 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e8464c41-7c3e-4475-9a61-db8be63eb8c2 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1656 microversion: 2.1 time: 0.156482 Sep 01 05:18:44.211392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 289/543] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:44 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:44.227446 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-45b3f154-e42e-41ff-81bc-1217ff24f536 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:44.228057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-45b3f154-e42e-41ff-81bc-1217ff24f536 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:44.234072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b3f154-e42e-41ff-81bc-1217ff24f536 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:44.234554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b3f154-e42e-41ff-81bc-1217ff24f536 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:44.234986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b3f154-e42e-41ff-81bc-1217ff24f536 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:44.235714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b3f154-e42e-41ff-81bc-1217ff24f536 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:44.236211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b3f154-e42e-41ff-81bc-1217ff24f536 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:44.236516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b3f154-e42e-41ff-81bc-1217ff24f536 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:44.258863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-92b533b3-488f-465b-9d7b-a2c25f521386 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:44.266656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-92b533b3-488f-465b-9d7b-a2c25f521386 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.162467 Sep 01 05:18:44.281600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 255/544] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:44 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:44.288111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-429d0826-834e-4dc6-bf10-9f7523309085 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:44.294731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-429d0826-834e-4dc6-bf10-9f7523309085 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:44.295214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-429d0826-834e-4dc6-bf10-9f7523309085 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:44.295653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-429d0826-834e-4dc6-bf10-9f7523309085 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:44.318263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-429d0826-834e-4dc6-bf10-9f7523309085 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Going to try to start instance {{(pid=120673) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 05:18:44.355395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:44.366760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-429d0826-834e-4dc6-bf10-9f7523309085 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "POST /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/action" status: 202 len: 0 microversion: 2.1 time: 0.083675 Sep 01 05:18:44.367688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 256/545] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:44 2022] POST /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:44.375735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-45b3f154-e42e-41ff-81bc-1217ff24f536 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:44.376096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-81005259-06a0-4c8f-9926-e45785e11364 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:44.376864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-81005259-06a0-4c8f-9926-e45785e11364 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:44.383683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81005259-06a0-4c8f-9926-e45785e11364 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:44.384264 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81005259-06a0-4c8f-9926-e45785e11364 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:44.384829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81005259-06a0-4c8f-9926-e45785e11364 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:44.385689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81005259-06a0-4c8f-9926-e45785e11364 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:44.385881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-45b3f154-e42e-41ff-81bc-1217ff24f536 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.162252 Sep 01 05:18:44.386172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81005259-06a0-4c8f-9926-e45785e11364 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:44.386496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 290/546] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:44 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:44.386714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81005259-06a0-4c8f-9926-e45785e11364 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:44.522881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-81005259-06a0-4c8f-9926-e45785e11364 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:44.530498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-81005259-06a0-4c8f-9926-e45785e11364 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1665 microversion: 2.1 time: 0.158773 Sep 01 05:18:44.531059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 257/547] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:44 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:45.292338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0172a9fc-69a6-4e31-9395-d0725c619939 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:45.292903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0172a9fc-69a6-4e31-9395-d0725c619939 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:45.295355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:45.301387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0172a9fc-69a6-4e31-9395-d0725c619939 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:45.301872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0172a9fc-69a6-4e31-9395-d0725c619939 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:45.302304 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0172a9fc-69a6-4e31-9395-d0725c619939 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:45.302984 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0172a9fc-69a6-4e31-9395-d0725c619939 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:45.303432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0172a9fc-69a6-4e31-9395-d0725c619939 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:45.303972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0172a9fc-69a6-4e31-9395-d0725c619939 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:45.407244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8f47d7ca-b7b2-42e3-a75a-c662f3e0f3f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:45.407881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8f47d7ca-b7b2-42e3-a75a-c662f3e0f3f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:45.415102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f47d7ca-b7b2-42e3-a75a-c662f3e0f3f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:45.415718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f47d7ca-b7b2-42e3-a75a-c662f3e0f3f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:45.416245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f47d7ca-b7b2-42e3-a75a-c662f3e0f3f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:45.417042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f47d7ca-b7b2-42e3-a75a-c662f3e0f3f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:45.417585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f47d7ca-b7b2-42e3-a75a-c662f3e0f3f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:45.418084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f47d7ca-b7b2-42e3-a75a-c662f3e0f3f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:45.441907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0172a9fc-69a6-4e31-9395-d0725c619939 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:45.444080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:45.450859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0172a9fc-69a6-4e31-9395-d0725c619939 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.162432 Sep 01 05:18:45.451434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 291/548] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:45 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:45.552700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6ef5a6a9-6b15-47b9-bb09-21e9fa589209 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:45.553266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6ef5a6a9-6b15-47b9-bb09-21e9fa589209 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:45.559438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ef5a6a9-6b15-47b9-bb09-21e9fa589209 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:45.559920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ef5a6a9-6b15-47b9-bb09-21e9fa589209 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:45.560354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ef5a6a9-6b15-47b9-bb09-21e9fa589209 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:45.561147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ef5a6a9-6b15-47b9-bb09-21e9fa589209 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:45.561603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ef5a6a9-6b15-47b9-bb09-21e9fa589209 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:45.562023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ef5a6a9-6b15-47b9-bb09-21e9fa589209 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:45.563528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8f47d7ca-b7b2-42e3-a75a-c662f3e0f3f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:45.571919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8f47d7ca-b7b2-42e3-a75a-c662f3e0f3f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.168512 Sep 01 05:18:45.572490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 258/549] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:45.620659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:45.688497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6ef5a6a9-6b15-47b9-bb09-21e9fa589209 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:45.696149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6ef5a6a9-6b15-47b9-bb09-21e9fa589209 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1665 microversion: 2.1 time: 0.148596 Sep 01 05:18:45.696713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 292/550] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:45 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1665 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:46.474142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-03d9c9c9-400d-46b4-830d-6e56d9caf4bb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:46.475538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-03d9c9c9-400d-46b4-830d-6e56d9caf4bb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:46.485667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03d9c9c9-400d-46b4-830d-6e56d9caf4bb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:46.486641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03d9c9c9-400d-46b4-830d-6e56d9caf4bb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:46.487500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03d9c9c9-400d-46b4-830d-6e56d9caf4bb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:46.488415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03d9c9c9-400d-46b4-830d-6e56d9caf4bb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:46.488974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03d9c9c9-400d-46b4-830d-6e56d9caf4bb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:46.489420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03d9c9c9-400d-46b4-830d-6e56d9caf4bb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:46.599625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d79781ca-2bb6-4750-9857-982f198d51c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:46.604814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d79781ca-2bb6-4750-9857-982f198d51c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:46.621521 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=10 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:46.632547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d79781ca-2bb6-4750-9857-982f198d51c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:46.633250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d79781ca-2bb6-4750-9857-982f198d51c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:46.633801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d79781ca-2bb6-4750-9857-982f198d51c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:46.635869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d79781ca-2bb6-4750-9857-982f198d51c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:46.636670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d79781ca-2bb6-4750-9857-982f198d51c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:46.639344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d79781ca-2bb6-4750-9857-982f198d51c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:46.666902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-03d9c9c9-400d-46b4-830d-6e56d9caf4bb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:46.675168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-03d9c9c9-400d-46b4-830d-6e56d9caf4bb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.206338 Sep 01 05:18:46.675873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 259/551] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:46 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:46.717244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-edc53735-a6bd-44e2-a004-366d7b5e2c59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:46.717849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-edc53735-a6bd-44e2-a004-366d7b5e2c59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:46.725125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edc53735-a6bd-44e2-a004-366d7b5e2c59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:46.725643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edc53735-a6bd-44e2-a004-366d7b5e2c59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:46.726084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edc53735-a6bd-44e2-a004-366d7b5e2c59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:46.726845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edc53735-a6bd-44e2-a004-366d7b5e2c59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:46.727302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edc53735-a6bd-44e2-a004-366d7b5e2c59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:46.727723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edc53735-a6bd-44e2-a004-366d7b5e2c59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:46.788221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d79781ca-2bb6-4750-9857-982f198d51c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:46.796363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d79781ca-2bb6-4750-9857-982f198d51c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.207227 Sep 01 05:18:46.796975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 293/552] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:46 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:46.860839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-edc53735-a6bd-44e2-a004-366d7b5e2c59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:46.868817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-edc53735-a6bd-44e2-a004-366d7b5e2c59 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1665 microversion: 2.1 time: 0.155383 Sep 01 05:18:46.869377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 260/553] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:46 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:47.695447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6916a9d1-4d54-4f3d-9ad5-407687913af7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:47.696064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6916a9d1-4d54-4f3d-9ad5-407687913af7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:47.702507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6916a9d1-4d54-4f3d-9ad5-407687913af7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:47.702983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6916a9d1-4d54-4f3d-9ad5-407687913af7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:47.703415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6916a9d1-4d54-4f3d-9ad5-407687913af7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:47.704098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6916a9d1-4d54-4f3d-9ad5-407687913af7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:47.704550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6916a9d1-4d54-4f3d-9ad5-407687913af7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:47.705030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6916a9d1-4d54-4f3d-9ad5-407687913af7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:47.818216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9557e40e-1aa3-4815-8830-adb52931a728 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:47.818825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9557e40e-1aa3-4815-8830-adb52931a728 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:47.825179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9557e40e-1aa3-4815-8830-adb52931a728 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:47.825657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9557e40e-1aa3-4815-8830-adb52931a728 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:47.826090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9557e40e-1aa3-4815-8830-adb52931a728 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:47.826772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9557e40e-1aa3-4815-8830-adb52931a728 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:47.827221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9557e40e-1aa3-4815-8830-adb52931a728 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:47.827636 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9557e40e-1aa3-4815-8830-adb52931a728 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:47.835286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6916a9d1-4d54-4f3d-9ad5-407687913af7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:47.842788 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6916a9d1-4d54-4f3d-9ad5-407687913af7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.151130 Sep 01 05:18:47.843358 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 294/554] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:47 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:47.890380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0a56c282-e351-4637-8513-e50fa420352a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:47.891215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0a56c282-e351-4637-8513-e50fa420352a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:47.898015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a56c282-e351-4637-8513-e50fa420352a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:47.898578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a56c282-e351-4637-8513-e50fa420352a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:47.899085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a56c282-e351-4637-8513-e50fa420352a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:47.899935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a56c282-e351-4637-8513-e50fa420352a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:47.900479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a56c282-e351-4637-8513-e50fa420352a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:47.901024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a56c282-e351-4637-8513-e50fa420352a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:47.962593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9557e40e-1aa3-4815-8830-adb52931a728 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:47.970814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9557e40e-1aa3-4815-8830-adb52931a728 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156717 Sep 01 05:18:47.971905 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 261/555] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:48.029399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0a56c282-e351-4637-8513-e50fa420352a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:48.038012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0a56c282-e351-4637-8513-e50fa420352a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1665 microversion: 2.1 time: 0.151643 Sep 01 05:18:48.038570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 295/556] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:47 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:48.864720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-32609c6d-f69d-49a1-81dc-da2220dbd592 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:48.865538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-32609c6d-f69d-49a1-81dc-da2220dbd592 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:48.872309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32609c6d-f69d-49a1-81dc-da2220dbd592 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:48.872814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32609c6d-f69d-49a1-81dc-da2220dbd592 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:48.873257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32609c6d-f69d-49a1-81dc-da2220dbd592 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:48.873951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32609c6d-f69d-49a1-81dc-da2220dbd592 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:48.874403 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32609c6d-f69d-49a1-81dc-da2220dbd592 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:48.874825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32609c6d-f69d-49a1-81dc-da2220dbd592 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:48.951139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8e4f4ba4-54f1-46e0-ab61-daacc529b7b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:48.951703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8e4f4ba4-54f1-46e0-ab61-daacc529b7b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:48.959299 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8e4f4ba4-54f1-46e0-ab61-daacc529b7b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:48.959784 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8e4f4ba4-54f1-46e0-ab61-daacc529b7b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:48.960215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8e4f4ba4-54f1-46e0-ab61-daacc529b7b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:48.960936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8e4f4ba4-54f1-46e0-ab61-daacc529b7b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:48.961388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8e4f4ba4-54f1-46e0-ab61-daacc529b7b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:48.961807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8e4f4ba4-54f1-46e0-ab61-daacc529b7b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:48.996388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8e4f4ba4-54f1-46e0-ab61-daacc529b7b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments/a9a9dbef-f089-4cdd-ab34-7af7f169bfa0" status: 200 len: 194 microversion: 2.20 time: 0.049316 Sep 01 05:18:48.997024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 296/557] 10.222.0.49 () {60 vars in 1454 bytes} [Thu Sep 1 05:18:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments/a9a9dbef-f089-4cdd-ab34-7af7f169bfa0 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:18:49.001500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6182e4c3-f11b-4945-9176-945ce12bcccc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:49.002118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6182e4c3-f11b-4945-9176-945ce12bcccc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:49.008737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6182e4c3-f11b-4945-9176-945ce12bcccc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.009296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6182e4c3-f11b-4945-9176-945ce12bcccc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.009739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6182e4c3-f11b-4945-9176-945ce12bcccc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.010439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6182e4c3-f11b-4945-9176-945ce12bcccc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.010885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6182e4c3-f11b-4945-9176-945ce12bcccc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.011281 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6182e4c3-f11b-4945-9176-945ce12bcccc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.014745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-32609c6d-f69d-49a1-81dc-da2220dbd592 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:49.024504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-32609c6d-f69d-49a1-81dc-da2220dbd592 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.163798 Sep 01 05:18:49.025115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 262/558] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:48 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:49.059460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0a2c529d-70eb-4de5-a540-840f534ad265 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:49.060073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0a2c529d-70eb-4de5-a540-840f534ad265 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:49.066832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a2c529d-70eb-4de5-a540-840f534ad265 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.067306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a2c529d-70eb-4de5-a540-840f534ad265 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.067730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a2c529d-70eb-4de5-a540-840f534ad265 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.068413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a2c529d-70eb-4de5-a540-840f534ad265 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.068880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a2c529d-70eb-4de5-a540-840f534ad265 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.069300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a2c529d-70eb-4de5-a540-840f534ad265 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.150907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6182e4c3-f11b-4945-9176-945ce12bcccc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:49.159927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6182e4c3-f11b-4945-9176-945ce12bcccc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.161928 Sep 01 05:18:49.160484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 297/559] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:48 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:49.165378 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-78b34998-1ad1-4d23-94b6-0c91e51bcce3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:49.165859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-78b34998-1ad1-4d23-94b6-0c91e51bcce3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:49.171956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78b34998-1ad1-4d23-94b6-0c91e51bcce3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.172441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78b34998-1ad1-4d23-94b6-0c91e51bcce3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.172894 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78b34998-1ad1-4d23-94b6-0c91e51bcce3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.173960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78b34998-1ad1-4d23-94b6-0c91e51bcce3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.175050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78b34998-1ad1-4d23-94b6-0c91e51bcce3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.175463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78b34998-1ad1-4d23-94b6-0c91e51bcce3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.202280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0a2c529d-70eb-4de5-a540-840f534ad265 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:49.210040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0a2c529d-70eb-4de5-a540-840f534ad265 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1665 microversion: 2.1 time: 0.155019 Sep 01 05:18:49.210605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 263/560] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:49 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:49.297600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-78b34998-1ad1-4d23-94b6-0c91e51bcce3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lazy-loading 'services' on Instance uuid 2a582556-d184-4047-ac19-285c0edd2fdf {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:18:49.420235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-78b34998-1ad1-4d23-94b6-0c91e51bcce3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments/a9a9dbef-f089-4cdd-ab34-7af7f169bfa0" status: 202 len: 0 microversion: 2.20 time: 0.258529 Sep 01 05:18:49.420829 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 298/561] 10.222.0.49 () {60 vars in 1457 bytes} [Thu Sep 1 05:18:49 2022] DELETE /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments/a9a9dbef-f089-4cdd-ab34-7af7f169bfa0 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:49.430242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-763eb5d5-2c6b-4a75-b749-5c2daf2976ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:49.432743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-763eb5d5-2c6b-4a75-b749-5c2daf2976ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:49.438735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-763eb5d5-2c6b-4a75-b749-5c2daf2976ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.439295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-763eb5d5-2c6b-4a75-b749-5c2daf2976ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.439649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-763eb5d5-2c6b-4a75-b749-5c2daf2976ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.440335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-763eb5d5-2c6b-4a75-b749-5c2daf2976ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.440841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-763eb5d5-2c6b-4a75-b749-5c2daf2976ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.441226 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-763eb5d5-2c6b-4a75-b749-5c2daf2976ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.470122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-763eb5d5-2c6b-4a75-b749-5c2daf2976ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044022 Sep 01 05:18:49.470598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 264/562] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:18:49 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:18:50.046112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4f0ee55d-6850-41aa-b3dd-396c5b1c47ce tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:50.046921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4f0ee55d-6850-41aa-b3dd-396c5b1c47ce tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:50.054227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4f0ee55d-6850-41aa-b3dd-396c5b1c47ce tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:50.054707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4f0ee55d-6850-41aa-b3dd-396c5b1c47ce tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:50.055139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4f0ee55d-6850-41aa-b3dd-396c5b1c47ce tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:50.055818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4f0ee55d-6850-41aa-b3dd-396c5b1c47ce tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:50.056272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4f0ee55d-6850-41aa-b3dd-396c5b1c47ce tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:50.056989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4f0ee55d-6850-41aa-b3dd-396c5b1c47ce tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:50.182802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-be994678-60cf-4789-b05c-b027e5f7df9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:50.183383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-be994678-60cf-4789-b05c-b027e5f7df9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:50.187796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4f0ee55d-6850-41aa-b3dd-396c5b1c47ce tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:50.190304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-be994678-60cf-4789-b05c-b027e5f7df9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:50.190802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-be994678-60cf-4789-b05c-b027e5f7df9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:50.191233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-be994678-60cf-4789-b05c-b027e5f7df9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:50.191915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-be994678-60cf-4789-b05c-b027e5f7df9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:50.192357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-be994678-60cf-4789-b05c-b027e5f7df9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:50.192768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-be994678-60cf-4789-b05c-b027e5f7df9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:50.196191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4f0ee55d-6850-41aa-b3dd-396c5b1c47ce tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.154353 Sep 01 05:18:50.196755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 299/563] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:50 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:50.231383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d55fbccc-e200-4708-b229-5c06b7087679 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:50.232133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d55fbccc-e200-4708-b229-5c06b7087679 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:50.239193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d55fbccc-e200-4708-b229-5c06b7087679 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:50.239687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d55fbccc-e200-4708-b229-5c06b7087679 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:50.240225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d55fbccc-e200-4708-b229-5c06b7087679 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:50.240861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d55fbccc-e200-4708-b229-5c06b7087679 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:50.241317 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d55fbccc-e200-4708-b229-5c06b7087679 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:50.241740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d55fbccc-e200-4708-b229-5c06b7087679 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:50.333764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-be994678-60cf-4789-b05c-b027e5f7df9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:50.342348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-be994678-60cf-4789-b05c-b027e5f7df9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.163600 Sep 01 05:18:50.343213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 265/564] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:50 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:50.391089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d55fbccc-e200-4708-b229-5c06b7087679 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:50.399222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d55fbccc-e200-4708-b229-5c06b7087679 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1665 microversion: 2.1 time: 0.171655 Sep 01 05:18:50.399801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 300/565] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:50 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1665 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:50.482908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c417ecf0-41a2-4dbd-9cfc-03d1d6b22bfb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:50.485080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c417ecf0-41a2-4dbd-9cfc-03d1d6b22bfb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:50.492121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c417ecf0-41a2-4dbd-9cfc-03d1d6b22bfb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:50.492597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c417ecf0-41a2-4dbd-9cfc-03d1d6b22bfb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:50.493068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c417ecf0-41a2-4dbd-9cfc-03d1d6b22bfb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:50.493751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c417ecf0-41a2-4dbd-9cfc-03d1d6b22bfb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:50.494198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c417ecf0-41a2-4dbd-9cfc-03d1d6b22bfb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:50.494613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c417ecf0-41a2-4dbd-9cfc-03d1d6b22bfb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:50.525143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c417ecf0-41a2-4dbd-9cfc-03d1d6b22bfb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046088 Sep 01 05:18:50.525612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 266/566] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:18:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:18:51.223594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cc7dda81-5f38-4c48-a743-1d621cf8c89f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:51.225237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cc7dda81-5f38-4c48-a743-1d621cf8c89f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:51.238421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc7dda81-5f38-4c48-a743-1d621cf8c89f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.238930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc7dda81-5f38-4c48-a743-1d621cf8c89f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.239350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc7dda81-5f38-4c48-a743-1d621cf8c89f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.240542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc7dda81-5f38-4c48-a743-1d621cf8c89f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.241030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc7dda81-5f38-4c48-a743-1d621cf8c89f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.241492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc7dda81-5f38-4c48-a743-1d621cf8c89f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.364543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c7273a80-c993-4217-b7e6-c5a0a57ab792 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:51.365184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c7273a80-c993-4217-b7e6-c5a0a57ab792 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:51.371466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7273a80-c993-4217-b7e6-c5a0a57ab792 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.371942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7273a80-c993-4217-b7e6-c5a0a57ab792 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.372371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7273a80-c993-4217-b7e6-c5a0a57ab792 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.373088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7273a80-c993-4217-b7e6-c5a0a57ab792 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.373541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7273a80-c993-4217-b7e6-c5a0a57ab792 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.374008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7273a80-c993-4217-b7e6-c5a0a57ab792 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.376811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cc7dda81-5f38-4c48-a743-1d621cf8c89f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:51.384973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cc7dda81-5f38-4c48-a743-1d621cf8c89f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.172107 Sep 01 05:18:51.385622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 301/567] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:51 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:51.421001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-889457d9-0389-4574-b022-6d8e4631dc66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:51.421729 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-889457d9-0389-4574-b022-6d8e4631dc66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:51.428180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-889457d9-0389-4574-b022-6d8e4631dc66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.428684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-889457d9-0389-4574-b022-6d8e4631dc66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.429282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-889457d9-0389-4574-b022-6d8e4631dc66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.429982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-889457d9-0389-4574-b022-6d8e4631dc66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.430412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-889457d9-0389-4574-b022-6d8e4631dc66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.430826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-889457d9-0389-4574-b022-6d8e4631dc66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.506284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c7273a80-c993-4217-b7e6-c5a0a57ab792 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:51.514478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c7273a80-c993-4217-b7e6-c5a0a57ab792 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154568 Sep 01 05:18:51.515352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 267/568] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:51.537310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5c344a42-48b8-4965-b3ec-f4e2a7adb510 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:51.539415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5c344a42-48b8-4965-b3ec-f4e2a7adb510 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:51.545550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c344a42-48b8-4965-b3ec-f4e2a7adb510 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.546031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c344a42-48b8-4965-b3ec-f4e2a7adb510 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.546459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c344a42-48b8-4965-b3ec-f4e2a7adb510 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.547161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c344a42-48b8-4965-b3ec-f4e2a7adb510 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.547600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c344a42-48b8-4965-b3ec-f4e2a7adb510 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.548012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c344a42-48b8-4965-b3ec-f4e2a7adb510 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.567822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-889457d9-0389-4574-b022-6d8e4631dc66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:51.575614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-889457d9-0389-4574-b022-6d8e4631dc66 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1669 microversion: 2.1 time: 0.158515 Sep 01 05:18:51.576275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 302/569] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:51 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:51.578625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5c344a42-48b8-4965-b3ec-f4e2a7adb510 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045838 Sep 01 05:18:51.579332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 268/570] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:18:51 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:18:51.937668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-885120fc-15c5-4f5a-a59a-3c0038e43c1e req-0e460933-770b-4b70-9a60-ffdebd091c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d673fb27-cefb-470e-85e8-9189c59d1c5c", "name": "network-vif-plugged", "status": "completed", "tag": "08c5bdfa-3bfb-49da-bc35-8290867af5b9"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:51.947541 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-885120fc-15c5-4f5a-a59a-3c0038e43c1e req-0e460933-770b-4b70-9a60-ffdebd091c7d service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.948102 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-885120fc-15c5-4f5a-a59a-3c0038e43c1e req-0e460933-770b-4b70-9a60-ffdebd091c7d service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.948606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-885120fc-15c5-4f5a-a59a-3c0038e43c1e req-0e460933-770b-4b70-9a60-ffdebd091c7d service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.960361 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-885120fc-15c5-4f5a-a59a-3c0038e43c1e req-0e460933-770b-4b70-9a60-ffdebd091c7d service nova] Creating event network-vif-plugged:08c5bdfa-3bfb-49da-bc35-8290867af5b9 for instance d673fb27-cefb-470e-85e8-9189c59d1c5c on hv-cinder-85391 Sep 01 05:18:51.965651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-885120fc-15c5-4f5a-a59a-3c0038e43c1e req-0e460933-770b-4b70-9a60-ffdebd091c7d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031576 Sep 01 05:18:51.966603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 303/571] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:18:52.405585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c81ba442-5e09-4a4e-addb-fd1dd7282839 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:52.406197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c81ba442-5e09-4a4e-addb-fd1dd7282839 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:52.413706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c81ba442-5e09-4a4e-addb-fd1dd7282839 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:52.414186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c81ba442-5e09-4a4e-addb-fd1dd7282839 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:52.414618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c81ba442-5e09-4a4e-addb-fd1dd7282839 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:52.415296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c81ba442-5e09-4a4e-addb-fd1dd7282839 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:52.415742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c81ba442-5e09-4a4e-addb-fd1dd7282839 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:52.416158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c81ba442-5e09-4a4e-addb-fd1dd7282839 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:52.539037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7e96b423-0a40-42e6-8156-92d8b7974bc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:52.539665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7e96b423-0a40-42e6-8156-92d8b7974bc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:52.546895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e96b423-0a40-42e6-8156-92d8b7974bc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:52.547392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e96b423-0a40-42e6-8156-92d8b7974bc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:52.547830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e96b423-0a40-42e6-8156-92d8b7974bc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:52.548607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e96b423-0a40-42e6-8156-92d8b7974bc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:52.549091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e96b423-0a40-42e6-8156-92d8b7974bc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:52.549820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e96b423-0a40-42e6-8156-92d8b7974bc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:52.555268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c81ba442-5e09-4a4e-addb-fd1dd7282839 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:52.564009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c81ba442-5e09-4a4e-addb-fd1dd7282839 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.162190 Sep 01 05:18:52.576829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 269/572] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:52 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:52.590993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1adba5b1-b2c7-4c6f-802c-7b374fe3b2dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:52.593240 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1adba5b1-b2c7-4c6f-802c-7b374fe3b2dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:52.600810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1adba5b1-b2c7-4c6f-802c-7b374fe3b2dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:52.601377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1adba5b1-b2c7-4c6f-802c-7b374fe3b2dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:52.601884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1adba5b1-b2c7-4c6f-802c-7b374fe3b2dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:52.602647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1adba5b1-b2c7-4c6f-802c-7b374fe3b2dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:52.603200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1adba5b1-b2c7-4c6f-802c-7b374fe3b2dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:52.603723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1adba5b1-b2c7-4c6f-802c-7b374fe3b2dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:52.638640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1adba5b1-b2c7-4c6f-802c-7b374fe3b2dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051599 Sep 01 05:18:52.639314 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 270/573] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:18:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:18:52.712963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7e96b423-0a40-42e6-8156-92d8b7974bc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:52.721159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7e96b423-0a40-42e6-8156-92d8b7974bc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.188361 Sep 01 05:18:52.722552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 304/574] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:53.584972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5ffd369b-461b-4731-9bc4-a9f5312e4fe4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:53.585575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5ffd369b-461b-4731-9bc4-a9f5312e4fe4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:53.591854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ffd369b-461b-4731-9bc4-a9f5312e4fe4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:53.592325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ffd369b-461b-4731-9bc4-a9f5312e4fe4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:53.592747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ffd369b-461b-4731-9bc4-a9f5312e4fe4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:53.593513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ffd369b-461b-4731-9bc4-a9f5312e4fe4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:53.593951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ffd369b-461b-4731-9bc4-a9f5312e4fe4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:53.594365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ffd369b-461b-4731-9bc4-a9f5312e4fe4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:53.651692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-20f3a832-e6b3-4d22-9b61-20c5f7c2f383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:53.654139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-20f3a832-e6b3-4d22-9b61-20c5f7c2f383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:53.661546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20f3a832-e6b3-4d22-9b61-20c5f7c2f383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:53.662107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20f3a832-e6b3-4d22-9b61-20c5f7c2f383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:53.662608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20f3a832-e6b3-4d22-9b61-20c5f7c2f383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:53.663362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20f3a832-e6b3-4d22-9b61-20c5f7c2f383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:53.663913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20f3a832-e6b3-4d22-9b61-20c5f7c2f383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:53.664393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20f3a832-e6b3-4d22-9b61-20c5f7c2f383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:53.695243 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-20f3a832-e6b3-4d22-9b61-20c5f7c2f383 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047367 Sep 01 05:18:53.695707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 305/575] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:18:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:18:53.726894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5ffd369b-461b-4731-9bc4-a9f5312e4fe4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:53.734425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5ffd369b-461b-4731-9bc4-a9f5312e4fe4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.153499 Sep 01 05:18:53.734980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 271/576] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:53 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:53.743588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b48799b9-d719-46f9-a0d2-8670051d5b5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:53.744193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b48799b9-d719-46f9-a0d2-8670051d5b5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:53.750187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b48799b9-d719-46f9-a0d2-8670051d5b5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:53.750667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b48799b9-d719-46f9-a0d2-8670051d5b5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:53.751097 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b48799b9-d719-46f9-a0d2-8670051d5b5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:53.751772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b48799b9-d719-46f9-a0d2-8670051d5b5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:53.752215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b48799b9-d719-46f9-a0d2-8670051d5b5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:53.753204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b48799b9-d719-46f9-a0d2-8670051d5b5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:53.882499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b48799b9-d719-46f9-a0d2-8670051d5b5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:53.890663 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b48799b9-d719-46f9-a0d2-8670051d5b5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1712 microversion: 2.1 time: 0.151004 Sep 01 05:18:53.891238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 306/577] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1712 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:54.000434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-33807c39-168c-40cd-a6a1-60bc5e134d0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:54.000997 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-33807c39-168c-40cd-a6a1-60bc5e134d0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:54.007549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33807c39-168c-40cd-a6a1-60bc5e134d0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.008027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33807c39-168c-40cd-a6a1-60bc5e134d0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.008464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33807c39-168c-40cd-a6a1-60bc5e134d0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.009279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33807c39-168c-40cd-a6a1-60bc5e134d0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.009734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33807c39-168c-40cd-a6a1-60bc5e134d0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.010162 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33807c39-168c-40cd-a6a1-60bc5e134d0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.090778 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-33807c39-168c-40cd-a6a1-60bc5e134d0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] HTTP exception thrown: Cannot 'detach_volume' instance 5fd99adb-f38e-4d43-82b1-529010509f72 while it is in vm_state rescued Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-33807c39-168c-40cd-a6a1-60bc5e134d0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Request method failure captured: Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: DELETE /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments/e593ac89-7421-4692-962f-80f6f95d7236 HTTP/1.1 Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED-3P2h09WzcNHsGu6ok1mj_IMYhqwx77kTgJsKM0gitT6TGjia6EkCndZLHg6xT83N873XLrlpv904xagMSkAmG1Zlxdul2gZ0FhgmaVCEFjcM_TONUvBFrLS_aZBFF8UKoy-4CcOUw9raG-n_hPk892NrcDNscsLrDlZUglZi8whI Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: db6e336d82254a9bafb2443958923d3d Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1376693752 Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:18:54.092410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:18:54.094047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_db6e336d82254a9bafb2443958923d3d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/db6e336d82254a9bafb2443958923d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/db6e336d82254a9bafb2443958923d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/db6e336d82254a9bafb2443958923d3d"}]}] Sep 01 05:18:54.094047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1376693752 Sep 01 05:18:54.094047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: db6e336d82254a9bafb2443958923d3d Sep 01 05:18:54.094047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1376693752 Sep 01 05:18:54.094047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-ServerRescueNegativeTestJSON-1376693752-project Sep 01 05:18:54.094047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:18:54.094047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:18:54.094047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 3f7ca41b422f45a0a62af9fba781a796 Sep 01 05:18:54.094047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1376693752-project Sep 01 05:18:54.094047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:18:54.094047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Cannot 'detach_volume' instance 5fd99adb-f38e-4d43-82b1-529010509f72 while it is in vm_state rescued Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'server_id': '5fd99adb-f38e-4d43-82b1-529010509f72', 'id': 'e593ac89-7421-4692-962f-80f6f95d7236'} Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5fd99adb-f38e-4d43-82b1-529010509f72 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:54.094864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5fd99adb-f38e-4d43-82b1-529010509f72 while it is in vm_state rescued Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5fd99adb-f38e-4d43-82b1-529010509f72 while it is in vm_state rescued Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:18:54.096433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-33807c39-168c-40cd-a6a1-60bc5e134d0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Returning 409 to user: Cannot 'detach_volume' instance 5fd99adb-f38e-4d43-82b1-529010509f72 while it is in vm_state rescued {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:54.097993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-33807c39-168c-40cd-a6a1-60bc5e134d0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments/e593ac89-7421-4692-962f-80f6f95d7236" status: 409 len: 152 microversion: 2.1 time: 0.097461 Sep 01 05:18:54.097993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 272/578] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 05:18:53 2022] DELETE /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments/e593ac89-7421-4692-962f-80f6f95d7236 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:18:54.102848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-557c9d07-5525-4d6d-a80b-f58dc062decb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:54.103379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-557c9d07-5525-4d6d-a80b-f58dc062decb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:54.109336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-557c9d07-5525-4d6d-a80b-f58dc062decb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.109809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-557c9d07-5525-4d6d-a80b-f58dc062decb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.110272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-557c9d07-5525-4d6d-a80b-f58dc062decb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.110945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-557c9d07-5525-4d6d-a80b-f58dc062decb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.111382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-557c9d07-5525-4d6d-a80b-f58dc062decb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.112297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-557c9d07-5525-4d6d-a80b-f58dc062decb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.159513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:54.180986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-557c9d07-5525-4d6d-a80b-f58dc062decb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "POST /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/action" status: 202 len: 0 microversion: 2.1 time: 0.081735 Sep 01 05:18:54.181865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 307/579] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:54 2022] POST /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:54.189789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f4826534-fdc0-4e05-88bd-5f0d9ee7fa97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:54.191030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f4826534-fdc0-4e05-88bd-5f0d9ee7fa97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:54.196981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4826534-fdc0-4e05-88bd-5f0d9ee7fa97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.197460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4826534-fdc0-4e05-88bd-5f0d9ee7fa97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.197895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4826534-fdc0-4e05-88bd-5f0d9ee7fa97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.198571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4826534-fdc0-4e05-88bd-5f0d9ee7fa97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.199017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4826534-fdc0-4e05-88bd-5f0d9ee7fa97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.199433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4826534-fdc0-4e05-88bd-5f0d9ee7fa97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.214671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:54.334493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f4826534-fdc0-4e05-88bd-5f0d9ee7fa97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:54.342572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f4826534-fdc0-4e05-88bd-5f0d9ee7fa97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1720 microversion: 2.1 time: 0.156544 Sep 01 05:18:54.343125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 273/580] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:54.708603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b6681e60-d4cc-4a20-b4b9-72d6cd1a87b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:54.710854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b6681e60-d4cc-4a20-b4b9-72d6cd1a87b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:54.716927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6681e60-d4cc-4a20-b4b9-72d6cd1a87b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.717411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6681e60-d4cc-4a20-b4b9-72d6cd1a87b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.717865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6681e60-d4cc-4a20-b4b9-72d6cd1a87b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.718548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6681e60-d4cc-4a20-b4b9-72d6cd1a87b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.718997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6681e60-d4cc-4a20-b4b9-72d6cd1a87b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.719581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6681e60-d4cc-4a20-b4b9-72d6cd1a87b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.751298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b6681e60-d4cc-4a20-b4b9-72d6cd1a87b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047531 Sep 01 05:18:54.752167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 308/581] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:18:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:18:54.756796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-72b8e9ed-2718-4a89-88e6-8158ce9b339f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:54.757837 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-72b8e9ed-2718-4a89-88e6-8158ce9b339f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:54.764718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72b8e9ed-2718-4a89-88e6-8158ce9b339f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.765296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72b8e9ed-2718-4a89-88e6-8158ce9b339f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.765794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72b8e9ed-2718-4a89-88e6-8158ce9b339f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.766481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72b8e9ed-2718-4a89-88e6-8158ce9b339f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.767077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72b8e9ed-2718-4a89-88e6-8158ce9b339f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.767502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72b8e9ed-2718-4a89-88e6-8158ce9b339f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.910551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72b8e9ed-2718-4a89-88e6-8158ce9b339f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:54.918503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-72b8e9ed-2718-4a89-88e6-8158ce9b339f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1266 microversion: 2.1 time: 0.166336 Sep 01 05:18:54.919368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 274/582] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:54 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:55.365679 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bdb01a3e-0552-4ee9-a3a2-41557cc74069 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:55.366323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bdb01a3e-0552-4ee9-a3a2-41557cc74069 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:55.372627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bdb01a3e-0552-4ee9-a3a2-41557cc74069 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.373155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bdb01a3e-0552-4ee9-a3a2-41557cc74069 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.373592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bdb01a3e-0552-4ee9-a3a2-41557cc74069 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:55.374272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bdb01a3e-0552-4ee9-a3a2-41557cc74069 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.374721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bdb01a3e-0552-4ee9-a3a2-41557cc74069 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.375136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bdb01a3e-0552-4ee9-a3a2-41557cc74069 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:55.506697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bdb01a3e-0552-4ee9-a3a2-41557cc74069 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:55.514903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bdb01a3e-0552-4ee9-a3a2-41557cc74069 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1720 microversion: 2.1 time: 0.153720 Sep 01 05:18:55.515460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 309/583] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:55 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:55.763626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cd8288ba-6a9a-4f9e-b613-2f87c04767b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:55.765989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cd8288ba-6a9a-4f9e-b613-2f87c04767b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:55.773061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd8288ba-6a9a-4f9e-b613-2f87c04767b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.773531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd8288ba-6a9a-4f9e-b613-2f87c04767b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.773958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd8288ba-6a9a-4f9e-b613-2f87c04767b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:55.774627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd8288ba-6a9a-4f9e-b613-2f87c04767b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.775072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd8288ba-6a9a-4f9e-b613-2f87c04767b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.775485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd8288ba-6a9a-4f9e-b613-2f87c04767b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:55.804232 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cd8288ba-6a9a-4f9e-b613-2f87c04767b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044579 Sep 01 05:18:55.804787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 275/584] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:18:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:18:55.940418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ecb18979-b459-4330-8ff0-1e5a7c178a9d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:55.941196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ecb18979-b459-4330-8ff0-1e5a7c178a9d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:55.947583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ecb18979-b459-4330-8ff0-1e5a7c178a9d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.948352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ecb18979-b459-4330-8ff0-1e5a7c178a9d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.948803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ecb18979-b459-4330-8ff0-1e5a7c178a9d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:55.949476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ecb18979-b459-4330-8ff0-1e5a7c178a9d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.949920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ecb18979-b459-4330-8ff0-1e5a7c178a9d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.950334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ecb18979-b459-4330-8ff0-1e5a7c178a9d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.081424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ecb18979-b459-4330-8ff0-1e5a7c178a9d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:56.089098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ecb18979-b459-4330-8ff0-1e5a7c178a9d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1452 microversion: 2.1 time: 0.152983 Sep 01 05:18:56.089651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 310/585] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:55 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:56.110275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-db2e24db-9e67-44ff-b230-2d3ef88116d2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:56.110879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-db2e24db-9e67-44ff-b230-2d3ef88116d2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:56.117446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db2e24db-9e67-44ff-b230-2d3ef88116d2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:56.117915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db2e24db-9e67-44ff-b230-2d3ef88116d2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:56.118338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db2e24db-9e67-44ff-b230-2d3ef88116d2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.119006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db2e24db-9e67-44ff-b230-2d3ef88116d2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:56.119443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db2e24db-9e67-44ff-b230-2d3ef88116d2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:56.119852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db2e24db-9e67-44ff-b230-2d3ef88116d2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.248225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-db2e24db-9e67-44ff-b230-2d3ef88116d2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:56.255726 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-db2e24db-9e67-44ff-b230-2d3ef88116d2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1452 microversion: 2.1 time: 0.149173 Sep 01 05:18:56.256279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 276/586] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:56 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:56.537744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-72b83078-674f-4ebd-b2f8-ec174dc63dee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:56.538362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-72b83078-674f-4ebd-b2f8-ec174dc63dee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:56.544490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72b83078-674f-4ebd-b2f8-ec174dc63dee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:56.545202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72b83078-674f-4ebd-b2f8-ec174dc63dee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:56.545684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72b83078-674f-4ebd-b2f8-ec174dc63dee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.546502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72b83078-674f-4ebd-b2f8-ec174dc63dee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:56.546954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72b83078-674f-4ebd-b2f8-ec174dc63dee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:56.547379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72b83078-674f-4ebd-b2f8-ec174dc63dee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.677803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-72b83078-674f-4ebd-b2f8-ec174dc63dee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:56.686098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-72b83078-674f-4ebd-b2f8-ec174dc63dee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1720 microversion: 2.1 time: 0.152903 Sep 01 05:18:56.686662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 311/587] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:56.817422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-eab8f083-a44e-46c2-9086-c7348b359ea3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:56.819695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-eab8f083-a44e-46c2-9086-c7348b359ea3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:56.836267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eab8f083-a44e-46c2-9086-c7348b359ea3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:56.836863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eab8f083-a44e-46c2-9086-c7348b359ea3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:56.837376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eab8f083-a44e-46c2-9086-c7348b359ea3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.838163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eab8f083-a44e-46c2-9086-c7348b359ea3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:56.838679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eab8f083-a44e-46c2-9086-c7348b359ea3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:56.839275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eab8f083-a44e-46c2-9086-c7348b359ea3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.871448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-eab8f083-a44e-46c2-9086-c7348b359ea3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058194 Sep 01 05:18:56.871794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 277/588] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:18:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:18:57.708435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cda7f0c2-59da-4894-80f8-503190ec63d1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:57.709079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cda7f0c2-59da-4894-80f8-503190ec63d1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:57.715410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cda7f0c2-59da-4894-80f8-503190ec63d1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.715964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cda7f0c2-59da-4894-80f8-503190ec63d1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.716464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cda7f0c2-59da-4894-80f8-503190ec63d1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.717265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cda7f0c2-59da-4894-80f8-503190ec63d1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.717713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cda7f0c2-59da-4894-80f8-503190ec63d1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.718128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cda7f0c2-59da-4894-80f8-503190ec63d1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.851086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cda7f0c2-59da-4894-80f8-503190ec63d1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:57.859285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cda7f0c2-59da-4894-80f8-503190ec63d1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1726 microversion: 2.1 time: 0.155041 Sep 01 05:18:57.859853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 312/589] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:57 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:57.880743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d09c555a-162a-4abf-8f5c-5d83c6a75fd2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:57.881336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d09c555a-162a-4abf-8f5c-5d83c6a75fd2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:57.883441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-138f7465-233b-4ef1-b46a-1ecaeb4f8727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:57.886051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-138f7465-233b-4ef1-b46a-1ecaeb4f8727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:57.888253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d09c555a-162a-4abf-8f5c-5d83c6a75fd2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.888926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d09c555a-162a-4abf-8f5c-5d83c6a75fd2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.889311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d09c555a-162a-4abf-8f5c-5d83c6a75fd2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.890703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d09c555a-162a-4abf-8f5c-5d83c6a75fd2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.891381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d09c555a-162a-4abf-8f5c-5d83c6a75fd2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.891979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d09c555a-162a-4abf-8f5c-5d83c6a75fd2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.894001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-138f7465-233b-4ef1-b46a-1ecaeb4f8727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.894726 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-138f7465-233b-4ef1-b46a-1ecaeb4f8727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.899467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-138f7465-233b-4ef1-b46a-1ecaeb4f8727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.900561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-138f7465-233b-4ef1-b46a-1ecaeb4f8727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.901372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-138f7465-233b-4ef1-b46a-1ecaeb4f8727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.901951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-138f7465-233b-4ef1-b46a-1ecaeb4f8727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.939167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-138f7465-233b-4ef1-b46a-1ecaeb4f8727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059530 Sep 01 05:18:57.939738 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 313/590] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:18:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:18:57.983156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-665ff8ef-bd1e-4c76-91b6-024c1ff4da35 req-2b0fdfce-ec25-4ee2-b680-8e9f5e619f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d673fb27-cefb-470e-85e8-9189c59d1c5c", "tag": "08c5bdfa-3bfb-49da-bc35-8290867af5b9"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:57.993514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-665ff8ef-bd1e-4c76-91b6-024c1ff4da35 req-2b0fdfce-ec25-4ee2-b680-8e9f5e619f20 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.994411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-665ff8ef-bd1e-4c76-91b6-024c1ff4da35 req-2b0fdfce-ec25-4ee2-b680-8e9f5e619f20 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.995251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-665ff8ef-bd1e-4c76-91b6-024c1ff4da35 req-2b0fdfce-ec25-4ee2-b680-8e9f5e619f20 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.996225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d09c555a-162a-4abf-8f5c-5d83c6a75fd2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119735 Sep 01 05:18:57.996833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 278/591] 10.222.0.49 () {58 vars in 1275 bytes} [Thu Sep 1 05:18:57 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:18:58.008019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-665ff8ef-bd1e-4c76-91b6-024c1ff4da35 req-2b0fdfce-ec25-4ee2-b680-8e9f5e619f20 service nova] Creating event network-changed:08c5bdfa-3bfb-49da-bc35-8290867af5b9 for instance d673fb27-cefb-470e-85e8-9189c59d1c5c on hv-cinder-85391 Sep 01 05:18:58.015247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-665ff8ef-bd1e-4c76-91b6-024c1ff4da35 req-2b0fdfce-ec25-4ee2-b680-8e9f5e619f20 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035796 Sep 01 05:18:58.016033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 314/592] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:18:58.952214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-38ac5558-51c3-4fb1-9b55-cd7d2ef2c57f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:58.954553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-38ac5558-51c3-4fb1-9b55-cd7d2ef2c57f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:58.961309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38ac5558-51c3-4fb1-9b55-cd7d2ef2c57f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:58.961787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38ac5558-51c3-4fb1-9b55-cd7d2ef2c57f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:58.962228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38ac5558-51c3-4fb1-9b55-cd7d2ef2c57f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:58.962935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38ac5558-51c3-4fb1-9b55-cd7d2ef2c57f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:58.963388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38ac5558-51c3-4fb1-9b55-cd7d2ef2c57f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:58.963808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38ac5558-51c3-4fb1-9b55-cd7d2ef2c57f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:59.001455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-38ac5558-51c3-4fb1-9b55-cd7d2ef2c57f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053236 Sep 01 05:18:59.002336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 279/593] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:18:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:18:59.504663 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-2f40df09-ad62-4378-bd3b-7129bffa837f req-45c4b21a-1e5d-4b1b-920d-8a6d10453417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd99adb-f38e-4d43-82b1-529010509f72", "tag": "7ce60b54-510b-440d-9175-fd0f98028fab"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:59.515039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-2f40df09-ad62-4378-bd3b-7129bffa837f req-45c4b21a-1e5d-4b1b-920d-8a6d10453417 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:59.515511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-2f40df09-ad62-4378-bd3b-7129bffa837f req-45c4b21a-1e5d-4b1b-920d-8a6d10453417 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:59.515940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-2f40df09-ad62-4378-bd3b-7129bffa837f req-45c4b21a-1e5d-4b1b-920d-8a6d10453417 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:59.526856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-2f40df09-ad62-4378-bd3b-7129bffa837f req-45c4b21a-1e5d-4b1b-920d-8a6d10453417 service nova] Creating event network-changed:7ce60b54-510b-440d-9175-fd0f98028fab for instance 5fd99adb-f38e-4d43-82b1-529010509f72 on hv-cinder-85391 Sep 01 05:18:59.531620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-2f40df09-ad62-4378-bd3b-7129bffa837f req-45c4b21a-1e5d-4b1b-920d-8a6d10453417 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032248 Sep 01 05:18:59.532203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 315/594] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:00.014684 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ae33a130-2983-4368-a7c2-be04ac7ed6bc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:00.017497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ae33a130-2983-4368-a7c2-be04ac7ed6bc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:00.024757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae33a130-2983-4368-a7c2-be04ac7ed6bc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:00.025305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae33a130-2983-4368-a7c2-be04ac7ed6bc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:00.025739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae33a130-2983-4368-a7c2-be04ac7ed6bc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:00.026612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae33a130-2983-4368-a7c2-be04ac7ed6bc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:00.027068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae33a130-2983-4368-a7c2-be04ac7ed6bc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:00.027488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae33a130-2983-4368-a7c2-be04ac7ed6bc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:00.064224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ae33a130-2983-4368-a7c2-be04ac7ed6bc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053468 Sep 01 05:19:00.064848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 280/595] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:00 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:01.078308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d04f50ae-d938-4fa0-9a58-82b3fa810749 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:01.081137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d04f50ae-d938-4fa0-9a58-82b3fa810749 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:01.087331 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d04f50ae-d938-4fa0-9a58-82b3fa810749 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:01.087812 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d04f50ae-d938-4fa0-9a58-82b3fa810749 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:01.088248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d04f50ae-d938-4fa0-9a58-82b3fa810749 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:01.088991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d04f50ae-d938-4fa0-9a58-82b3fa810749 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:01.089441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d04f50ae-d938-4fa0-9a58-82b3fa810749 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:01.089862 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d04f50ae-d938-4fa0-9a58-82b3fa810749 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:01.119843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d04f50ae-d938-4fa0-9a58-82b3fa810749 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046402 Sep 01 05:19:01.120389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 316/596] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:01.545671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-1abf4569-7502-4c69-9421-4915daf0a18e req-f0b0c868-211c-48a9-81e1-61efd004df6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd99adb-f38e-4d43-82b1-529010509f72", "tag": "7ce60b54-510b-440d-9175-fd0f98028fab"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:01.555996 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-1abf4569-7502-4c69-9421-4915daf0a18e req-f0b0c868-211c-48a9-81e1-61efd004df6a service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:01.556468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-1abf4569-7502-4c69-9421-4915daf0a18e req-f0b0c868-211c-48a9-81e1-61efd004df6a service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:01.557193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-1abf4569-7502-4c69-9421-4915daf0a18e req-f0b0c868-211c-48a9-81e1-61efd004df6a service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:01.568650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-1abf4569-7502-4c69-9421-4915daf0a18e req-f0b0c868-211c-48a9-81e1-61efd004df6a service nova] Creating event network-changed:7ce60b54-510b-440d-9175-fd0f98028fab for instance 5fd99adb-f38e-4d43-82b1-529010509f72 on hv-cinder-85391 Sep 01 05:19:01.573677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-1abf4569-7502-4c69-9421-4915daf0a18e req-f0b0c868-211c-48a9-81e1-61efd004df6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031666 Sep 01 05:19:01.574247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 281/597] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:02.131992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-06ebccc9-977b-4bec-b31c-5ebf3834256b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:02.134188 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-06ebccc9-977b-4bec-b31c-5ebf3834256b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:02.140941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06ebccc9-977b-4bec-b31c-5ebf3834256b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:02.141434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06ebccc9-977b-4bec-b31c-5ebf3834256b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:02.141868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06ebccc9-977b-4bec-b31c-5ebf3834256b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:02.142562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06ebccc9-977b-4bec-b31c-5ebf3834256b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:02.143070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06ebccc9-977b-4bec-b31c-5ebf3834256b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:02.143494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06ebccc9-977b-4bec-b31c-5ebf3834256b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:02.176928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-06ebccc9-977b-4bec-b31c-5ebf3834256b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048932 Sep 01 05:19:02.177518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 317/598] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:03.191796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-56ae7b1d-6222-441a-bde6-43d47d7482f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:03.193907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-56ae7b1d-6222-441a-bde6-43d47d7482f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:03.200384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56ae7b1d-6222-441a-bde6-43d47d7482f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:03.200890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56ae7b1d-6222-441a-bde6-43d47d7482f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:03.201320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56ae7b1d-6222-441a-bde6-43d47d7482f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:03.201992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56ae7b1d-6222-441a-bde6-43d47d7482f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:03.202438 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56ae7b1d-6222-441a-bde6-43d47d7482f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:03.202852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56ae7b1d-6222-441a-bde6-43d47d7482f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:03.232377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-56ae7b1d-6222-441a-bde6-43d47d7482f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045235 Sep 01 05:19:03.232947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 282/599] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:04.244249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d2e9a682-f6db-4527-9d0d-3f150ca48f2b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:04.246396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d2e9a682-f6db-4527-9d0d-3f150ca48f2b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:04.253222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d2e9a682-f6db-4527-9d0d-3f150ca48f2b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:04.253705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d2e9a682-f6db-4527-9d0d-3f150ca48f2b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:04.254134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d2e9a682-f6db-4527-9d0d-3f150ca48f2b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:04.254809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d2e9a682-f6db-4527-9d0d-3f150ca48f2b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:04.255283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d2e9a682-f6db-4527-9d0d-3f150ca48f2b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:04.255697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d2e9a682-f6db-4527-9d0d-3f150ca48f2b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:04.287666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d2e9a682-f6db-4527-9d0d-3f150ca48f2b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047478 Sep 01 05:19:04.288219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 318/600] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:05.300790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f956a546-ba48-47bf-aa9f-9b1289c91c1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:05.302929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f956a546-ba48-47bf-aa9f-9b1289c91c1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:05.309927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f956a546-ba48-47bf-aa9f-9b1289c91c1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:05.310403 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f956a546-ba48-47bf-aa9f-9b1289c91c1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:05.310827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f956a546-ba48-47bf-aa9f-9b1289c91c1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:05.311499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f956a546-ba48-47bf-aa9f-9b1289c91c1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:05.311938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f956a546-ba48-47bf-aa9f-9b1289c91c1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:05.312353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f956a546-ba48-47bf-aa9f-9b1289c91c1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:05.341278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f956a546-ba48-47bf-aa9f-9b1289c91c1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045050 Sep 01 05:19:05.341819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 283/601] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:06.353558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-35cc2f9f-ab8e-4667-97b2-8b86e0d95c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:06.355582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-35cc2f9f-ab8e-4667-97b2-8b86e0d95c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:06.361954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35cc2f9f-ab8e-4667-97b2-8b86e0d95c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:06.362531 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35cc2f9f-ab8e-4667-97b2-8b86e0d95c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:06.362972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35cc2f9f-ab8e-4667-97b2-8b86e0d95c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:06.363646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35cc2f9f-ab8e-4667-97b2-8b86e0d95c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:06.364088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35cc2f9f-ab8e-4667-97b2-8b86e0d95c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:06.364503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35cc2f9f-ab8e-4667-97b2-8b86e0d95c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:06.394233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-35cc2f9f-ab8e-4667-97b2-8b86e0d95c57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044648 Sep 01 05:19:06.394787 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 319/602] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:07.406531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a4ee76a8-10f5-4f38-84e9-753da4baeba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:07.408731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a4ee76a8-10f5-4f38-84e9-753da4baeba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:07.415296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4ee76a8-10f5-4f38-84e9-753da4baeba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:07.415770 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4ee76a8-10f5-4f38-84e9-753da4baeba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:07.416192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4ee76a8-10f5-4f38-84e9-753da4baeba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:07.416895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4ee76a8-10f5-4f38-84e9-753da4baeba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:07.417343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4ee76a8-10f5-4f38-84e9-753da4baeba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:07.417756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4ee76a8-10f5-4f38-84e9-753da4baeba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:07.447726 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a4ee76a8-10f5-4f38-84e9-753da4baeba3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045041 Sep 01 05:19:07.448376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 284/603] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:07 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:19:08.459602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c998df69-9d38-47b4-a0e3-dcf17ccc98e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:08.461801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c998df69-9d38-47b4-a0e3-dcf17ccc98e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:08.468251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c998df69-9d38-47b4-a0e3-dcf17ccc98e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:08.468738 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c998df69-9d38-47b4-a0e3-dcf17ccc98e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:08.469207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c998df69-9d38-47b4-a0e3-dcf17ccc98e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:08.469892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c998df69-9d38-47b4-a0e3-dcf17ccc98e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:08.470344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c998df69-9d38-47b4-a0e3-dcf17ccc98e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:08.470763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c998df69-9d38-47b4-a0e3-dcf17ccc98e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:08.503210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c998df69-9d38-47b4-a0e3-dcf17ccc98e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047031 Sep 01 05:19:08.503767 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 320/604] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:09.515496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-407a8eaf-4661-4ebc-b890-e9af7b2d57c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:09.517640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-407a8eaf-4661-4ebc-b890-e9af7b2d57c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:09.524701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-407a8eaf-4661-4ebc-b890-e9af7b2d57c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:09.525225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-407a8eaf-4661-4ebc-b890-e9af7b2d57c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:09.525653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-407a8eaf-4661-4ebc-b890-e9af7b2d57c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:09.526332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-407a8eaf-4661-4ebc-b890-e9af7b2d57c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:09.526770 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-407a8eaf-4661-4ebc-b890-e9af7b2d57c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:09.527183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-407a8eaf-4661-4ebc-b890-e9af7b2d57c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:09.560657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-407a8eaf-4661-4ebc-b890-e9af7b2d57c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049049 Sep 01 05:19:09.561228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 285/605] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:09 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:10.574090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b2b4ac30-e2a3-433d-bb83-553531de0615 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:10.576379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b2b4ac30-e2a3-433d-bb83-553531de0615 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:10.583468 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2b4ac30-e2a3-433d-bb83-553531de0615 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:10.583951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2b4ac30-e2a3-433d-bb83-553531de0615 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:10.584394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2b4ac30-e2a3-433d-bb83-553531de0615 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:10.585121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2b4ac30-e2a3-433d-bb83-553531de0615 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:10.585573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2b4ac30-e2a3-433d-bb83-553531de0615 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:10.585995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2b4ac30-e2a3-433d-bb83-553531de0615 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:10.615199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b2b4ac30-e2a3-433d-bb83-553531de0615 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045556 Sep 01 05:19:10.615749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 321/606] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:10 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:11.627082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7b7ea3cd-ecb5-4e17-8086-d27074c96d8e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:11.629276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7b7ea3cd-ecb5-4e17-8086-d27074c96d8e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:11.635912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7b7ea3cd-ecb5-4e17-8086-d27074c96d8e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:11.636394 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7b7ea3cd-ecb5-4e17-8086-d27074c96d8e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:11.636865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7b7ea3cd-ecb5-4e17-8086-d27074c96d8e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:11.637551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7b7ea3cd-ecb5-4e17-8086-d27074c96d8e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:11.638000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7b7ea3cd-ecb5-4e17-8086-d27074c96d8e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:11.638419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7b7ea3cd-ecb5-4e17-8086-d27074c96d8e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:11.670804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7b7ea3cd-ecb5-4e17-8086-d27074c96d8e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047723 Sep 01 05:19:11.671360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 286/607] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:12.683017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-504f9d36-cd74-4003-a87d-b3a4b0900f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:12.685167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-504f9d36-cd74-4003-a87d-b3a4b0900f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:12.691592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-504f9d36-cd74-4003-a87d-b3a4b0900f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:12.692076 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-504f9d36-cd74-4003-a87d-b3a4b0900f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:12.692512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-504f9d36-cd74-4003-a87d-b3a4b0900f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:12.693219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-504f9d36-cd74-4003-a87d-b3a4b0900f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:12.693670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-504f9d36-cd74-4003-a87d-b3a4b0900f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:12.694089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-504f9d36-cd74-4003-a87d-b3a4b0900f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:12.723702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-504f9d36-cd74-4003-a87d-b3a4b0900f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045039 Sep 01 05:19:12.724250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 322/608] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:12 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:13.736025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5d90efda-81af-4070-91f2-dd59df6483f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:13.738792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5d90efda-81af-4070-91f2-dd59df6483f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:13.741233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=68 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:13.746512 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d90efda-81af-4070-91f2-dd59df6483f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:13.746989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d90efda-81af-4070-91f2-dd59df6483f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:13.747422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d90efda-81af-4070-91f2-dd59df6483f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:13.748097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d90efda-81af-4070-91f2-dd59df6483f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:13.748549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d90efda-81af-4070-91f2-dd59df6483f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:13.748993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d90efda-81af-4070-91f2-dd59df6483f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:13.779539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5d90efda-81af-4070-91f2-dd59df6483f1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047564 Sep 01 05:19:13.780087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 287/609] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:13 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:14.792138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6f5765e5-7553-419b-ba0e-0b1c214e4c61 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:14.794316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6f5765e5-7553-419b-ba0e-0b1c214e4c61 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:14.802330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f5765e5-7553-419b-ba0e-0b1c214e4c61 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:14.802834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f5765e5-7553-419b-ba0e-0b1c214e4c61 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:14.803274 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f5765e5-7553-419b-ba0e-0b1c214e4c61 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:14.804028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f5765e5-7553-419b-ba0e-0b1c214e4c61 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:14.804536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f5765e5-7553-419b-ba0e-0b1c214e4c61 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:14.804989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f5765e5-7553-419b-ba0e-0b1c214e4c61 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:14.835294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6f5765e5-7553-419b-ba0e-0b1c214e4c61 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047144 Sep 01 05:19:14.835846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 323/610] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:15.847958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-742be1db-8c93-4aa7-8f36-4ef9b7575e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:15.849915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-742be1db-8c93-4aa7-8f36-4ef9b7575e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:15.856391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-742be1db-8c93-4aa7-8f36-4ef9b7575e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:15.856890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-742be1db-8c93-4aa7-8f36-4ef9b7575e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:15.857320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-742be1db-8c93-4aa7-8f36-4ef9b7575e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:15.857992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-742be1db-8c93-4aa7-8f36-4ef9b7575e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:15.858435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-742be1db-8c93-4aa7-8f36-4ef9b7575e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:15.858847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-742be1db-8c93-4aa7-8f36-4ef9b7575e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:15.889030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-742be1db-8c93-4aa7-8f36-4ef9b7575e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045285 Sep 01 05:19:15.889834 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 288/611] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:16.901312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-02d248ab-a1db-4d18-850e-1e765e792cde tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:16.903424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-02d248ab-a1db-4d18-850e-1e765e792cde tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:16.906888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=66 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:16.913553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02d248ab-a1db-4d18-850e-1e765e792cde tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:16.914070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02d248ab-a1db-4d18-850e-1e765e792cde tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:16.914502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02d248ab-a1db-4d18-850e-1e765e792cde tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:16.915187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02d248ab-a1db-4d18-850e-1e765e792cde tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:16.915630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02d248ab-a1db-4d18-850e-1e765e792cde tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:16.916049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02d248ab-a1db-4d18-850e-1e765e792cde tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:16.946303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-02d248ab-a1db-4d18-850e-1e765e792cde tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049055 Sep 01 05:19:16.946856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 324/612] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:16 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:17.959521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ac59b0d7-f413-43c9-8536-258264c240bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:17.961867 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ac59b0d7-f413-43c9-8536-258264c240bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:17.968649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac59b0d7-f413-43c9-8536-258264c240bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:17.969159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac59b0d7-f413-43c9-8536-258264c240bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:17.969593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac59b0d7-f413-43c9-8536-258264c240bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:17.970275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac59b0d7-f413-43c9-8536-258264c240bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:17.970723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac59b0d7-f413-43c9-8536-258264c240bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:17.971140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac59b0d7-f413-43c9-8536-258264c240bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:18.001101 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ac59b0d7-f413-43c9-8536-258264c240bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046268 Sep 01 05:19:18.001661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 289/613] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:17 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:19:19.013910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bbdf17a5-b9c7-4118-a192-4869b069de27 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:19.015999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bbdf17a5-b9c7-4118-a192-4869b069de27 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:19.022485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbdf17a5-b9c7-4118-a192-4869b069de27 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:19.022961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbdf17a5-b9c7-4118-a192-4869b069de27 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:19.023388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbdf17a5-b9c7-4118-a192-4869b069de27 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:19.024061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbdf17a5-b9c7-4118-a192-4869b069de27 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:19.024503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbdf17a5-b9c7-4118-a192-4869b069de27 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:19.024955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbdf17a5-b9c7-4118-a192-4869b069de27 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:19.038765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:19.055740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bbdf17a5-b9c7-4118-a192-4869b069de27 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045913 Sep 01 05:19:19.056296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 325/614] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:19 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:20.068539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-850e74d2-530d-41d8-99c1-a3b8bd91b326 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:20.070608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-850e74d2-530d-41d8-99c1-a3b8bd91b326 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:20.077010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-850e74d2-530d-41d8-99c1-a3b8bd91b326 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:20.077485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-850e74d2-530d-41d8-99c1-a3b8bd91b326 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:20.077912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-850e74d2-530d-41d8-99c1-a3b8bd91b326 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:20.078586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-850e74d2-530d-41d8-99c1-a3b8bd91b326 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:20.079025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-850e74d2-530d-41d8-99c1-a3b8bd91b326 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:20.079440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-850e74d2-530d-41d8-99c1-a3b8bd91b326 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:20.108084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-850e74d2-530d-41d8-99c1-a3b8bd91b326 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043868 Sep 01 05:19:20.108633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 290/615] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:21.120296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-148b4202-783a-4a11-bbb3-c5ae61b158a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:21.122394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-148b4202-783a-4a11-bbb3-c5ae61b158a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:21.129936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-148b4202-783a-4a11-bbb3-c5ae61b158a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:21.130600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-148b4202-783a-4a11-bbb3-c5ae61b158a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:21.131071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-148b4202-783a-4a11-bbb3-c5ae61b158a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:21.131959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-148b4202-783a-4a11-bbb3-c5ae61b158a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:21.132486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-148b4202-783a-4a11-bbb3-c5ae61b158a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:21.132936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-148b4202-783a-4a11-bbb3-c5ae61b158a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:21.163451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-148b4202-783a-4a11-bbb3-c5ae61b158a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047190 Sep 01 05:19:21.164014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 326/616] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:21 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:22.175439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-546db31f-b5b3-4242-af96-0e3676d4cca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:22.177879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-546db31f-b5b3-4242-af96-0e3676d4cca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:22.184482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-546db31f-b5b3-4242-af96-0e3676d4cca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:22.185002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-546db31f-b5b3-4242-af96-0e3676d4cca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:22.185434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-546db31f-b5b3-4242-af96-0e3676d4cca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:22.186111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-546db31f-b5b3-4242-af96-0e3676d4cca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:22.186560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-546db31f-b5b3-4242-af96-0e3676d4cca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:22.186976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-546db31f-b5b3-4242-af96-0e3676d4cca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:22.190523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:22.219002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-546db31f-b5b3-4242-af96-0e3676d4cca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047608 Sep 01 05:19:22.219566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 291/617] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:23.335555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c526389a-c817-495b-9583-1abd9528df0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:23.337805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c526389a-c817-495b-9583-1abd9528df0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:23.343662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c526389a-c817-495b-9583-1abd9528df0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:23.344140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c526389a-c817-495b-9583-1abd9528df0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:23.344567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c526389a-c817-495b-9583-1abd9528df0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:23.345280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c526389a-c817-495b-9583-1abd9528df0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:23.345727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c526389a-c817-495b-9583-1abd9528df0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:23.346139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c526389a-c817-495b-9583-1abd9528df0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:23.375289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c526389a-c817-495b-9583-1abd9528df0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147821 Sep 01 05:19:23.375826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 327/618] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:24.389107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ecbc646f-7d84-4c43-a60a-40c2a5c2cfa3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:24.391217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ecbc646f-7d84-4c43-a60a-40c2a5c2cfa3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:24.397734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecbc646f-7d84-4c43-a60a-40c2a5c2cfa3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:24.398235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecbc646f-7d84-4c43-a60a-40c2a5c2cfa3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:24.398663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecbc646f-7d84-4c43-a60a-40c2a5c2cfa3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:24.399502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecbc646f-7d84-4c43-a60a-40c2a5c2cfa3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:24.399950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecbc646f-7d84-4c43-a60a-40c2a5c2cfa3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:24.400370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecbc646f-7d84-4c43-a60a-40c2a5c2cfa3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:24.430327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ecbc646f-7d84-4c43-a60a-40c2a5c2cfa3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045275 Sep 01 05:19:24.430790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 292/619] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:25.443712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-825324a0-7f02-4a0d-8a83-d717d443f9da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:25.445859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-825324a0-7f02-4a0d-8a83-d717d443f9da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:25.452204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-825324a0-7f02-4a0d-8a83-d717d443f9da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:25.452675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-825324a0-7f02-4a0d-8a83-d717d443f9da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:25.453135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-825324a0-7f02-4a0d-8a83-d717d443f9da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:25.453808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-825324a0-7f02-4a0d-8a83-d717d443f9da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:25.454253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-825324a0-7f02-4a0d-8a83-d717d443f9da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:25.454667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-825324a0-7f02-4a0d-8a83-d717d443f9da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:25.484188 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-825324a0-7f02-4a0d-8a83-d717d443f9da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045341 Sep 01 05:19:25.484741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 328/620] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:26.496497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-592f3081-0c3b-4172-b7f0-a9d1e585437f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:26.498651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-592f3081-0c3b-4172-b7f0-a9d1e585437f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:26.505094 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-592f3081-0c3b-4172-b7f0-a9d1e585437f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:26.505735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-592f3081-0c3b-4172-b7f0-a9d1e585437f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:26.506174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-592f3081-0c3b-4172-b7f0-a9d1e585437f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:26.506861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-592f3081-0c3b-4172-b7f0-a9d1e585437f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:26.507312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-592f3081-0c3b-4172-b7f0-a9d1e585437f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:26.507734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-592f3081-0c3b-4172-b7f0-a9d1e585437f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:26.537993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-592f3081-0c3b-4172-b7f0-a9d1e585437f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045499 Sep 01 05:19:26.538546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 293/621] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:27.549773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2109b0e4-4c13-440d-800c-d7131e7c072b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:27.552717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2109b0e4-4c13-440d-800c-d7131e7c072b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:27.555157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:19:27.555308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:19:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments (ip 10.222.0.49) !!! Sep 01 05:19:27.563809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2109b0e4-4c13-440d-800c-d7131e7c072b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:27.564289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2109b0e4-4c13-440d-800c-d7131e7c072b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:27.564722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2109b0e4-4c13-440d-800c-d7131e7c072b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:27.565435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2109b0e4-4c13-440d-800c-d7131e7c072b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:27.565881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2109b0e4-4c13-440d-800c-d7131e7c072b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:27.566301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2109b0e4-4c13-440d-800c-d7131e7c072b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:27.596449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2109b0e4-4c13-440d-800c-d7131e7c072b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050703 Sep 01 05:19:27.597034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 329/622] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:27 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:28.610106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a2ab385c-114b-4b1e-a376-1a890498f6fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:28.612203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a2ab385c-114b-4b1e-a376-1a890498f6fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:28.619277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2ab385c-114b-4b1e-a376-1a890498f6fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:28.619748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2ab385c-114b-4b1e-a376-1a890498f6fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:28.620174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2ab385c-114b-4b1e-a376-1a890498f6fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:28.620864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2ab385c-114b-4b1e-a376-1a890498f6fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:28.621309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2ab385c-114b-4b1e-a376-1a890498f6fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:28.621723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2ab385c-114b-4b1e-a376-1a890498f6fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:28.650979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a2ab385c-114b-4b1e-a376-1a890498f6fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044857 Sep 01 05:19:28.651512 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 294/623] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:28 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:29.664456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2e76c6f2-5329-4da9-8471-83c91eda4f3c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:29.666651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2e76c6f2-5329-4da9-8471-83c91eda4f3c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:29.673083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e76c6f2-5329-4da9-8471-83c91eda4f3c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:29.673569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e76c6f2-5329-4da9-8471-83c91eda4f3c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:29.674008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e76c6f2-5329-4da9-8471-83c91eda4f3c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:29.674692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e76c6f2-5329-4da9-8471-83c91eda4f3c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:29.675140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e76c6f2-5329-4da9-8471-83c91eda4f3c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:29.675561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e76c6f2-5329-4da9-8471-83c91eda4f3c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:29.714172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2e76c6f2-5329-4da9-8471-83c91eda4f3c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054771 Sep 01 05:19:29.714734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 330/624] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:29 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:30.725952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8a9df92d-a8e8-4a85-8425-1d72690bf5b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:30.728096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8a9df92d-a8e8-4a85-8425-1d72690bf5b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:30.734568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a9df92d-a8e8-4a85-8425-1d72690bf5b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:30.735049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a9df92d-a8e8-4a85-8425-1d72690bf5b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:30.735488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a9df92d-a8e8-4a85-8425-1d72690bf5b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:30.736169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a9df92d-a8e8-4a85-8425-1d72690bf5b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:30.736623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a9df92d-a8e8-4a85-8425-1d72690bf5b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:30.737070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a9df92d-a8e8-4a85-8425-1d72690bf5b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:30.766766 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8a9df92d-a8e8-4a85-8425-1d72690bf5b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044943 Sep 01 05:19:30.767317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 295/625] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:30 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:31.153682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d276b644-d05a-42a8-ba25-ef85b0af9ab5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:31.155855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d276b644-d05a-42a8-ba25-ef85b0af9ab5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:31.162273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d276b644-d05a-42a8-ba25-ef85b0af9ab5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:31.162743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d276b644-d05a-42a8-ba25-ef85b0af9ab5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:31.163167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d276b644-d05a-42a8-ba25-ef85b0af9ab5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:31.163833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d276b644-d05a-42a8-ba25-ef85b0af9ab5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:31.164276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d276b644-d05a-42a8-ba25-ef85b0af9ab5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:31.164686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d276b644-d05a-42a8-ba25-ef85b0af9ab5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:31.197132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d276b644-d05a-42a8-ba25-ef85b0af9ab5 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047300 Sep 01 05:19:31.197667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 331/626] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:31 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:19:31.259359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b0e8d381-d235-46d3-a7eb-9e1d36e5865f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:31.259851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b0e8d381-d235-46d3-a7eb-9e1d36e5865f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:31.265706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0e8d381-d235-46d3-a7eb-9e1d36e5865f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:31.266181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0e8d381-d235-46d3-a7eb-9e1d36e5865f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:31.266612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0e8d381-d235-46d3-a7eb-9e1d36e5865f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:31.267379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0e8d381-d235-46d3-a7eb-9e1d36e5865f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:31.267772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0e8d381-d235-46d3-a7eb-9e1d36e5865f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:31.268190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0e8d381-d235-46d3-a7eb-9e1d36e5865f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:31.293750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b0e8d381-d235-46d3-a7eb-9e1d36e5865f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:19:31.367467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b0e8d381-d235-46d3-a7eb-9e1d36e5865f tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 204 len: 0 microversion: 2.1 time: 0.112468 Sep 01 05:19:31.368041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 296/627] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:19:31 2022] DELETE /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:19:31.376684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-117a84d4-df9e-4be5-9d5d-eb4466f9448a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:31.377331 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-117a84d4-df9e-4be5-9d5d-eb4466f9448a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:31.383819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-117a84d4-df9e-4be5-9d5d-eb4466f9448a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:31.384306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-117a84d4-df9e-4be5-9d5d-eb4466f9448a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:31.384886 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-117a84d4-df9e-4be5-9d5d-eb4466f9448a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:31.385575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-117a84d4-df9e-4be5-9d5d-eb4466f9448a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:31.386031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-117a84d4-df9e-4be5-9d5d-eb4466f9448a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:31.386456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-117a84d4-df9e-4be5-9d5d-eb4466f9448a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:31.573249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-117a84d4-df9e-4be5-9d5d-eb4466f9448a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:31.580920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-117a84d4-df9e-4be5-9d5d-eb4466f9448a tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1675 microversion: 2.1 time: 0.208160 Sep 01 05:19:31.581484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 332/628] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:31 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1675 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:31.779347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2280241b-a53c-4a38-aedc-63643d2640c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:31.781509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2280241b-a53c-4a38-aedc-63643d2640c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:31.788510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2280241b-a53c-4a38-aedc-63643d2640c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:31.789020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2280241b-a53c-4a38-aedc-63643d2640c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:31.789461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2280241b-a53c-4a38-aedc-63643d2640c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:31.790138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2280241b-a53c-4a38-aedc-63643d2640c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:31.790586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2280241b-a53c-4a38-aedc-63643d2640c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:31.791004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2280241b-a53c-4a38-aedc-63643d2640c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:31.821251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2280241b-a53c-4a38-aedc-63643d2640c0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046320 Sep 01 05:19:31.821799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 297/629] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:32.601962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4fc6df18-41b2-43dd-8f58-87ef10ba144d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:32.602574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4fc6df18-41b2-43dd-8f58-87ef10ba144d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:32.609039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4fc6df18-41b2-43dd-8f58-87ef10ba144d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:32.609526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4fc6df18-41b2-43dd-8f58-87ef10ba144d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:32.609963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4fc6df18-41b2-43dd-8f58-87ef10ba144d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:32.610650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4fc6df18-41b2-43dd-8f58-87ef10ba144d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:32.611107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4fc6df18-41b2-43dd-8f58-87ef10ba144d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:32.611532 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4fc6df18-41b2-43dd-8f58-87ef10ba144d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:32.738351 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4fc6df18-41b2-43dd-8f58-87ef10ba144d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:32.746634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4fc6df18-41b2-43dd-8f58-87ef10ba144d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1675 microversion: 2.1 time: 0.149191 Sep 01 05:19:32.747210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 333/630] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:32 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:32.833541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a4d5a21a-a307-4c03-8397-43398bcd92af tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:32.835653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a4d5a21a-a307-4c03-8397-43398bcd92af tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:32.842639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4d5a21a-a307-4c03-8397-43398bcd92af tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:32.843112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4d5a21a-a307-4c03-8397-43398bcd92af tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:32.843535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4d5a21a-a307-4c03-8397-43398bcd92af tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:32.844203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4d5a21a-a307-4c03-8397-43398bcd92af tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:32.844643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4d5a21a-a307-4c03-8397-43398bcd92af tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:32.845087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4d5a21a-a307-4c03-8397-43398bcd92af tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:32.874422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a4d5a21a-a307-4c03-8397-43398bcd92af tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044799 Sep 01 05:19:32.874905 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 298/631] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:33.767586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cab46609-7cc3-47ff-8c80-a4a7824a0133 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:33.768106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cab46609-7cc3-47ff-8c80-a4a7824a0133 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:33.775227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cab46609-7cc3-47ff-8c80-a4a7824a0133 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:33.775721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cab46609-7cc3-47ff-8c80-a4a7824a0133 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:33.776159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cab46609-7cc3-47ff-8c80-a4a7824a0133 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:33.776954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cab46609-7cc3-47ff-8c80-a4a7824a0133 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:33.777581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cab46609-7cc3-47ff-8c80-a4a7824a0133 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:33.778008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cab46609-7cc3-47ff-8c80-a4a7824a0133 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:33.887239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d3136821-7d77-46e1-be08-ba064ffcd07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:33.893827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d3136821-7d77-46e1-be08-ba064ffcd07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:33.900275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3136821-7d77-46e1-be08-ba064ffcd07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:33.900752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3136821-7d77-46e1-be08-ba064ffcd07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:33.901213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3136821-7d77-46e1-be08-ba064ffcd07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:33.901897 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3136821-7d77-46e1-be08-ba064ffcd07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:33.902347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3136821-7d77-46e1-be08-ba064ffcd07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:33.902761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3136821-7d77-46e1-be08-ba064ffcd07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:33.939689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d3136821-7d77-46e1-be08-ba064ffcd07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056375 Sep 01 05:19:33.940447 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 299/632] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:19:33.985749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cab46609-7cc3-47ff-8c80-a4a7824a0133 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:33.994253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cab46609-7cc3-47ff-8c80-a4a7824a0133 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1675 microversion: 2.1 time: 0.230569 Sep 01 05:19:33.994835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 334/633] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:33 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1675 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:34.436895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-2a4ae7a0-f120-4dce-8c85-39dbef5769f3 req-cbd84aaa-b9e2-4a17-82ab-53b8fac58a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3674edea-d05c-428c-896e-938f3891acc1", "name": "network-vif-deleted", "tag": "b84e0a09-0be3-4d95-aaaa-b1217f2ba513"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:34.450349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-2a4ae7a0-f120-4dce-8c85-39dbef5769f3 req-cbd84aaa-b9e2-4a17-82ab-53b8fac58a5b service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:34.451373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-2a4ae7a0-f120-4dce-8c85-39dbef5769f3 req-cbd84aaa-b9e2-4a17-82ab-53b8fac58a5b service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:34.452035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-2a4ae7a0-f120-4dce-8c85-39dbef5769f3 req-cbd84aaa-b9e2-4a17-82ab-53b8fac58a5b service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:34.464647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-2a4ae7a0-f120-4dce-8c85-39dbef5769f3 req-cbd84aaa-b9e2-4a17-82ab-53b8fac58a5b service nova] Creating event network-vif-deleted:b84e0a09-0be3-4d95-aaaa-b1217f2ba513 for instance 3674edea-d05c-428c-896e-938f3891acc1 on hv-cinder-85391 Sep 01 05:19:34.471598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-2a4ae7a0-f120-4dce-8c85-39dbef5769f3 req-cbd84aaa-b9e2-4a17-82ab-53b8fac58a5b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038575 Sep 01 05:19:34.472308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 300/634] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:34.953662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4ce8a287-8e83-4c27-b327-c6a4e4292b03 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:34.956145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4ce8a287-8e83-4c27-b327-c6a4e4292b03 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:34.963207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ce8a287-8e83-4c27-b327-c6a4e4292b03 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:34.963704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ce8a287-8e83-4c27-b327-c6a4e4292b03 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:34.964176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ce8a287-8e83-4c27-b327-c6a4e4292b03 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:34.964912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ce8a287-8e83-4c27-b327-c6a4e4292b03 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:34.965373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ce8a287-8e83-4c27-b327-c6a4e4292b03 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:34.965798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ce8a287-8e83-4c27-b327-c6a4e4292b03 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:34.999539 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4ce8a287-8e83-4c27-b327-c6a4e4292b03 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049829 Sep 01 05:19:35.000309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 335/635] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:35.015501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:35.016209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:35.024012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:35.024751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:35.025387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:35.026257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:35.026999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:35.027421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:35.066769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:35.067861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:35.068459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:35.069093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lazy-loading 'fault' on Instance uuid 3674edea-d05c-428c-896e-938f3891acc1 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:19:35.199302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:35.217759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3403a489-bf08-464f-8e8d-6811c1379b77 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 200 len: 1327 microversion: 2.1 time: 0.206378 Sep 01 05:19:35.218452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 301/636] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:35 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 1327 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:36.012093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b7919ed6-e5ff-4417-8cce-925e3d0a1776 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:36.014372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b7919ed6-e5ff-4417-8cce-925e3d0a1776 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:36.021825 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7919ed6-e5ff-4417-8cce-925e3d0a1776 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:36.022311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7919ed6-e5ff-4417-8cce-925e3d0a1776 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:36.022748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7919ed6-e5ff-4417-8cce-925e3d0a1776 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:36.023432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7919ed6-e5ff-4417-8cce-925e3d0a1776 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:36.023879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7919ed6-e5ff-4417-8cce-925e3d0a1776 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:36.024306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b7919ed6-e5ff-4417-8cce-925e3d0a1776 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:36.060023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b7919ed6-e5ff-4417-8cce-925e3d0a1776 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051778 Sep 01 05:19:36.060505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 336/637] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:36.242318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3ecb6090-f05a-4ee3-aba0-5c19d276c95c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:36.242943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3ecb6090-f05a-4ee3-aba0-5c19d276c95c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:36.249220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ecb6090-f05a-4ee3-aba0-5c19d276c95c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:36.249701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ecb6090-f05a-4ee3-aba0-5c19d276c95c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:36.250133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ecb6090-f05a-4ee3-aba0-5c19d276c95c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:36.250812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ecb6090-f05a-4ee3-aba0-5c19d276c95c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:36.251265 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ecb6090-f05a-4ee3-aba0-5c19d276c95c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:36.251683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ecb6090-f05a-4ee3-aba0-5c19d276c95c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:36.264672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-3ecb6090-f05a-4ee3-aba0-5c19d276c95c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] HTTP exception thrown: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3ecb6090-f05a-4ee3-aba0-5c19d276c95c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Request method failure captured: Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 HTTP/1.1 Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED-1ohArlcqyRQ3GM507mA8OeXhOwsTxgdizBpUNvCXmYXtRJMNdNMgvI2W73Djx5cuX-C6AuLvmhil688UiqvfZJECg1ycfiaSmD_FKvrkAwJR5Xs7U03aCnPlyNSCUltTGf9uM8U0IVZaVqbGURDD7lAhQ22x2H6IZ5nnsuIOeX5w Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 6c302f5c44be49e5ae6e7e6b8b1f6c1c Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:19:36.266306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:19:36.267880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6c302f5c44be49e5ae6e7e6b8b1f6c1c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}] Sep 01 05:19:36.267880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:19:36.267880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 6c302f5c44be49e5ae6e7e6b8b1f6c1c Sep 01 05:19:36.267880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:19:36.267880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeTestJSON-846640785-project Sep 01 05:19:36.267880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:19:36.267880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:19:36.267880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 11f90807029244ecb6ad7cf6e4d2ad80 Sep 01 05:19:36.267880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeTestJSON-846640785-project Sep 01 05:19:36.267880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:19:36.267880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:19:36.267880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '3674edea-d05c-428c-896e-938f3891acc1'} Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:36.268960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:19:36.270979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:19:36.272338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3ecb6090-f05a-4ee3-aba0-5c19d276c95c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Returning 404 to user: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:36.272338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3ecb6090-f05a-4ee3-aba0-5c19d276c95c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 404 len: 111 microversion: 2.1 time: 0.029261 Sep 01 05:19:36.272338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 302/638] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:36 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:19:36.277457 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e07aec09-0e1b-4949-b517-808af0cd9b8c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '.version_select at 0x7f9624d97d30>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:36.301896 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e07aec09-0e1b-4949-b517-808af0cd9b8c tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-466784186" status: 202 len: 0 microversion: 2.1 time: 0.028724 Sep 01 05:19:36.302449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 337/639] 10.222.0.49 () {58 vars in 1218 bytes} [Thu Sep 1 05:19:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-466784186 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:19:36.962781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0c2a67d6-dbb4-4fe9-993d-b67720d30aa1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Action: 'create', calling method: .version_select at 0x7f9624be2700>, body: {"keypair": {"name": "tempest-keypair-941541203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmWJf9oUT6hOhT78EW+KEPNQe+xyPEg6ks1XmU8PAN0jeKs+5RlT2pQexhl4V3cbR/ad4L6skN7Fuv+y3BlgkjzDIWE2ZkS+0UeMBDoyeAy/fUa+MUdNV3+4/a/p/hhcg=="}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:36.978561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-0c2a67d6-dbb4-4fe9-993d-b67720d30aa1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Getting quotas for project 6c302f5c44be49e5ae6e7e6b8b1f6c1c. Resources: {'key_pairs'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:19:36.982343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-0c2a67d6-dbb4-4fe9-993d-b67720d30aa1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Getting quotas for user 11f90807029244ecb6ad7cf6e4d2ad80 and project 6c302f5c44be49e5ae6e7e6b8b1f6c1c. Resources: {'key_pairs'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:19:37.003797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0c2a67d6-dbb4-4fe9-993d-b67720d30aa1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044937 Sep 01 05:19:37.004386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 303/640] 10.222.0.49 () {60 vars in 1159 bytes} [Thu Sep 1 05:19:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:37.072688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d26adf76-8929-4778-a1a8-8c04be647412 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:37.075078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d26adf76-8929-4778-a1a8-8c04be647412 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:37.082710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d26adf76-8929-4778-a1a8-8c04be647412 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:37.084565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d26adf76-8929-4778-a1a8-8c04be647412 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:37.085131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d26adf76-8929-4778-a1a8-8c04be647412 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:37.085835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d26adf76-8929-4778-a1a8-8c04be647412 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:37.086302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d26adf76-8929-4778-a1a8-8c04be647412 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:37.086715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d26adf76-8929-4778-a1a8-8c04be647412 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:37.117588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d26adf76-8929-4778-a1a8-8c04be647412 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049055 Sep 01 05:19:37.118166 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 338/641] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:37 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:37.637296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c7b449e6-bafe-4637-b0cf-7e555e48f655 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:37.637845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c7b449e6-bafe-4637-b0cf-7e555e48f655 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:37.644290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7b449e6-bafe-4637-b0cf-7e555e48f655 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:37.644765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7b449e6-bafe-4637-b0cf-7e555e48f655 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:37.645222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7b449e6-bafe-4637-b0cf-7e555e48f655 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:37.645960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7b449e6-bafe-4637-b0cf-7e555e48f655 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:37.646404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7b449e6-bafe-4637-b0cf-7e555e48f655 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:37.646821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7b449e6-bafe-4637-b0cf-7e555e48f655 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:37.726949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-c7b449e6-bafe-4637-b0cf-7e555e48f655 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lazy-loading 'services' on Instance uuid 5fd99adb-f38e-4d43-82b1-529010509f72 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:19:37.808408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c7b449e6-bafe-4637-b0cf-7e555e48f655 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments/e593ac89-7421-4692-962f-80f6f95d7236" status: 202 len: 0 microversion: 2.1 time: 0.175311 Sep 01 05:19:37.809051 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 304/642] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 05:19:37 2022] DELETE /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments/e593ac89-7421-4692-962f-80f6f95d7236 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:19:37.820669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7fa669a0-c75e-4972-baab-7bb122022328 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:37.824247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7fa669a0-c75e-4972-baab-7bb122022328 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:37.832585 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fa669a0-c75e-4972-baab-7bb122022328 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:37.833133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fa669a0-c75e-4972-baab-7bb122022328 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:37.833819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fa669a0-c75e-4972-baab-7bb122022328 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:37.834522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fa669a0-c75e-4972-baab-7bb122022328 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:37.834970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fa669a0-c75e-4972-baab-7bb122022328 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:37.835387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fa669a0-c75e-4972-baab-7bb122022328 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:37.872959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7fa669a0-c75e-4972-baab-7bb122022328 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058441 Sep 01 05:19:37.873749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 339/643] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:37 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:38.130605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c794530b-53a5-4d9a-8490-3cf9ca2313cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:38.132980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c794530b-53a5-4d9a-8490-3cf9ca2313cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:38.139081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c794530b-53a5-4d9a-8490-3cf9ca2313cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:38.139568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c794530b-53a5-4d9a-8490-3cf9ca2313cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:38.140003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c794530b-53a5-4d9a-8490-3cf9ca2313cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:38.140687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c794530b-53a5-4d9a-8490-3cf9ca2313cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:38.141165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c794530b-53a5-4d9a-8490-3cf9ca2313cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:38.141589 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c794530b-53a5-4d9a-8490-3cf9ca2313cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:38.173500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c794530b-53a5-4d9a-8490-3cf9ca2313cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047320 Sep 01 05:19:38.178863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 305/644] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:38 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:38.225943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-53658429", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28dd87ae-b139-4a92-8df3-d269621d39cb"}], "security_groups": [{"name": "tempest-securitygroup--350991801"}], "key_name": "tempest-keypair-941541203", "user_data": "}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:38.329584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.network.neutron [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] validate_networks() for [('28dd87ae-b139-4a92-8df3-d269621d39cb', None, None, None, None, None)] {{(pid=120674) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:19:38.733498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Flavor limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:19:38.733909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Image limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:19:38.734405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Flavor pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:19:38.734804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Image pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:19:38.735550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:19:38.744837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:38.745311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:38.745735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:38.746443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:38.746886 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:38.747297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:38.763900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Getting quotas for project 6c302f5c44be49e5ae6e7e6b8b1f6c1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:19:38.767767 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Getting quotas for user 11f90807029244ecb6ad7cf6e4d2ad80 and project 6c302f5c44be49e5ae6e7e6b8b1f6c1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:19:38.778537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Going to run 1 instances... {{(pid=120674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:19:38.780793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:19:38.828184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-515b17a7-5fc6-47fd-a729-1ba50fa5fbba tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.607099 Sep 01 05:19:38.829073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 340/645] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:19:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:19:38.839958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-58bbcb75-2681-41e0-98d1-9da952245425 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:38.840613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-58bbcb75-2681-41e0-98d1-9da952245425 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:38.886110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8fff6771-14cf-4fd6-839e-53a50f884e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:38.888586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8fff6771-14cf-4fd6-839e-53a50f884e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:38.897978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-58bbcb75-2681-41e0-98d1-9da952245425 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:38.900077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fff6771-14cf-4fd6-839e-53a50f884e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:38.900576 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fff6771-14cf-4fd6-839e-53a50f884e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:38.901036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fff6771-14cf-4fd6-839e-53a50f884e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:38.901911 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fff6771-14cf-4fd6-839e-53a50f884e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:38.902369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fff6771-14cf-4fd6-839e-53a50f884e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:38.902792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8fff6771-14cf-4fd6-839e-53a50f884e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:38.905812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-58bbcb75-2681-41e0-98d1-9da952245425 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1235 microversion: 2.1 time: 0.069753 Sep 01 05:19:38.912287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 306/646] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:38 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1235 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:38.934540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8fff6771-14cf-4fd6-839e-53a50f884e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052562 Sep 01 05:19:38.935103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 341/647] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:38 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:39.186818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6959b09d-b9a3-481f-b89f-e31fb74a1683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:39.189041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6959b09d-b9a3-481f-b89f-e31fb74a1683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:39.198020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6959b09d-b9a3-481f-b89f-e31fb74a1683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:39.199582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6959b09d-b9a3-481f-b89f-e31fb74a1683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:39.199985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6959b09d-b9a3-481f-b89f-e31fb74a1683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:39.200676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6959b09d-b9a3-481f-b89f-e31fb74a1683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:39.201154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6959b09d-b9a3-481f-b89f-e31fb74a1683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:39.201571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6959b09d-b9a3-481f-b89f-e31fb74a1683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:39.233596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6959b09d-b9a3-481f-b89f-e31fb74a1683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050868 Sep 01 05:19:39.234182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 307/648] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:39 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:39.926394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d27ef97a-f84b-4ff9-9cc9-448b7ab488d6 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:39.927608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d27ef97a-f84b-4ff9-9cc9-448b7ab488d6 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:39.934305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d27ef97a-f84b-4ff9-9cc9-448b7ab488d6 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:39.934781 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d27ef97a-f84b-4ff9-9cc9-448b7ab488d6 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:39.935209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d27ef97a-f84b-4ff9-9cc9-448b7ab488d6 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:39.935879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d27ef97a-f84b-4ff9-9cc9-448b7ab488d6 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:39.936324 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d27ef97a-f84b-4ff9-9cc9-448b7ab488d6 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:39.936739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d27ef97a-f84b-4ff9-9cc9-448b7ab488d6 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:39.948038 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e85d0e0f-f45e-4546-ab1b-4c5fe03826e3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:39.950203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e85d0e0f-f45e-4546-ab1b-4c5fe03826e3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:39.956458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e85d0e0f-f45e-4546-ab1b-4c5fe03826e3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:39.956970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e85d0e0f-f45e-4546-ab1b-4c5fe03826e3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:39.957407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e85d0e0f-f45e-4546-ab1b-4c5fe03826e3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:39.958233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e85d0e0f-f45e-4546-ab1b-4c5fe03826e3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:39.959006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e85d0e0f-f45e-4546-ab1b-4c5fe03826e3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:39.959436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e85d0e0f-f45e-4546-ab1b-4c5fe03826e3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:39.973985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:39.993614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e85d0e0f-f45e-4546-ab1b-4c5fe03826e3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050070 Sep 01 05:19:39.994177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 308/649] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:19:40.001047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d27ef97a-f84b-4ff9-9cc9-448b7ab488d6 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:40.009624 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d27ef97a-f84b-4ff9-9cc9-448b7ab488d6 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1287 microversion: 2.1 time: 0.087121 Sep 01 05:19:40.010373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 342/650] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:39 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:40.247078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-80ebf939-c75c-410e-9210-f1a744b0c5c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:40.249197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-80ebf939-c75c-410e-9210-f1a744b0c5c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:40.264922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80ebf939-c75c-410e-9210-f1a744b0c5c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:40.265419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80ebf939-c75c-410e-9210-f1a744b0c5c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:40.265861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80ebf939-c75c-410e-9210-f1a744b0c5c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:40.266559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80ebf939-c75c-410e-9210-f1a744b0c5c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:40.267013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80ebf939-c75c-410e-9210-f1a744b0c5c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:40.267593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80ebf939-c75c-410e-9210-f1a744b0c5c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:40.299359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-80ebf939-c75c-410e-9210-f1a744b0c5c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056594 Sep 01 05:19:40.299919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 309/651] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:41.006042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bc47721a-8118-4496-b008-52b3e9d47ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:41.008334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bc47721a-8118-4496-b008-52b3e9d47ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:41.017144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc47721a-8118-4496-b008-52b3e9d47ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:41.017931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc47721a-8118-4496-b008-52b3e9d47ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:41.018446 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc47721a-8118-4496-b008-52b3e9d47ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:41.019388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc47721a-8118-4496-b008-52b3e9d47ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:41.019902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc47721a-8118-4496-b008-52b3e9d47ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:41.020326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc47721a-8118-4496-b008-52b3e9d47ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:41.030155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3f6c4030-7b31-4a5e-9b08-ac97c6f4e07e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:41.031338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3f6c4030-7b31-4a5e-9b08-ac97c6f4e07e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:41.038707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f6c4030-7b31-4a5e-9b08-ac97c6f4e07e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:41.039193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f6c4030-7b31-4a5e-9b08-ac97c6f4e07e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:41.039620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f6c4030-7b31-4a5e-9b08-ac97c6f4e07e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:41.040565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f6c4030-7b31-4a5e-9b08-ac97c6f4e07e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:41.041279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f6c4030-7b31-4a5e-9b08-ac97c6f4e07e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:41.041910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f6c4030-7b31-4a5e-9b08-ac97c6f4e07e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:41.058088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:41.069439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bc47721a-8118-4496-b008-52b3e9d47ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067560 Sep 01 05:19:41.073712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 343/652] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:41.199343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3f6c4030-7b31-4a5e-9b08-ac97c6f4e07e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:41.207306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3f6c4030-7b31-4a5e-9b08-ac97c6f4e07e tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1360 microversion: 2.1 time: 0.180771 Sep 01 05:19:41.208424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 310/653] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:41 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:41.313117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c3ddbc87-1895-4108-93f9-08456831ee94 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:41.315148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c3ddbc87-1895-4108-93f9-08456831ee94 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:41.321560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3ddbc87-1895-4108-93f9-08456831ee94 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:41.322048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3ddbc87-1895-4108-93f9-08456831ee94 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:41.322479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3ddbc87-1895-4108-93f9-08456831ee94 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:41.323165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3ddbc87-1895-4108-93f9-08456831ee94 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:41.323609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3ddbc87-1895-4108-93f9-08456831ee94 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:41.324025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3ddbc87-1895-4108-93f9-08456831ee94 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:41.355630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c3ddbc87-1895-4108-93f9-08456831ee94 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046872 Sep 01 05:19:41.360065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 344/654] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:41.733838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-1c19ce21-c97a-4aa1-b92b-eb5e59875e45 req-9b393c84-632f-4cd5-847a-8569ce354d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc80648-73e9-4ce0-9161-2a82c5634104", "tag": "e2267d61-043c-4be7-90fa-6dce08aea3bd"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:41.743578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-1c19ce21-c97a-4aa1-b92b-eb5e59875e45 req-9b393c84-632f-4cd5-847a-8569ce354d39 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:41.748601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-1c19ce21-c97a-4aa1-b92b-eb5e59875e45 req-9b393c84-632f-4cd5-847a-8569ce354d39 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:41.749523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-1c19ce21-c97a-4aa1-b92b-eb5e59875e45 req-9b393c84-632f-4cd5-847a-8569ce354d39 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:41.764201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-1c19ce21-c97a-4aa1-b92b-eb5e59875e45 req-9b393c84-632f-4cd5-847a-8569ce354d39 service nova] Creating event network-changed:e2267d61-043c-4be7-90fa-6dce08aea3bd for instance dbc80648-73e9-4ce0-9161-2a82c5634104 on hv-cinder-85391 Sep 01 05:19:41.769041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-1c19ce21-c97a-4aa1-b92b-eb5e59875e45 req-9b393c84-632f-4cd5-847a-8569ce354d39 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038773 Sep 01 05:19:41.769680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 311/655] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:42.081303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-008fa2cf-b7a9-4dc6-a0d0-7db90d7b2a49 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:42.083442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-008fa2cf-b7a9-4dc6-a0d0-7db90d7b2a49 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:42.089832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-008fa2cf-b7a9-4dc6-a0d0-7db90d7b2a49 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:42.090699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-008fa2cf-b7a9-4dc6-a0d0-7db90d7b2a49 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:42.091117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-008fa2cf-b7a9-4dc6-a0d0-7db90d7b2a49 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:42.091794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-008fa2cf-b7a9-4dc6-a0d0-7db90d7b2a49 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:42.092239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-008fa2cf-b7a9-4dc6-a0d0-7db90d7b2a49 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:42.092655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-008fa2cf-b7a9-4dc6-a0d0-7db90d7b2a49 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:42.122701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-008fa2cf-b7a9-4dc6-a0d0-7db90d7b2a49 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045389 Sep 01 05:19:42.123178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 345/656] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:42 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:42.230188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-79a2df1d-ee30-4221-a0fb-631590979c9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:42.230894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-79a2df1d-ee30-4221-a0fb-631590979c9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:42.237391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79a2df1d-ee30-4221-a0fb-631590979c9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:42.237876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79a2df1d-ee30-4221-a0fb-631590979c9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:42.238310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79a2df1d-ee30-4221-a0fb-631590979c9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:42.238995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79a2df1d-ee30-4221-a0fb-631590979c9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:42.241294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79a2df1d-ee30-4221-a0fb-631590979c9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:42.241294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79a2df1d-ee30-4221-a0fb-631590979c9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:42.368329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6048cfca-3c3d-4b39-a576-8d334441a0ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:42.370003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-79a2df1d-ee30-4221-a0fb-631590979c9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:42.370465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6048cfca-3c3d-4b39-a576-8d334441a0ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:42.376410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6048cfca-3c3d-4b39-a576-8d334441a0ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:42.376881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6048cfca-3c3d-4b39-a576-8d334441a0ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:42.377310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6048cfca-3c3d-4b39-a576-8d334441a0ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:42.377611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-79a2df1d-ee30-4221-a0fb-631590979c9d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1360 microversion: 2.1 time: 0.152282 Sep 01 05:19:42.377994 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6048cfca-3c3d-4b39-a576-8d334441a0ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:42.378159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 312/657] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:42 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:42.379006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6048cfca-3c3d-4b39-a576-8d334441a0ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:42.379006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6048cfca-3c3d-4b39-a576-8d334441a0ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:42.410098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6048cfca-3c3d-4b39-a576-8d334441a0ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046465 Sep 01 05:19:42.410647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 346/658] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:19:43.135443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f2523ddf-3afb-404a-b4f1-df0a3f0e2941 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:43.137593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f2523ddf-3afb-404a-b4f1-df0a3f0e2941 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:43.143683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2523ddf-3afb-404a-b4f1-df0a3f0e2941 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:43.144430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2523ddf-3afb-404a-b4f1-df0a3f0e2941 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:43.144582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2523ddf-3afb-404a-b4f1-df0a3f0e2941 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:43.145312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2523ddf-3afb-404a-b4f1-df0a3f0e2941 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:43.145843 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2523ddf-3afb-404a-b4f1-df0a3f0e2941 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:43.146204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2523ddf-3afb-404a-b4f1-df0a3f0e2941 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:43.176481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f2523ddf-3afb-404a-b4f1-df0a3f0e2941 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Sep 01 05:19:43.177073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 313/659] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:43 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:43.399275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e72cd8f5-f617-4d67-89ad-b755ff984d99 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:43.399809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e72cd8f5-f617-4d67-89ad-b755ff984d99 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:43.405771 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e72cd8f5-f617-4d67-89ad-b755ff984d99 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:43.406257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e72cd8f5-f617-4d67-89ad-b755ff984d99 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:43.406688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e72cd8f5-f617-4d67-89ad-b755ff984d99 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:43.407372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e72cd8f5-f617-4d67-89ad-b755ff984d99 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:43.407823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e72cd8f5-f617-4d67-89ad-b755ff984d99 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:43.408242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e72cd8f5-f617-4d67-89ad-b755ff984d99 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:43.423166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f5a9ceab-30b8-4cfe-b13f-c5e787187826 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:43.425569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f5a9ceab-30b8-4cfe-b13f-c5e787187826 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:43.434132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f5a9ceab-30b8-4cfe-b13f-c5e787187826 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:43.434617 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f5a9ceab-30b8-4cfe-b13f-c5e787187826 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:43.435223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f5a9ceab-30b8-4cfe-b13f-c5e787187826 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:43.436123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f5a9ceab-30b8-4cfe-b13f-c5e787187826 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:43.441346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f5a9ceab-30b8-4cfe-b13f-c5e787187826 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:43.441346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f5a9ceab-30b8-4cfe-b13f-c5e787187826 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:43.469986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f5a9ceab-30b8-4cfe-b13f-c5e787187826 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051139 Sep 01 05:19:43.470819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 314/660] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:43.574970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e72cd8f5-f617-4d67-89ad-b755ff984d99 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:43.582849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e72cd8f5-f617-4d67-89ad-b755ff984d99 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1360 microversion: 2.1 time: 0.188304 Sep 01 05:19:43.583451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 347/661] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:43 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1360 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:44.189096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e405e6fe-d740-4068-b1c1-f44dc91805f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:44.191140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e405e6fe-d740-4068-b1c1-f44dc91805f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:44.193148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:44.199484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e405e6fe-d740-4068-b1c1-f44dc91805f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:44.199965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e405e6fe-d740-4068-b1c1-f44dc91805f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:44.200398 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e405e6fe-d740-4068-b1c1-f44dc91805f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:44.201119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e405e6fe-d740-4068-b1c1-f44dc91805f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:44.201569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e405e6fe-d740-4068-b1c1-f44dc91805f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:44.202001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e405e6fe-d740-4068-b1c1-f44dc91805f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:44.234787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e405e6fe-d740-4068-b1c1-f44dc91805f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049711 Sep 01 05:19:44.235348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 315/662] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:44 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:44.482869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6204cb6f-e131-472f-b376-011fa9460a55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:44.485078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6204cb6f-e131-472f-b376-011fa9460a55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:44.491497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6204cb6f-e131-472f-b376-011fa9460a55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:44.491973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6204cb6f-e131-472f-b376-011fa9460a55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:44.492406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6204cb6f-e131-472f-b376-011fa9460a55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:44.493118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6204cb6f-e131-472f-b376-011fa9460a55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:44.493570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6204cb6f-e131-472f-b376-011fa9460a55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:44.493991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6204cb6f-e131-472f-b376-011fa9460a55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:44.524301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6204cb6f-e131-472f-b376-011fa9460a55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045384 Sep 01 05:19:44.524863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 348/663] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:44.604196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3022464c-d583-4388-a2f8-8afcdee04753 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:44.604826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3022464c-d583-4388-a2f8-8afcdee04753 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:44.611542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3022464c-d583-4388-a2f8-8afcdee04753 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:44.612032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3022464c-d583-4388-a2f8-8afcdee04753 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:44.612497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3022464c-d583-4388-a2f8-8afcdee04753 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:44.613224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3022464c-d583-4388-a2f8-8afcdee04753 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:44.613678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3022464c-d583-4388-a2f8-8afcdee04753 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:44.614095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3022464c-d583-4388-a2f8-8afcdee04753 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:44.751872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3022464c-d583-4388-a2f8-8afcdee04753 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:44.760081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3022464c-d583-4388-a2f8-8afcdee04753 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1360 microversion: 2.1 time: 0.160505 Sep 01 05:19:44.760664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 316/664] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:44 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:45.247360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6610765a-5489-453d-8e57-665defed9ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:45.249811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6610765a-5489-453d-8e57-665defed9ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:45.255944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6610765a-5489-453d-8e57-665defed9ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:45.257074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6610765a-5489-453d-8e57-665defed9ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:45.257507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6610765a-5489-453d-8e57-665defed9ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:45.258183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6610765a-5489-453d-8e57-665defed9ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:45.258628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6610765a-5489-453d-8e57-665defed9ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:45.259043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6610765a-5489-453d-8e57-665defed9ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:45.290234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6610765a-5489-453d-8e57-665defed9ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047233 Sep 01 05:19:45.290798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 349/665] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:45.535700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cfe76b14-7b11-48f4-806e-01d421b03b86 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:45.538874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cfe76b14-7b11-48f4-806e-01d421b03b86 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:45.545548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfe76b14-7b11-48f4-806e-01d421b03b86 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:45.546383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfe76b14-7b11-48f4-806e-01d421b03b86 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:45.547166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfe76b14-7b11-48f4-806e-01d421b03b86 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:45.548410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfe76b14-7b11-48f4-806e-01d421b03b86 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:45.549261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfe76b14-7b11-48f4-806e-01d421b03b86 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:45.550052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfe76b14-7b11-48f4-806e-01d421b03b86 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:45.582596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cfe76b14-7b11-48f4-806e-01d421b03b86 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051031 Sep 01 05:19:45.583146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 317/666] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:45 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:45.780982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4d576312-3f00-41ef-a7dd-fcbd9c30e9db tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:45.781534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4d576312-3f00-41ef-a7dd-fcbd9c30e9db tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:45.788536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d576312-3f00-41ef-a7dd-fcbd9c30e9db tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:45.789035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d576312-3f00-41ef-a7dd-fcbd9c30e9db tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:45.789464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d576312-3f00-41ef-a7dd-fcbd9c30e9db tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:45.790138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d576312-3f00-41ef-a7dd-fcbd9c30e9db tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:45.790609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d576312-3f00-41ef-a7dd-fcbd9c30e9db tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:45.791023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d576312-3f00-41ef-a7dd-fcbd9c30e9db tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:45.917294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4d576312-3f00-41ef-a7dd-fcbd9c30e9db tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:45.924952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4d576312-3f00-41ef-a7dd-fcbd9c30e9db tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1360 microversion: 2.1 time: 0.147954 Sep 01 05:19:45.925512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 350/667] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:45 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:46.302571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-87edf810-ce3c-42a1-a77f-0f0c419a365f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:46.305481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-87edf810-ce3c-42a1-a77f-0f0c419a365f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:46.312116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87edf810-ce3c-42a1-a77f-0f0c419a365f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:46.312594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87edf810-ce3c-42a1-a77f-0f0c419a365f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:46.313062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87edf810-ce3c-42a1-a77f-0f0c419a365f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:46.313752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87edf810-ce3c-42a1-a77f-0f0c419a365f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:46.314199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87edf810-ce3c-42a1-a77f-0f0c419a365f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:46.314618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87edf810-ce3c-42a1-a77f-0f0c419a365f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:46.343731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-87edf810-ce3c-42a1-a77f-0f0c419a365f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045158 Sep 01 05:19:46.344288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 318/668] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:46 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:46.594639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0f950f66-f4bf-4c1b-820b-bbd260781e99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:46.596825 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0f950f66-f4bf-4c1b-820b-bbd260781e99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:46.603410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f950f66-f4bf-4c1b-820b-bbd260781e99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:46.603899 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f950f66-f4bf-4c1b-820b-bbd260781e99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:46.604336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f950f66-f4bf-4c1b-820b-bbd260781e99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:46.605081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f950f66-f4bf-4c1b-820b-bbd260781e99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:46.605535 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f950f66-f4bf-4c1b-820b-bbd260781e99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:46.605960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f950f66-f4bf-4c1b-820b-bbd260781e99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:46.634635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0f950f66-f4bf-4c1b-820b-bbd260781e99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044079 Sep 01 05:19:46.635189 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 351/669] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:46.946121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cc84d336-674a-4bd8-a692-36dbe9b42cfa tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:46.946731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cc84d336-674a-4bd8-a692-36dbe9b42cfa tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:46.952538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc84d336-674a-4bd8-a692-36dbe9b42cfa tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:46.953047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc84d336-674a-4bd8-a692-36dbe9b42cfa tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:46.953478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc84d336-674a-4bd8-a692-36dbe9b42cfa tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:46.954154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc84d336-674a-4bd8-a692-36dbe9b42cfa tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:46.954597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc84d336-674a-4bd8-a692-36dbe9b42cfa tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:46.955013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc84d336-674a-4bd8-a692-36dbe9b42cfa tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:47.082607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cc84d336-674a-4bd8-a692-36dbe9b42cfa tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:47.090894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cc84d336-674a-4bd8-a692-36dbe9b42cfa tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1360 microversion: 2.1 time: 0.148797 Sep 01 05:19:47.091491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 319/670] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:46 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:47.356142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-97fe71bd-9499-438c-8434-317d01b24010 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:47.358208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-97fe71bd-9499-438c-8434-317d01b24010 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:47.360481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:47.366132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97fe71bd-9499-438c-8434-317d01b24010 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:47.366613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97fe71bd-9499-438c-8434-317d01b24010 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:47.367047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97fe71bd-9499-438c-8434-317d01b24010 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:47.367725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97fe71bd-9499-438c-8434-317d01b24010 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:47.368176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97fe71bd-9499-438c-8434-317d01b24010 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:47.368593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97fe71bd-9499-438c-8434-317d01b24010 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:47.399728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-97fe71bd-9499-438c-8434-317d01b24010 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047604 Sep 01 05:19:47.400283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 352/671] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:47.647194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-894166aa-698d-4b1b-80fa-6807680f27d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:47.649423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-894166aa-698d-4b1b-80fa-6807680f27d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:47.655725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-894166aa-698d-4b1b-80fa-6807680f27d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:47.656202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-894166aa-698d-4b1b-80fa-6807680f27d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:47.656630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-894166aa-698d-4b1b-80fa-6807680f27d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:47.657331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-894166aa-698d-4b1b-80fa-6807680f27d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:47.657779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-894166aa-698d-4b1b-80fa-6807680f27d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:47.658194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-894166aa-698d-4b1b-80fa-6807680f27d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:47.689412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-894166aa-698d-4b1b-80fa-6807680f27d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046323 Sep 01 05:19:47.689959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 320/672] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:47 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:48.112060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fc007512-3ccf-468b-b675-711d49f30810 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:48.112579 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fc007512-3ccf-468b-b675-711d49f30810 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:48.119027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fc007512-3ccf-468b-b675-711d49f30810 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:48.119501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fc007512-3ccf-468b-b675-711d49f30810 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:48.119925 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fc007512-3ccf-468b-b675-711d49f30810 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:48.120595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fc007512-3ccf-468b-b675-711d49f30810 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:48.121065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fc007512-3ccf-468b-b675-711d49f30810 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:48.121488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fc007512-3ccf-468b-b675-711d49f30810 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:48.252117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fc007512-3ccf-468b-b675-711d49f30810 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:48.260599 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fc007512-3ccf-468b-b675-711d49f30810 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1360 microversion: 2.1 time: 0.152601 Sep 01 05:19:48.261222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 353/673] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:48 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:48.411656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4ddbbd52-0e4e-49cc-98a0-f78254b248e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:48.414402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4ddbbd52-0e4e-49cc-98a0-f78254b248e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:48.420393 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4ddbbd52-0e4e-49cc-98a0-f78254b248e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:48.420909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4ddbbd52-0e4e-49cc-98a0-f78254b248e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:48.421339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4ddbbd52-0e4e-49cc-98a0-f78254b248e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:48.422014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4ddbbd52-0e4e-49cc-98a0-f78254b248e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:48.422456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4ddbbd52-0e4e-49cc-98a0-f78254b248e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:48.422953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4ddbbd52-0e4e-49cc-98a0-f78254b248e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:48.454337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4ddbbd52-0e4e-49cc-98a0-f78254b248e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046588 Sep 01 05:19:48.454875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 321/674] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:48 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:48.566091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-6598ee19-02ad-4b4e-987d-b56ee5022035 req-dc0be6eb-d0a9-496f-a9b8-b16d0b83bb90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc80648-73e9-4ce0-9161-2a82c5634104", "name": "network-vif-plugged", "status": "completed", "tag": "e2267d61-043c-4be7-90fa-6dce08aea3bd"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:48.576111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-6598ee19-02ad-4b4e-987d-b56ee5022035 req-dc0be6eb-d0a9-496f-a9b8-b16d0b83bb90 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:48.576659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-6598ee19-02ad-4b4e-987d-b56ee5022035 req-dc0be6eb-d0a9-496f-a9b8-b16d0b83bb90 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:48.577118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-6598ee19-02ad-4b4e-987d-b56ee5022035 req-dc0be6eb-d0a9-496f-a9b8-b16d0b83bb90 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:48.588721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-6598ee19-02ad-4b4e-987d-b56ee5022035 req-dc0be6eb-d0a9-496f-a9b8-b16d0b83bb90 service nova] Creating event network-vif-plugged:e2267d61-043c-4be7-90fa-6dce08aea3bd for instance dbc80648-73e9-4ce0-9161-2a82c5634104 on hv-cinder-85391 Sep 01 05:19:48.593904 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-6598ee19-02ad-4b4e-987d-b56ee5022035 req-dc0be6eb-d0a9-496f-a9b8-b16d0b83bb90 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031601 Sep 01 05:19:48.594509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 354/675] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:19:48.702439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a780640a-5134-4b13-b3a1-91368df62bcf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:48.704548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a780640a-5134-4b13-b3a1-91368df62bcf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:48.711776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a780640a-5134-4b13-b3a1-91368df62bcf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:48.712259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a780640a-5134-4b13-b3a1-91368df62bcf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:48.712697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a780640a-5134-4b13-b3a1-91368df62bcf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:48.713424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a780640a-5134-4b13-b3a1-91368df62bcf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:48.713880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a780640a-5134-4b13-b3a1-91368df62bcf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:48.714305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a780640a-5134-4b13-b3a1-91368df62bcf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:48.745468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a780640a-5134-4b13-b3a1-91368df62bcf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047131 Sep 01 05:19:48.746048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 322/676] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:49.279558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:49.280315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=6 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:49.284479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4dc08b49-5e0c-4dbd-9dd7-4d629f051bde tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:49.285204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4dc08b49-5e0c-4dbd-9dd7-4d629f051bde tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:49.292798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dc08b49-5e0c-4dbd-9dd7-4d629f051bde tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:49.293277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dc08b49-5e0c-4dbd-9dd7-4d629f051bde tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:49.293705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dc08b49-5e0c-4dbd-9dd7-4d629f051bde tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:49.294386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dc08b49-5e0c-4dbd-9dd7-4d629f051bde tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:49.294926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dc08b49-5e0c-4dbd-9dd7-4d629f051bde tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:49.295295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dc08b49-5e0c-4dbd-9dd7-4d629f051bde tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:49.426163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4dc08b49-5e0c-4dbd-9dd7-4d629f051bde tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:49.434172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4dc08b49-5e0c-4dbd-9dd7-4d629f051bde tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1360 microversion: 2.1 time: 0.155625 Sep 01 05:19:49.434753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 355/677] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:49 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:49.467166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-627c2f40-caf5-47a1-b324-686d2238f198 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:49.469368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-627c2f40-caf5-47a1-b324-686d2238f198 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:49.471273 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=6 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:49.477295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-627c2f40-caf5-47a1-b324-686d2238f198 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:49.478014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-627c2f40-caf5-47a1-b324-686d2238f198 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:49.478457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-627c2f40-caf5-47a1-b324-686d2238f198 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:49.479183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-627c2f40-caf5-47a1-b324-686d2238f198 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:49.479593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-627c2f40-caf5-47a1-b324-686d2238f198 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:49.480015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-627c2f40-caf5-47a1-b324-686d2238f198 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:49.509654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-627c2f40-caf5-47a1-b324-686d2238f198 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046381 Sep 01 05:19:49.510135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 323/678] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:49 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:49.759050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-93d7f352-d230-4987-9ed3-b8dc20061f1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:49.761251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-93d7f352-d230-4987-9ed3-b8dc20061f1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:49.767576 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93d7f352-d230-4987-9ed3-b8dc20061f1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:49.768086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93d7f352-d230-4987-9ed3-b8dc20061f1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:49.768521 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93d7f352-d230-4987-9ed3-b8dc20061f1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:49.769223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93d7f352-d230-4987-9ed3-b8dc20061f1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:49.769673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93d7f352-d230-4987-9ed3-b8dc20061f1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:49.770090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93d7f352-d230-4987-9ed3-b8dc20061f1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:49.801305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-93d7f352-d230-4987-9ed3-b8dc20061f1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046962 Sep 01 05:19:49.801879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 356/679] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:49 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:19:50.455799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-91e18ee5-4825-4ebe-b865-6cc0859c9555 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:50.456448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-91e18ee5-4825-4ebe-b865-6cc0859c9555 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:50.463827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91e18ee5-4825-4ebe-b865-6cc0859c9555 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:50.464321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91e18ee5-4825-4ebe-b865-6cc0859c9555 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:50.464751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91e18ee5-4825-4ebe-b865-6cc0859c9555 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:50.465486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91e18ee5-4825-4ebe-b865-6cc0859c9555 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:50.465925 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91e18ee5-4825-4ebe-b865-6cc0859c9555 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:50.466368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91e18ee5-4825-4ebe-b865-6cc0859c9555 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:50.522437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-15fbcc67-241a-41af-921d-f32e00ef8976 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:50.526059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-15fbcc67-241a-41af-921d-f32e00ef8976 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:50.533575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15fbcc67-241a-41af-921d-f32e00ef8976 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:50.534078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15fbcc67-241a-41af-921d-f32e00ef8976 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:50.534516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15fbcc67-241a-41af-921d-f32e00ef8976 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:50.535206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15fbcc67-241a-41af-921d-f32e00ef8976 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:50.535657 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15fbcc67-241a-41af-921d-f32e00ef8976 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:50.536077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15fbcc67-241a-41af-921d-f32e00ef8976 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:50.566339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-15fbcc67-241a-41af-921d-f32e00ef8976 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048429 Sep 01 05:19:50.566910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 357/680] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:50 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:19:50.600739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-91e18ee5-4825-4ebe-b865-6cc0859c9555 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:50.608455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-91e18ee5-4825-4ebe-b865-6cc0859c9555 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1360 microversion: 2.1 time: 0.156739 Sep 01 05:19:50.609071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 324/681] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:50 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:50.814003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-24d7c1f6-fcb1-42ee-9b43-1e1f4a8384d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:50.816060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-24d7c1f6-fcb1-42ee-9b43-1e1f4a8384d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:50.823118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24d7c1f6-fcb1-42ee-9b43-1e1f4a8384d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:50.823590 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24d7c1f6-fcb1-42ee-9b43-1e1f4a8384d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:50.824019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24d7c1f6-fcb1-42ee-9b43-1e1f4a8384d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:50.824693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24d7c1f6-fcb1-42ee-9b43-1e1f4a8384d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:50.825172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24d7c1f6-fcb1-42ee-9b43-1e1f4a8384d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:50.825586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24d7c1f6-fcb1-42ee-9b43-1e1f4a8384d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:50.854851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-24d7c1f6-fcb1-42ee-9b43-1e1f4a8384d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045015 Sep 01 05:19:50.855400 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 358/682] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:51.583288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fe846e23-4050-4535-9c76-bca9e8453335 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:51.587479 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fe846e23-4050-4535-9c76-bca9e8453335 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:51.595619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe846e23-4050-4535-9c76-bca9e8453335 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:51.596105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe846e23-4050-4535-9c76-bca9e8453335 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:51.596539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe846e23-4050-4535-9c76-bca9e8453335 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:51.597251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe846e23-4050-4535-9c76-bca9e8453335 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:51.597703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe846e23-4050-4535-9c76-bca9e8453335 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:51.598122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe846e23-4050-4535-9c76-bca9e8453335 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:51.630376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b4b3e6a9-8ee6-48dc-9de6-ff2c72316ea4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:51.631021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b4b3e6a9-8ee6-48dc-9de6-ff2c72316ea4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:51.636088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:51.638588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4b3e6a9-8ee6-48dc-9de6-ff2c72316ea4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:51.639075 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4b3e6a9-8ee6-48dc-9de6-ff2c72316ea4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:51.639505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4b3e6a9-8ee6-48dc-9de6-ff2c72316ea4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:51.640201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4b3e6a9-8ee6-48dc-9de6-ff2c72316ea4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:51.640653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4b3e6a9-8ee6-48dc-9de6-ff2c72316ea4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:51.641096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4b3e6a9-8ee6-48dc-9de6-ff2c72316ea4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:51.642532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fe846e23-4050-4535-9c76-bca9e8453335 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066451 Sep 01 05:19:51.643107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 325/683] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:51.786149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b4b3e6a9-8ee6-48dc-9de6-ff2c72316ea4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:51.795843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b4b3e6a9-8ee6-48dc-9de6-ff2c72316ea4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1546 microversion: 2.1 time: 0.170542 Sep 01 05:19:51.796425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 359/684] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:51 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:51.817033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c09751ae-cfeb-4bb5-845f-663bb6b7f09b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:51.817847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c09751ae-cfeb-4bb5-845f-663bb6b7f09b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:51.825573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c09751ae-cfeb-4bb5-845f-663bb6b7f09b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:51.826066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c09751ae-cfeb-4bb5-845f-663bb6b7f09b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:51.826508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c09751ae-cfeb-4bb5-845f-663bb6b7f09b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:51.827185 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c09751ae-cfeb-4bb5-845f-663bb6b7f09b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:51.827644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c09751ae-cfeb-4bb5-845f-663bb6b7f09b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:51.828064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c09751ae-cfeb-4bb5-845f-663bb6b7f09b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:51.867562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6cf97c70-65d1-4151-aec0-b0a61520a091 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:51.870108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6cf97c70-65d1-4151-aec0-b0a61520a091 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:51.876898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6cf97c70-65d1-4151-aec0-b0a61520a091 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:51.877387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6cf97c70-65d1-4151-aec0-b0a61520a091 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:51.877819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6cf97c70-65d1-4151-aec0-b0a61520a091 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:51.878711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6cf97c70-65d1-4151-aec0-b0a61520a091 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:51.879479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6cf97c70-65d1-4151-aec0-b0a61520a091 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:51.880215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6cf97c70-65d1-4151-aec0-b0a61520a091 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:51.915066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c09751ae-cfeb-4bb5-845f-663bb6b7f09b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101945 Sep 01 05:19:51.916057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 326/685] 10.222.0.49 () {58 vars in 1275 bytes} [Thu Sep 1 05:19:51 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:51.926674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6cf97c70-65d1-4151-aec0-b0a61520a091 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063346 Sep 01 05:19:51.927089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 360/686] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:51 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:52.656601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1c9a9902-039f-41ac-8804-cd51f1e04a0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:52.658810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1c9a9902-039f-41ac-8804-cd51f1e04a0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:52.664735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1c9a9902-039f-41ac-8804-cd51f1e04a0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:52.665814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1c9a9902-039f-41ac-8804-cd51f1e04a0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:52.666253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1c9a9902-039f-41ac-8804-cd51f1e04a0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:52.666951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1c9a9902-039f-41ac-8804-cd51f1e04a0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:52.667405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1c9a9902-039f-41ac-8804-cd51f1e04a0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:52.667827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1c9a9902-039f-41ac-8804-cd51f1e04a0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:52.699105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1c9a9902-039f-41ac-8804-cd51f1e04a0b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046888 Sep 01 05:19:52.704556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 327/687] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:52.940519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7523601d-1f3e-4342-ae5d-5c0f62388173 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:52.944912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7523601d-1f3e-4342-ae5d-5c0f62388173 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:52.952640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7523601d-1f3e-4342-ae5d-5c0f62388173 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:52.953236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7523601d-1f3e-4342-ae5d-5c0f62388173 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:52.953919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7523601d-1f3e-4342-ae5d-5c0f62388173 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:52.955369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7523601d-1f3e-4342-ae5d-5c0f62388173 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:52.955912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7523601d-1f3e-4342-ae5d-5c0f62388173 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:52.956828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7523601d-1f3e-4342-ae5d-5c0f62388173 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:52.966109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-a8ce7fa3-293f-473c-9ab7-b17bbc6f51ab req-ed2f9a27-32ff-4aec-a57f-38059c04a092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc80648-73e9-4ce0-9161-2a82c5634104", "tag": "e2267d61-043c-4be7-90fa-6dce08aea3bd"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:52.975680 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-a8ce7fa3-293f-473c-9ab7-b17bbc6f51ab req-ed2f9a27-32ff-4aec-a57f-38059c04a092 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:52.976251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-a8ce7fa3-293f-473c-9ab7-b17bbc6f51ab req-ed2f9a27-32ff-4aec-a57f-38059c04a092 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:52.976748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-a8ce7fa3-293f-473c-9ab7-b17bbc6f51ab req-ed2f9a27-32ff-4aec-a57f-38059c04a092 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:52.981141 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:52.989058 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7523601d-1f3e-4342-ae5d-5c0f62388173 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052979 Sep 01 05:19:52.989992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 328/688] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:52.990505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-a8ce7fa3-293f-473c-9ab7-b17bbc6f51ab req-ed2f9a27-32ff-4aec-a57f-38059c04a092 service nova] Creating event network-changed:e2267d61-043c-4be7-90fa-6dce08aea3bd for instance dbc80648-73e9-4ce0-9161-2a82c5634104 on hv-cinder-85391 Sep 01 05:19:52.996072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-a8ce7fa3-293f-473c-9ab7-b17bbc6f51ab req-ed2f9a27-32ff-4aec-a57f-38059c04a092 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088853 Sep 01 05:19:52.996669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 361/689] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:53.711566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-033d9c89-3f8a-4e1f-93ff-feddd565710f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:53.714511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-033d9c89-3f8a-4e1f-93ff-feddd565710f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:53.721241 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-033d9c89-3f8a-4e1f-93ff-feddd565710f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:53.721724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-033d9c89-3f8a-4e1f-93ff-feddd565710f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:53.722154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-033d9c89-3f8a-4e1f-93ff-feddd565710f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:53.722850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-033d9c89-3f8a-4e1f-93ff-feddd565710f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:53.723292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-033d9c89-3f8a-4e1f-93ff-feddd565710f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:53.723702 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-033d9c89-3f8a-4e1f-93ff-feddd565710f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:53.754676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-033d9c89-3f8a-4e1f-93ff-feddd565710f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047233 Sep 01 05:19:53.755249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 329/690] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:54.003210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cefe59c1-f841-40de-9d3c-a5f89676f9ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:54.005492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cefe59c1-f841-40de-9d3c-a5f89676f9ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:54.012693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cefe59c1-f841-40de-9d3c-a5f89676f9ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:54.013206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cefe59c1-f841-40de-9d3c-a5f89676f9ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:54.013642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cefe59c1-f841-40de-9d3c-a5f89676f9ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:54.014324 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cefe59c1-f841-40de-9d3c-a5f89676f9ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:54.014775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cefe59c1-f841-40de-9d3c-a5f89676f9ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:54.015193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cefe59c1-f841-40de-9d3c-a5f89676f9ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:54.045340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cefe59c1-f841-40de-9d3c-a5f89676f9ea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046963 Sep 01 05:19:54.045893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 362/691] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:54.767621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c6821e69-5494-4a84-83f5-9b814de9efc2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:54.770344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c6821e69-5494-4a84-83f5-9b814de9efc2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:54.776725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6821e69-5494-4a84-83f5-9b814de9efc2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:54.777302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6821e69-5494-4a84-83f5-9b814de9efc2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:54.777751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6821e69-5494-4a84-83f5-9b814de9efc2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:54.778400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6821e69-5494-4a84-83f5-9b814de9efc2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:54.778846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6821e69-5494-4a84-83f5-9b814de9efc2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:54.779261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6821e69-5494-4a84-83f5-9b814de9efc2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:54.809321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c6821e69-5494-4a84-83f5-9b814de9efc2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045486 Sep 01 05:19:54.809873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 330/692] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:55.058692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e033b142-8d18-4dc8-8fb2-85a5f3ceb87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:55.060738 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e033b142-8d18-4dc8-8fb2-85a5f3ceb87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:55.067402 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e033b142-8d18-4dc8-8fb2-85a5f3ceb87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:55.067875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e033b142-8d18-4dc8-8fb2-85a5f3ceb87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:55.068304 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e033b142-8d18-4dc8-8fb2-85a5f3ceb87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:55.069013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e033b142-8d18-4dc8-8fb2-85a5f3ceb87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:55.069454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e033b142-8d18-4dc8-8fb2-85a5f3ceb87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:55.069865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e033b142-8d18-4dc8-8fb2-85a5f3ceb87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:55.098164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e033b142-8d18-4dc8-8fb2-85a5f3ceb87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044466 Sep 01 05:19:55.098704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 363/693] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:55.821449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-36121a23-760e-4d6f-b279-70cf9dfd912a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:55.823623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-36121a23-760e-4d6f-b279-70cf9dfd912a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:55.830056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-36121a23-760e-4d6f-b279-70cf9dfd912a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:55.830535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-36121a23-760e-4d6f-b279-70cf9dfd912a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:55.830966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-36121a23-760e-4d6f-b279-70cf9dfd912a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:55.831647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-36121a23-760e-4d6f-b279-70cf9dfd912a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:55.832095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-36121a23-760e-4d6f-b279-70cf9dfd912a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:55.832514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-36121a23-760e-4d6f-b279-70cf9dfd912a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:55.862877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-36121a23-760e-4d6f-b279-70cf9dfd912a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045603 Sep 01 05:19:55.863438 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 331/694] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:55 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:56.111168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-35847b86-21bf-4a45-bc22-cf61913fa07f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:56.113260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-35847b86-21bf-4a45-bc22-cf61913fa07f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:56.119818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35847b86-21bf-4a45-bc22-cf61913fa07f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:56.120340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35847b86-21bf-4a45-bc22-cf61913fa07f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:56.120854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35847b86-21bf-4a45-bc22-cf61913fa07f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:56.121571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35847b86-21bf-4a45-bc22-cf61913fa07f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:56.122028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35847b86-21bf-4a45-bc22-cf61913fa07f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:56.122449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35847b86-21bf-4a45-bc22-cf61913fa07f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:56.151865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-35847b86-21bf-4a45-bc22-cf61913fa07f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044828 Sep 01 05:19:56.152420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 364/695] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:56.875373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-239d4bb5-33ad-4963-b7a8-41e393aa8fe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:56.877511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-239d4bb5-33ad-4963-b7a8-41e393aa8fe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:56.884945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-239d4bb5-33ad-4963-b7a8-41e393aa8fe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:56.885445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-239d4bb5-33ad-4963-b7a8-41e393aa8fe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:56.885909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-239d4bb5-33ad-4963-b7a8-41e393aa8fe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:56.886586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-239d4bb5-33ad-4963-b7a8-41e393aa8fe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:56.887030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-239d4bb5-33ad-4963-b7a8-41e393aa8fe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:56.887445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-239d4bb5-33ad-4963-b7a8-41e393aa8fe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:56.916555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-239d4bb5-33ad-4963-b7a8-41e393aa8fe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045174 Sep 01 05:19:56.917146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 332/696] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:57.163669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-91c72848-fffb-475f-9e72-6cd3427473fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:57.165907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-91c72848-fffb-475f-9e72-6cd3427473fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:57.172221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91c72848-fffb-475f-9e72-6cd3427473fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:57.172695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91c72848-fffb-475f-9e72-6cd3427473fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:57.173162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91c72848-fffb-475f-9e72-6cd3427473fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:57.173833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91c72848-fffb-475f-9e72-6cd3427473fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:57.174278 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91c72848-fffb-475f-9e72-6cd3427473fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:57.174691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91c72848-fffb-475f-9e72-6cd3427473fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:57.204591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-91c72848-fffb-475f-9e72-6cd3427473fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044915 Sep 01 05:19:57.205156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 365/697] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:57.928583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5cbe6372-325a-4632-b4be-0aedadd8f0ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:57.930768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5cbe6372-325a-4632-b4be-0aedadd8f0ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:57.937484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cbe6372-325a-4632-b4be-0aedadd8f0ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:57.937960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cbe6372-325a-4632-b4be-0aedadd8f0ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:57.938392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cbe6372-325a-4632-b4be-0aedadd8f0ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:57.939073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cbe6372-325a-4632-b4be-0aedadd8f0ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:57.939519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cbe6372-325a-4632-b4be-0aedadd8f0ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:57.939939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cbe6372-325a-4632-b4be-0aedadd8f0ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:57.969338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5cbe6372-325a-4632-b4be-0aedadd8f0ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Sep 01 05:19:57.969908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 333/698] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:57 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:58.216717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a0b3a22e-55e0-4c8a-b5cf-e68df3fe84f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:58.218868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a0b3a22e-55e0-4c8a-b5cf-e68df3fe84f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:58.225260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a0b3a22e-55e0-4c8a-b5cf-e68df3fe84f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:58.225739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a0b3a22e-55e0-4c8a-b5cf-e68df3fe84f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:58.226207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a0b3a22e-55e0-4c8a-b5cf-e68df3fe84f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:58.226915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a0b3a22e-55e0-4c8a-b5cf-e68df3fe84f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:58.227403 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a0b3a22e-55e0-4c8a-b5cf-e68df3fe84f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:58.227898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a0b3a22e-55e0-4c8a-b5cf-e68df3fe84f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:58.256283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a0b3a22e-55e0-4c8a-b5cf-e68df3fe84f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044205 Sep 01 05:19:58.256858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 366/699] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:58.982043 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b546b6c8-7bbb-4cc5-bde8-5984a35360af tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:58.984126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b546b6c8-7bbb-4cc5-bde8-5984a35360af tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:58.990515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b546b6c8-7bbb-4cc5-bde8-5984a35360af tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:58.990990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b546b6c8-7bbb-4cc5-bde8-5984a35360af tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:58.991419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b546b6c8-7bbb-4cc5-bde8-5984a35360af tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:58.992092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b546b6c8-7bbb-4cc5-bde8-5984a35360af tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:58.992538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b546b6c8-7bbb-4cc5-bde8-5984a35360af tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:58.993681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b546b6c8-7bbb-4cc5-bde8-5984a35360af tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:59.022247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b546b6c8-7bbb-4cc5-bde8-5984a35360af tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Sep 01 05:19:59.022788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 334/700] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:19:58 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:59.269060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-40585c7d-c65f-475f-b853-3e394ebe1547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:59.271247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-40585c7d-c65f-475f-b853-3e394ebe1547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:59.278315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-40585c7d-c65f-475f-b853-3e394ebe1547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:59.278831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-40585c7d-c65f-475f-b853-3e394ebe1547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:59.279319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-40585c7d-c65f-475f-b853-3e394ebe1547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:59.280032 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-40585c7d-c65f-475f-b853-3e394ebe1547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:59.280478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-40585c7d-c65f-475f-b853-3e394ebe1547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:59.280926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-40585c7d-c65f-475f-b853-3e394ebe1547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:59.310795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-40585c7d-c65f-475f-b853-3e394ebe1547 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045714 Sep 01 05:19:59.311356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 367/701] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:19:59 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:00.034035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5cfbc379-f321-4b5d-8aec-cbd39e526cd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:00.036192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5cfbc379-f321-4b5d-8aec-cbd39e526cd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:00.043474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cfbc379-f321-4b5d-8aec-cbd39e526cd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:00.043955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cfbc379-f321-4b5d-8aec-cbd39e526cd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:00.044390 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cfbc379-f321-4b5d-8aec-cbd39e526cd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:00.045103 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cfbc379-f321-4b5d-8aec-cbd39e526cd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:00.045557 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cfbc379-f321-4b5d-8aec-cbd39e526cd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:00.045975 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cfbc379-f321-4b5d-8aec-cbd39e526cd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:00.075222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5cfbc379-f321-4b5d-8aec-cbd39e526cd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045173 Sep 01 05:20:00.075776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 335/702] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:20:00.323281 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-be0b2618-d1aa-4d64-b66a-50a344171b1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:00.325460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-be0b2618-d1aa-4d64-b66a-50a344171b1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:00.331777 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be0b2618-d1aa-4d64-b66a-50a344171b1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:00.332280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be0b2618-d1aa-4d64-b66a-50a344171b1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:00.332713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be0b2618-d1aa-4d64-b66a-50a344171b1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:00.333408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be0b2618-d1aa-4d64-b66a-50a344171b1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:00.333855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be0b2618-d1aa-4d64-b66a-50a344171b1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:00.334270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be0b2618-d1aa-4d64-b66a-50a344171b1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:00.363947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-be0b2618-d1aa-4d64-b66a-50a344171b1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045353 Sep 01 05:20:00.364484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 368/703] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:00 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:01.088619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-417db8f5-e68a-4943-8e4a-237dd05cdda3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:01.090790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-417db8f5-e68a-4943-8e4a-237dd05cdda3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:01.097151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-417db8f5-e68a-4943-8e4a-237dd05cdda3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:01.097633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-417db8f5-e68a-4943-8e4a-237dd05cdda3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:01.098068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-417db8f5-e68a-4943-8e4a-237dd05cdda3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:01.098754 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-417db8f5-e68a-4943-8e4a-237dd05cdda3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:01.099206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-417db8f5-e68a-4943-8e4a-237dd05cdda3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:01.099624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-417db8f5-e68a-4943-8e4a-237dd05cdda3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:01.128694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-417db8f5-e68a-4943-8e4a-237dd05cdda3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045186 Sep 01 05:20:01.129269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 336/704] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:01 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:01.377031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-25d96a63-dd27-44d6-b50c-fa6fdcd3c603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:01.379115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-25d96a63-dd27-44d6-b50c-fa6fdcd3c603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:01.386137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-25d96a63-dd27-44d6-b50c-fa6fdcd3c603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:01.386611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-25d96a63-dd27-44d6-b50c-fa6fdcd3c603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:01.387064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-25d96a63-dd27-44d6-b50c-fa6fdcd3c603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:01.387735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-25d96a63-dd27-44d6-b50c-fa6fdcd3c603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:01.388182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-25d96a63-dd27-44d6-b50c-fa6fdcd3c603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:01.388594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-25d96a63-dd27-44d6-b50c-fa6fdcd3c603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:01.418357 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-25d96a63-dd27-44d6-b50c-fa6fdcd3c603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045439 Sep 01 05:20:01.418899 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 369/705] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:02.141002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dad04169-c94b-434a-b5a9-3a3f375c7c9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:02.143142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dad04169-c94b-434a-b5a9-3a3f375c7c9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:02.149723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dad04169-c94b-434a-b5a9-3a3f375c7c9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:02.150346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dad04169-c94b-434a-b5a9-3a3f375c7c9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:02.150774 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dad04169-c94b-434a-b5a9-3a3f375c7c9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:02.151453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dad04169-c94b-434a-b5a9-3a3f375c7c9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:02.151895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dad04169-c94b-434a-b5a9-3a3f375c7c9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:02.152310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dad04169-c94b-434a-b5a9-3a3f375c7c9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:02.181746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dad04169-c94b-434a-b5a9-3a3f375c7c9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Sep 01 05:20:02.182296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 337/706] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:02 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:02.431308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e53fefd1-5c63-4f52-993d-2d20dc462658 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:02.434258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e53fefd1-5c63-4f52-993d-2d20dc462658 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:02.440629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e53fefd1-5c63-4f52-993d-2d20dc462658 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:02.441150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e53fefd1-5c63-4f52-993d-2d20dc462658 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:02.441584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e53fefd1-5c63-4f52-993d-2d20dc462658 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:02.442268 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e53fefd1-5c63-4f52-993d-2d20dc462658 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:02.442718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e53fefd1-5c63-4f52-993d-2d20dc462658 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:02.443221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e53fefd1-5c63-4f52-993d-2d20dc462658 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:02.473130 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e53fefd1-5c63-4f52-993d-2d20dc462658 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046449 Sep 01 05:20:02.474092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 370/707] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:03.194373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-125915ef-e3a4-48ca-8ebb-12ef9e446240 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:03.197106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-125915ef-e3a4-48ca-8ebb-12ef9e446240 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:03.203515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-125915ef-e3a4-48ca-8ebb-12ef9e446240 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:03.203983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-125915ef-e3a4-48ca-8ebb-12ef9e446240 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:03.204408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-125915ef-e3a4-48ca-8ebb-12ef9e446240 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:03.205118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-125915ef-e3a4-48ca-8ebb-12ef9e446240 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:03.205564 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-125915ef-e3a4-48ca-8ebb-12ef9e446240 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:03.205977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-125915ef-e3a4-48ca-8ebb-12ef9e446240 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:03.235465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-125915ef-e3a4-48ca-8ebb-12ef9e446240 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Sep 01 05:20:03.236015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 338/708] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:03 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:03.486002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-53c53cf8-7a56-4f63-a764-907bb6145963 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:03.488176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-53c53cf8-7a56-4f63-a764-907bb6145963 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:03.495544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-53c53cf8-7a56-4f63-a764-907bb6145963 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:03.496052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-53c53cf8-7a56-4f63-a764-907bb6145963 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:03.496511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-53c53cf8-7a56-4f63-a764-907bb6145963 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:03.497219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-53c53cf8-7a56-4f63-a764-907bb6145963 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:03.497668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-53c53cf8-7a56-4f63-a764-907bb6145963 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:03.498082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-53c53cf8-7a56-4f63-a764-907bb6145963 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:03.527883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-53c53cf8-7a56-4f63-a764-907bb6145963 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045891 Sep 01 05:20:03.528427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 371/709] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:04.246864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2e655616-9f55-453d-b26b-3138da9d2bec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:04.249087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2e655616-9f55-453d-b26b-3138da9d2bec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:04.255810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e655616-9f55-453d-b26b-3138da9d2bec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:04.256289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e655616-9f55-453d-b26b-3138da9d2bec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:04.256719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e655616-9f55-453d-b26b-3138da9d2bec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:04.257435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e655616-9f55-453d-b26b-3138da9d2bec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:04.257883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e655616-9f55-453d-b26b-3138da9d2bec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:04.258299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e655616-9f55-453d-b26b-3138da9d2bec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:04.290445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2e655616-9f55-453d-b26b-3138da9d2bec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047497 Sep 01 05:20:04.291021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 339/710] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:04.540343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4a05b620-9dc2-4d50-bb80-c95443a0f9f0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:04.542508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4a05b620-9dc2-4d50-bb80-c95443a0f9f0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:04.548973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a05b620-9dc2-4d50-bb80-c95443a0f9f0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:04.549460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a05b620-9dc2-4d50-bb80-c95443a0f9f0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:04.549892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a05b620-9dc2-4d50-bb80-c95443a0f9f0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:04.550571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a05b620-9dc2-4d50-bb80-c95443a0f9f0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:04.551019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a05b620-9dc2-4d50-bb80-c95443a0f9f0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:04.551438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a05b620-9dc2-4d50-bb80-c95443a0f9f0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:04.583522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4a05b620-9dc2-4d50-bb80-c95443a0f9f0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047248 Sep 01 05:20:04.584099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 372/711] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:05.302834 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fbffaf9a-07ae-4b3f-bc79-87b907cd0409 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:05.304954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fbffaf9a-07ae-4b3f-bc79-87b907cd0409 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:05.312147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fbffaf9a-07ae-4b3f-bc79-87b907cd0409 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:05.312623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fbffaf9a-07ae-4b3f-bc79-87b907cd0409 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:05.313090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fbffaf9a-07ae-4b3f-bc79-87b907cd0409 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:05.313763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fbffaf9a-07ae-4b3f-bc79-87b907cd0409 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:05.314206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fbffaf9a-07ae-4b3f-bc79-87b907cd0409 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:05.314621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fbffaf9a-07ae-4b3f-bc79-87b907cd0409 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:05.343681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fbffaf9a-07ae-4b3f-bc79-87b907cd0409 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Sep 01 05:20:05.344216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 340/712] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:05 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:05.595834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9d80b96f-bc1d-4f67-8800-877bada7e595 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:05.598187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9d80b96f-bc1d-4f67-8800-877bada7e595 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:05.605317 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d80b96f-bc1d-4f67-8800-877bada7e595 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:05.605803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d80b96f-bc1d-4f67-8800-877bada7e595 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:05.606240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d80b96f-bc1d-4f67-8800-877bada7e595 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:05.606919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d80b96f-bc1d-4f67-8800-877bada7e595 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:05.607374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d80b96f-bc1d-4f67-8800-877bada7e595 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:05.607792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d80b96f-bc1d-4f67-8800-877bada7e595 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:05.638886 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9d80b96f-bc1d-4f67-8800-877bada7e595 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047159 Sep 01 05:20:05.639437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 373/713] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:06.355975 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2da36b6a-e695-4abc-ad1a-bae059aa3057 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:06.358089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2da36b6a-e695-4abc-ad1a-bae059aa3057 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:06.364514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2da36b6a-e695-4abc-ad1a-bae059aa3057 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:06.365030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2da36b6a-e695-4abc-ad1a-bae059aa3057 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:06.365464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2da36b6a-e695-4abc-ad1a-bae059aa3057 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:06.366144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2da36b6a-e695-4abc-ad1a-bae059aa3057 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:06.366591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2da36b6a-e695-4abc-ad1a-bae059aa3057 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:06.367013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2da36b6a-e695-4abc-ad1a-bae059aa3057 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:06.396836 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2da36b6a-e695-4abc-ad1a-bae059aa3057 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045187 Sep 01 05:20:06.397386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 341/714] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:06 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:06.651259 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d618fc57-f6fa-4975-94a0-4dab0cfee07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:06.653439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d618fc57-f6fa-4975-94a0-4dab0cfee07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:06.659510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d618fc57-f6fa-4975-94a0-4dab0cfee07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:06.659987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d618fc57-f6fa-4975-94a0-4dab0cfee07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:06.660417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d618fc57-f6fa-4975-94a0-4dab0cfee07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:06.661120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d618fc57-f6fa-4975-94a0-4dab0cfee07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:06.661562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d618fc57-f6fa-4975-94a0-4dab0cfee07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:06.661979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d618fc57-f6fa-4975-94a0-4dab0cfee07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:06.691512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d618fc57-f6fa-4975-94a0-4dab0cfee07c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044258 Sep 01 05:20:06.692051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 374/715] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:07.409970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1d332cae-80d2-4bbd-882d-28be4cf50c69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:07.412123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1d332cae-80d2-4bbd-882d-28be4cf50c69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:07.419542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d332cae-80d2-4bbd-882d-28be4cf50c69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:07.420022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d332cae-80d2-4bbd-882d-28be4cf50c69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:07.420457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d332cae-80d2-4bbd-882d-28be4cf50c69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:07.421161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d332cae-80d2-4bbd-882d-28be4cf50c69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:07.421612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d332cae-80d2-4bbd-882d-28be4cf50c69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:07.422033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d332cae-80d2-4bbd-882d-28be4cf50c69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:07.448069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:07.453395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1d332cae-80d2-4bbd-882d-28be4cf50c69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047419 Sep 01 05:20:07.453942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 342/716] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:07 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:07.704015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a4f3cf28-cc82-4045-9f8f-698f79047b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:07.706066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a4f3cf28-cc82-4045-9f8f-698f79047b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:07.712565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4f3cf28-cc82-4045-9f8f-698f79047b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:07.713072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4f3cf28-cc82-4045-9f8f-698f79047b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:07.713504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4f3cf28-cc82-4045-9f8f-698f79047b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:07.714184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4f3cf28-cc82-4045-9f8f-698f79047b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:07.714630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4f3cf28-cc82-4045-9f8f-698f79047b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:07.715046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4f3cf28-cc82-4045-9f8f-698f79047b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:07.745154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a4f3cf28-cc82-4045-9f8f-698f79047b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045217 Sep 01 05:20:07.745698 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 375/717] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:07 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:08.466167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-edf89d7f-7bc9-48b7-9764-7aace7a0377f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:08.468330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-edf89d7f-7bc9-48b7-9764-7aace7a0377f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:08.474162 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edf89d7f-7bc9-48b7-9764-7aace7a0377f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:08.474641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edf89d7f-7bc9-48b7-9764-7aace7a0377f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:08.475071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edf89d7f-7bc9-48b7-9764-7aace7a0377f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:08.475736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edf89d7f-7bc9-48b7-9764-7aace7a0377f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:08.476181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edf89d7f-7bc9-48b7-9764-7aace7a0377f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:08.476594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edf89d7f-7bc9-48b7-9764-7aace7a0377f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:08.507303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-edf89d7f-7bc9-48b7-9764-7aace7a0377f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045639 Sep 01 05:20:08.507850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 343/718] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:08 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:08.757520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-772d5fe9-7fcf-4fe7-a948-ea20d45c6c00 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:08.759760 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-772d5fe9-7fcf-4fe7-a948-ea20d45c6c00 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:08.766092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-772d5fe9-7fcf-4fe7-a948-ea20d45c6c00 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:08.766568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-772d5fe9-7fcf-4fe7-a948-ea20d45c6c00 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:08.766998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-772d5fe9-7fcf-4fe7-a948-ea20d45c6c00 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:08.767673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-772d5fe9-7fcf-4fe7-a948-ea20d45c6c00 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:08.768115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-772d5fe9-7fcf-4fe7-a948-ea20d45c6c00 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:08.768527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-772d5fe9-7fcf-4fe7-a948-ea20d45c6c00 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:08.797240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-772d5fe9-7fcf-4fe7-a948-ea20d45c6c00 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043763 Sep 01 05:20:08.797782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 376/719] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:09.519570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f08ed959-91ee-433e-a351-4c41ca2f5814 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:09.521739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f08ed959-91ee-433e-a351-4c41ca2f5814 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:09.528835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f08ed959-91ee-433e-a351-4c41ca2f5814 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:09.529318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f08ed959-91ee-433e-a351-4c41ca2f5814 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:09.529755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f08ed959-91ee-433e-a351-4c41ca2f5814 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:09.530440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f08ed959-91ee-433e-a351-4c41ca2f5814 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:09.530889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f08ed959-91ee-433e-a351-4c41ca2f5814 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:09.531309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f08ed959-91ee-433e-a351-4c41ca2f5814 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:09.560234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f08ed959-91ee-433e-a351-4c41ca2f5814 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044609 Sep 01 05:20:09.560803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 344/720] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:09 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:09.810380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bb4ae1b0-da5d-4948-92f2-cc20f9a2c76a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:09.812456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bb4ae1b0-da5d-4948-92f2-cc20f9a2c76a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:09.818897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb4ae1b0-da5d-4948-92f2-cc20f9a2c76a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:09.819382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb4ae1b0-da5d-4948-92f2-cc20f9a2c76a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:09.819878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb4ae1b0-da5d-4948-92f2-cc20f9a2c76a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:09.820551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb4ae1b0-da5d-4948-92f2-cc20f9a2c76a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:09.821021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb4ae1b0-da5d-4948-92f2-cc20f9a2c76a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:09.822120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb4ae1b0-da5d-4948-92f2-cc20f9a2c76a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:09.851488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bb4ae1b0-da5d-4948-92f2-cc20f9a2c76a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045935 Sep 01 05:20:09.852041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 377/721] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:09 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:10.573120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f31e6810-0798-4726-8a78-32703e216be4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:10.575135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f31e6810-0798-4726-8a78-32703e216be4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:10.581565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f31e6810-0798-4726-8a78-32703e216be4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:10.582036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f31e6810-0798-4726-8a78-32703e216be4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:10.582457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f31e6810-0798-4726-8a78-32703e216be4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:10.583129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f31e6810-0798-4726-8a78-32703e216be4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:10.583574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f31e6810-0798-4726-8a78-32703e216be4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:10.583987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f31e6810-0798-4726-8a78-32703e216be4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:10.614259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f31e6810-0798-4726-8a78-32703e216be4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Sep 01 05:20:10.615030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 345/722] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:10.863934 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a3c7e752-597c-49c6-b14a-16a97a1e7d18 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:10.866019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a3c7e752-597c-49c6-b14a-16a97a1e7d18 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:10.873511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3c7e752-597c-49c6-b14a-16a97a1e7d18 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:10.873986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3c7e752-597c-49c6-b14a-16a97a1e7d18 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:10.874415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3c7e752-597c-49c6-b14a-16a97a1e7d18 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:10.875090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3c7e752-597c-49c6-b14a-16a97a1e7d18 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:10.875535 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3c7e752-597c-49c6-b14a-16a97a1e7d18 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:10.875947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3c7e752-597c-49c6-b14a-16a97a1e7d18 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:10.889713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:10.906734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a3c7e752-597c-49c6-b14a-16a97a1e7d18 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046800 Sep 01 05:20:10.907288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 378/723] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:10 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:11.627279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1605115a-b377-45f1-bc20-bcfda3fc77dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:11.629460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1605115a-b377-45f1-bc20-bcfda3fc77dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:11.636535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1605115a-b377-45f1-bc20-bcfda3fc77dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:11.637042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1605115a-b377-45f1-bc20-bcfda3fc77dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:11.637481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1605115a-b377-45f1-bc20-bcfda3fc77dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:11.638167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1605115a-b377-45f1-bc20-bcfda3fc77dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:11.638616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1605115a-b377-45f1-bc20-bcfda3fc77dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:11.639092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1605115a-b377-45f1-bc20-bcfda3fc77dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:11.669065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1605115a-b377-45f1-bc20-bcfda3fc77dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045739 Sep 01 05:20:11.669618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 346/724] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:11 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:11.919562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cc829ef1-9623-4251-9379-349751903e30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:11.921704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cc829ef1-9623-4251-9379-349751903e30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:11.928026 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc829ef1-9623-4251-9379-349751903e30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:11.928501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc829ef1-9623-4251-9379-349751903e30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:11.928995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc829ef1-9623-4251-9379-349751903e30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:11.929697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc829ef1-9623-4251-9379-349751903e30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:11.930140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc829ef1-9623-4251-9379-349751903e30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:11.930637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc829ef1-9623-4251-9379-349751903e30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:11.959658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cc829ef1-9623-4251-9379-349751903e30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044679 Sep 01 05:20:11.960201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 379/725] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:12.681801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5dc166f2-cd78-4068-8bf5-eba19a2fd327 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:12.684160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5dc166f2-cd78-4068-8bf5-eba19a2fd327 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:12.690516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5dc166f2-cd78-4068-8bf5-eba19a2fd327 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:12.690991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5dc166f2-cd78-4068-8bf5-eba19a2fd327 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:12.691416 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5dc166f2-cd78-4068-8bf5-eba19a2fd327 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:12.692082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5dc166f2-cd78-4068-8bf5-eba19a2fd327 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:12.692521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5dc166f2-cd78-4068-8bf5-eba19a2fd327 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:12.692967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5dc166f2-cd78-4068-8bf5-eba19a2fd327 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:12.723919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5dc166f2-cd78-4068-8bf5-eba19a2fd327 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046572 Sep 01 05:20:12.724446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 347/726] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:12 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:12.972614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-adee127f-ad52-43e2-9bd6-0387dabc4f14 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:12.974669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-adee127f-ad52-43e2-9bd6-0387dabc4f14 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:12.981164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adee127f-ad52-43e2-9bd6-0387dabc4f14 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:12.981643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adee127f-ad52-43e2-9bd6-0387dabc4f14 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:12.982073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adee127f-ad52-43e2-9bd6-0387dabc4f14 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:12.982751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adee127f-ad52-43e2-9bd6-0387dabc4f14 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:12.983197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adee127f-ad52-43e2-9bd6-0387dabc4f14 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:12.983615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adee127f-ad52-43e2-9bd6-0387dabc4f14 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:13.013583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-adee127f-ad52-43e2-9bd6-0387dabc4f14 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045181 Sep 01 05:20:13.014140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 380/727] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:12 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:13.736382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0d98a6fe-f8dd-44cd-9b08-c4e151cc73db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:13.738587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0d98a6fe-f8dd-44cd-9b08-c4e151cc73db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:13.745680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d98a6fe-f8dd-44cd-9b08-c4e151cc73db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:13.746151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d98a6fe-f8dd-44cd-9b08-c4e151cc73db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:13.746575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d98a6fe-f8dd-44cd-9b08-c4e151cc73db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:13.747246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d98a6fe-f8dd-44cd-9b08-c4e151cc73db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:13.747695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d98a6fe-f8dd-44cd-9b08-c4e151cc73db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:13.748108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d98a6fe-f8dd-44cd-9b08-c4e151cc73db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:13.776406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0d98a6fe-f8dd-44cd-9b08-c4e151cc73db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Sep 01 05:20:13.776962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 348/728] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:14.025982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-34219291-a065-4898-be33-3b28816ebd2f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:14.028040 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-34219291-a065-4898-be33-3b28816ebd2f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:14.034575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34219291-a065-4898-be33-3b28816ebd2f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:14.035066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34219291-a065-4898-be33-3b28816ebd2f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:14.035502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34219291-a065-4898-be33-3b28816ebd2f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:14.036187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34219291-a065-4898-be33-3b28816ebd2f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:14.036639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34219291-a065-4898-be33-3b28816ebd2f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:14.037090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34219291-a065-4898-be33-3b28816ebd2f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:14.067047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-34219291-a065-4898-be33-3b28816ebd2f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045145 Sep 01 05:20:14.067601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 381/729] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:14.788935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ee5b5487-1be0-4cf0-aa7b-5c32d00f5c7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:14.791745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ee5b5487-1be0-4cf0-aa7b-5c32d00f5c7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:14.794329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=68 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:14.799704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee5b5487-1be0-4cf0-aa7b-5c32d00f5c7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:14.800179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee5b5487-1be0-4cf0-aa7b-5c32d00f5c7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:14.800611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee5b5487-1be0-4cf0-aa7b-5c32d00f5c7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:14.801317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee5b5487-1be0-4cf0-aa7b-5c32d00f5c7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:14.801765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee5b5487-1be0-4cf0-aa7b-5c32d00f5c7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:14.802182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee5b5487-1be0-4cf0-aa7b-5c32d00f5c7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:14.831903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ee5b5487-1be0-4cf0-aa7b-5c32d00f5c7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047188 Sep 01 05:20:14.832456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 349/730] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:14 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:15.079742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7367f6f6-4755-4f5c-9ad3-5347e3fb0f71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:15.081816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7367f6f6-4755-4f5c-9ad3-5347e3fb0f71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:15.088817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7367f6f6-4755-4f5c-9ad3-5347e3fb0f71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:15.089296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7367f6f6-4755-4f5c-9ad3-5347e3fb0f71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:15.089793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7367f6f6-4755-4f5c-9ad3-5347e3fb0f71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:15.090970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7367f6f6-4755-4f5c-9ad3-5347e3fb0f71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:15.091453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7367f6f6-4755-4f5c-9ad3-5347e3fb0f71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:15.091872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7367f6f6-4755-4f5c-9ad3-5347e3fb0f71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:15.121481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7367f6f6-4755-4f5c-9ad3-5347e3fb0f71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045767 Sep 01 05:20:15.122028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 382/731] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:15.843673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-87027f18-c885-4ad3-b396-ce270ac4b0ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:15.845761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-87027f18-c885-4ad3-b396-ce270ac4b0ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:15.852307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87027f18-c885-4ad3-b396-ce270ac4b0ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:15.853356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87027f18-c885-4ad3-b396-ce270ac4b0ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:15.853804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87027f18-c885-4ad3-b396-ce270ac4b0ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:15.854502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87027f18-c885-4ad3-b396-ce270ac4b0ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:15.854956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87027f18-c885-4ad3-b396-ce270ac4b0ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:15.855380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87027f18-c885-4ad3-b396-ce270ac4b0ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:15.891121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-87027f18-c885-4ad3-b396-ce270ac4b0ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051442 Sep 01 05:20:15.891991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 350/732] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:16.134376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d6448857-b93a-4629-b2a8-4eec8fb368b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:16.136494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d6448857-b93a-4629-b2a8-4eec8fb368b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:16.142975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6448857-b93a-4629-b2a8-4eec8fb368b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:16.143455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6448857-b93a-4629-b2a8-4eec8fb368b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:16.143889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6448857-b93a-4629-b2a8-4eec8fb368b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:16.144560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6448857-b93a-4629-b2a8-4eec8fb368b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:16.145033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6448857-b93a-4629-b2a8-4eec8fb368b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:16.145451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6448857-b93a-4629-b2a8-4eec8fb368b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:16.175471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d6448857-b93a-4629-b2a8-4eec8fb368b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045169 Sep 01 05:20:16.176032 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 383/733] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:16 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:16.903730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e14cd8c4-5ca7-45d5-93b7-d37729a9fb7a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:16.905883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e14cd8c4-5ca7-45d5-93b7-d37729a9fb7a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:16.912232 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e14cd8c4-5ca7-45d5-93b7-d37729a9fb7a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:16.912708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e14cd8c4-5ca7-45d5-93b7-d37729a9fb7a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:16.913175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e14cd8c4-5ca7-45d5-93b7-d37729a9fb7a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:16.913851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e14cd8c4-5ca7-45d5-93b7-d37729a9fb7a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:16.914303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e14cd8c4-5ca7-45d5-93b7-d37729a9fb7a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:16.914728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e14cd8c4-5ca7-45d5-93b7-d37729a9fb7a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:16.946190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e14cd8c4-5ca7-45d5-93b7-d37729a9fb7a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046752 Sep 01 05:20:16.947192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 351/734] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:16 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:17.188191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-09406e93-523a-4e2d-9625-6d108ed276f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:17.190286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-09406e93-523a-4e2d-9625-6d108ed276f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:17.196757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09406e93-523a-4e2d-9625-6d108ed276f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:17.197261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09406e93-523a-4e2d-9625-6d108ed276f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:17.197687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09406e93-523a-4e2d-9625-6d108ed276f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:17.198362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09406e93-523a-4e2d-9625-6d108ed276f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:17.198812 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09406e93-523a-4e2d-9625-6d108ed276f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:17.199227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09406e93-523a-4e2d-9625-6d108ed276f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:17.228574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-09406e93-523a-4e2d-9625-6d108ed276f5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044098 Sep 01 05:20:17.229147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 384/735] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:17 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:20:17.958126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8b443b41-f664-43a1-bd4e-57669848d375 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:17.960280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8b443b41-f664-43a1-bd4e-57669848d375 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:17.966694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b443b41-f664-43a1-bd4e-57669848d375 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:17.967179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b443b41-f664-43a1-bd4e-57669848d375 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:17.967619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b443b41-f664-43a1-bd4e-57669848d375 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:17.968302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b443b41-f664-43a1-bd4e-57669848d375 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:17.968763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b443b41-f664-43a1-bd4e-57669848d375 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:17.969224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b443b41-f664-43a1-bd4e-57669848d375 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:17.998476 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8b443b41-f664-43a1-bd4e-57669848d375 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044317 Sep 01 05:20:17.999017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 352/736] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:17 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:18.240933 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8d165ca4-80b7-4cc3-8275-91ae17b3fff7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:18.243022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8d165ca4-80b7-4cc3-8275-91ae17b3fff7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:18.245425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=66 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:18.250561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d165ca4-80b7-4cc3-8275-91ae17b3fff7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:18.251037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d165ca4-80b7-4cc3-8275-91ae17b3fff7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:18.251465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d165ca4-80b7-4cc3-8275-91ae17b3fff7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:18.252170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d165ca4-80b7-4cc3-8275-91ae17b3fff7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:18.252617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d165ca4-80b7-4cc3-8275-91ae17b3fff7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:18.253062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d165ca4-80b7-4cc3-8275-91ae17b3fff7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:18.283544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8d165ca4-80b7-4cc3-8275-91ae17b3fff7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046660 Sep 01 05:20:18.284090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 385/737] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:18 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:19.010249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-07774963-7917-4d3f-9af0-a21102a0218f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:19.012380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-07774963-7917-4d3f-9af0-a21102a0218f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:19.018812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07774963-7917-4d3f-9af0-a21102a0218f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:19.019314 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07774963-7917-4d3f-9af0-a21102a0218f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:19.019750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07774963-7917-4d3f-9af0-a21102a0218f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:19.020435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07774963-7917-4d3f-9af0-a21102a0218f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:19.020917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07774963-7917-4d3f-9af0-a21102a0218f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:19.021338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07774963-7917-4d3f-9af0-a21102a0218f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:19.050647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-07774963-7917-4d3f-9af0-a21102a0218f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044490 Sep 01 05:20:19.051209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 353/738] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:19 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:19.296306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-74074b37-1c74-49fb-a4bc-328ab0612cf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:19.298501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-74074b37-1c74-49fb-a4bc-328ab0612cf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:19.304788 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74074b37-1c74-49fb-a4bc-328ab0612cf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:19.305279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74074b37-1c74-49fb-a4bc-328ab0612cf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:19.306365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74074b37-1c74-49fb-a4bc-328ab0612cf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:19.307042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74074b37-1c74-49fb-a4bc-328ab0612cf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:19.307488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74074b37-1c74-49fb-a4bc-328ab0612cf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:19.307903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74074b37-1c74-49fb-a4bc-328ab0612cf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:19.336704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-74074b37-1c74-49fb-a4bc-328ab0612cf4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044357 Sep 01 05:20:19.337820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 386/739] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:19 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:20.063510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d32c4f65-6971-41dd-98ec-141ab77e39d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:20.065689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d32c4f65-6971-41dd-98ec-141ab77e39d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:20.072163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d32c4f65-6971-41dd-98ec-141ab77e39d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:20.072645 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d32c4f65-6971-41dd-98ec-141ab77e39d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:20.073119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d32c4f65-6971-41dd-98ec-141ab77e39d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:20.073811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d32c4f65-6971-41dd-98ec-141ab77e39d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:20.074267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d32c4f65-6971-41dd-98ec-141ab77e39d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:20.074685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d32c4f65-6971-41dd-98ec-141ab77e39d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:20.105019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d32c4f65-6971-41dd-98ec-141ab77e39d8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045449 Sep 01 05:20:20.105570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 354/740] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:20 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:20.349310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5a832b96-3fc0-42b3-987b-3f703eac4134 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:20.351557 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5a832b96-3fc0-42b3-987b-3f703eac4134 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:20.358586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5a832b96-3fc0-42b3-987b-3f703eac4134 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:20.359059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5a832b96-3fc0-42b3-987b-3f703eac4134 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:20.359488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5a832b96-3fc0-42b3-987b-3f703eac4134 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:20.360182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5a832b96-3fc0-42b3-987b-3f703eac4134 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:20.360602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5a832b96-3fc0-42b3-987b-3f703eac4134 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:20.361047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5a832b96-3fc0-42b3-987b-3f703eac4134 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:20.389661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5a832b96-3fc0-42b3-987b-3f703eac4134 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044449 Sep 01 05:20:20.390203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 387/741] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:21.117555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e27757b8-863c-41b9-acfd-4d9e0843e914 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:21.119810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e27757b8-863c-41b9-acfd-4d9e0843e914 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:21.126193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e27757b8-863c-41b9-acfd-4d9e0843e914 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:21.126666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e27757b8-863c-41b9-acfd-4d9e0843e914 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:21.127095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e27757b8-863c-41b9-acfd-4d9e0843e914 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:21.127772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e27757b8-863c-41b9-acfd-4d9e0843e914 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:21.128223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e27757b8-863c-41b9-acfd-4d9e0843e914 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:21.128634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e27757b8-863c-41b9-acfd-4d9e0843e914 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:21.158304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e27757b8-863c-41b9-acfd-4d9e0843e914 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Sep 01 05:20:21.158877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 355/742] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:21 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:21.402600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6802d49e-767f-47c3-8591-33d1189066f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:21.404756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6802d49e-767f-47c3-8591-33d1189066f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:21.411139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6802d49e-767f-47c3-8591-33d1189066f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:21.411618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6802d49e-767f-47c3-8591-33d1189066f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:21.412050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6802d49e-767f-47c3-8591-33d1189066f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:21.412733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6802d49e-767f-47c3-8591-33d1189066f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:21.413208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6802d49e-767f-47c3-8591-33d1189066f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:21.413657 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6802d49e-767f-47c3-8591-33d1189066f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:21.442313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6802d49e-767f-47c3-8591-33d1189066f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044338 Sep 01 05:20:21.443056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 388/743] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:21 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:22.171315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b50f1a41-8842-4524-9be0-90e8332594b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:22.173365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b50f1a41-8842-4524-9be0-90e8332594b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:22.179626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b50f1a41-8842-4524-9be0-90e8332594b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:22.180099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b50f1a41-8842-4524-9be0-90e8332594b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:22.180528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b50f1a41-8842-4524-9be0-90e8332594b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:22.181994 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b50f1a41-8842-4524-9be0-90e8332594b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:22.182449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b50f1a41-8842-4524-9be0-90e8332594b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:22.182866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b50f1a41-8842-4524-9be0-90e8332594b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:22.211805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b50f1a41-8842-4524-9be0-90e8332594b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Sep 01 05:20:22.212398 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 356/744] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:22 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:22.455265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cf44a55e-729d-430b-831f-d643807707e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:22.457336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cf44a55e-729d-430b-831f-d643807707e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:22.464643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf44a55e-729d-430b-831f-d643807707e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:22.465157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf44a55e-729d-430b-831f-d643807707e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:22.465597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf44a55e-729d-430b-831f-d643807707e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:22.466323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf44a55e-729d-430b-831f-d643807707e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:22.466778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf44a55e-729d-430b-831f-d643807707e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:22.467201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf44a55e-729d-430b-831f-d643807707e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:22.496615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cf44a55e-729d-430b-831f-d643807707e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045441 Sep 01 05:20:22.497191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 389/745] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:23.223741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b78d9f09-5c71-4fe8-ad0c-643a974fec61 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:23.225826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b78d9f09-5c71-4fe8-ad0c-643a974fec61 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:23.232285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b78d9f09-5c71-4fe8-ad0c-643a974fec61 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:23.232761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b78d9f09-5c71-4fe8-ad0c-643a974fec61 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:23.233217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b78d9f09-5c71-4fe8-ad0c-643a974fec61 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:23.233890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b78d9f09-5c71-4fe8-ad0c-643a974fec61 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:23.234335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b78d9f09-5c71-4fe8-ad0c-643a974fec61 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:23.234750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b78d9f09-5c71-4fe8-ad0c-643a974fec61 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:23.264417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b78d9f09-5c71-4fe8-ad0c-643a974fec61 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 Sep 01 05:20:23.264993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 357/746] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:23 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:23.509024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8d7a112b-380a-45f9-8682-b2352eb7d87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:23.511144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8d7a112b-380a-45f9-8682-b2352eb7d87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:23.517534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d7a112b-380a-45f9-8682-b2352eb7d87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:23.518010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d7a112b-380a-45f9-8682-b2352eb7d87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:23.518437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d7a112b-380a-45f9-8682-b2352eb7d87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:23.519109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d7a112b-380a-45f9-8682-b2352eb7d87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:23.519553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d7a112b-380a-45f9-8682-b2352eb7d87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:23.519971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d7a112b-380a-45f9-8682-b2352eb7d87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:23.550294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8d7a112b-380a-45f9-8682-b2352eb7d87c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045350 Sep 01 05:20:23.551191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 390/747] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:24.276945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-944b2848-5803-46f3-9a3d-12156a8f9b06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:24.279912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-944b2848-5803-46f3-9a3d-12156a8f9b06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:24.287347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-944b2848-5803-46f3-9a3d-12156a8f9b06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:24.287704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-944b2848-5803-46f3-9a3d-12156a8f9b06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:24.288215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-944b2848-5803-46f3-9a3d-12156a8f9b06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:24.289016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-944b2848-5803-46f3-9a3d-12156a8f9b06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:24.289618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-944b2848-5803-46f3-9a3d-12156a8f9b06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:24.290080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-944b2848-5803-46f3-9a3d-12156a8f9b06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:24.320991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-944b2848-5803-46f3-9a3d-12156a8f9b06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048663 Sep 01 05:20:24.322172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 358/748] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:24 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:24.562640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-14e4c858-6131-43e8-aae1-76ad221047b1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:24.564872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-14e4c858-6131-43e8-aae1-76ad221047b1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:24.571804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14e4c858-6131-43e8-aae1-76ad221047b1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:24.572362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14e4c858-6131-43e8-aae1-76ad221047b1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:24.572851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14e4c858-6131-43e8-aae1-76ad221047b1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:24.573501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14e4c858-6131-43e8-aae1-76ad221047b1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:24.573950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14e4c858-6131-43e8-aae1-76ad221047b1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:24.574373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14e4c858-6131-43e8-aae1-76ad221047b1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:24.604018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-14e4c858-6131-43e8-aae1-76ad221047b1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045690 Sep 01 05:20:24.604578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 391/749] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:25.333771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-26689a92-a44c-4839-a04e-5784276c5fd1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:25.335794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-26689a92-a44c-4839-a04e-5784276c5fd1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:25.342940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26689a92-a44c-4839-a04e-5784276c5fd1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:25.343402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26689a92-a44c-4839-a04e-5784276c5fd1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:25.343830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26689a92-a44c-4839-a04e-5784276c5fd1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:25.344500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26689a92-a44c-4839-a04e-5784276c5fd1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:25.344972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26689a92-a44c-4839-a04e-5784276c5fd1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:25.345389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26689a92-a44c-4839-a04e-5784276c5fd1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:25.358711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:25.374934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-26689a92-a44c-4839-a04e-5784276c5fd1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 Sep 01 05:20:25.375483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 359/750] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:25 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:25.615735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4dfb6954-0485-4c2a-93b7-30e95c788014 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:25.618058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4dfb6954-0485-4c2a-93b7-30e95c788014 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:25.625536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dfb6954-0485-4c2a-93b7-30e95c788014 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:25.626014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dfb6954-0485-4c2a-93b7-30e95c788014 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:25.626444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dfb6954-0485-4c2a-93b7-30e95c788014 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:25.627123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dfb6954-0485-4c2a-93b7-30e95c788014 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:25.627578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dfb6954-0485-4c2a-93b7-30e95c788014 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:25.627990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dfb6954-0485-4c2a-93b7-30e95c788014 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:25.659105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4dfb6954-0485-4c2a-93b7-30e95c788014 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047370 Sep 01 05:20:25.659662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 392/751] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:26.387774 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a311d5a6-67ba-408b-b438-1b17c8ea3bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:26.389947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a311d5a6-67ba-408b-b438-1b17c8ea3bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:26.396292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a311d5a6-67ba-408b-b438-1b17c8ea3bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:26.396765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a311d5a6-67ba-408b-b438-1b17c8ea3bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:26.397229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a311d5a6-67ba-408b-b438-1b17c8ea3bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:26.397907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a311d5a6-67ba-408b-b438-1b17c8ea3bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:26.398358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a311d5a6-67ba-408b-b438-1b17c8ea3bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:26.398782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a311d5a6-67ba-408b-b438-1b17c8ea3bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:26.429087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a311d5a6-67ba-408b-b438-1b17c8ea3bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045325 Sep 01 05:20:26.429635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 360/752] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:26 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:26.671893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dd2f9102-a769-484e-8401-b1bd517d219a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:26.673974 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dd2f9102-a769-484e-8401-b1bd517d219a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:26.680246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd2f9102-a769-484e-8401-b1bd517d219a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:26.680729 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd2f9102-a769-484e-8401-b1bd517d219a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:26.681602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd2f9102-a769-484e-8401-b1bd517d219a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:26.682308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd2f9102-a769-484e-8401-b1bd517d219a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:26.682766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd2f9102-a769-484e-8401-b1bd517d219a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:26.683189 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd2f9102-a769-484e-8401-b1bd517d219a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:26.713600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dd2f9102-a769-484e-8401-b1bd517d219a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045579 Sep 01 05:20:26.714153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 393/753] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:27.442146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-76f38204-6cad-40ca-b5ee-9b0e07b1733e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:27.444277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-76f38204-6cad-40ca-b5ee-9b0e07b1733e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:27.451166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76f38204-6cad-40ca-b5ee-9b0e07b1733e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:27.451636 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76f38204-6cad-40ca-b5ee-9b0e07b1733e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:27.452065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76f38204-6cad-40ca-b5ee-9b0e07b1733e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:27.452735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76f38204-6cad-40ca-b5ee-9b0e07b1733e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:27.453206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76f38204-6cad-40ca-b5ee-9b0e07b1733e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:27.453617 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76f38204-6cad-40ca-b5ee-9b0e07b1733e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:27.482536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-76f38204-6cad-40ca-b5ee-9b0e07b1733e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Sep 01 05:20:27.483075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 361/754] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:27 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:27.726156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f9213fb8-0bd7-4514-9e1d-495a86edd4f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:27.728349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f9213fb8-0bd7-4514-9e1d-495a86edd4f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:27.734735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f9213fb8-0bd7-4514-9e1d-495a86edd4f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:27.735218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f9213fb8-0bd7-4514-9e1d-495a86edd4f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:27.735632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f9213fb8-0bd7-4514-9e1d-495a86edd4f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:27.736306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f9213fb8-0bd7-4514-9e1d-495a86edd4f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:27.736749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f9213fb8-0bd7-4514-9e1d-495a86edd4f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:27.737198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f9213fb8-0bd7-4514-9e1d-495a86edd4f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:27.766890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f9213fb8-0bd7-4514-9e1d-495a86edd4f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044904 Sep 01 05:20:27.767432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 394/755] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:27 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:28.495000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-32c7a8a5-19aa-4cff-9110-1568dd7489eb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:28.497060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-32c7a8a5-19aa-4cff-9110-1568dd7489eb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:28.503379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32c7a8a5-19aa-4cff-9110-1568dd7489eb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:28.503850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32c7a8a5-19aa-4cff-9110-1568dd7489eb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:28.504282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32c7a8a5-19aa-4cff-9110-1568dd7489eb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:28.504991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32c7a8a5-19aa-4cff-9110-1568dd7489eb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:28.505464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32c7a8a5-19aa-4cff-9110-1568dd7489eb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:28.505883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32c7a8a5-19aa-4cff-9110-1568dd7489eb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:28.535000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-32c7a8a5-19aa-4cff-9110-1568dd7489eb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Sep 01 05:20:28.535541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 362/756] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:28 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:28.780118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2a6b49b2-92b5-47c2-a6b7-cbfcf90f8bf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:28.782219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2a6b49b2-92b5-47c2-a6b7-cbfcf90f8bf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:28.788575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2a6b49b2-92b5-47c2-a6b7-cbfcf90f8bf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:28.789094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2a6b49b2-92b5-47c2-a6b7-cbfcf90f8bf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:28.789528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2a6b49b2-92b5-47c2-a6b7-cbfcf90f8bf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:28.790353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2a6b49b2-92b5-47c2-a6b7-cbfcf90f8bf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:28.791001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2a6b49b2-92b5-47c2-a6b7-cbfcf90f8bf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:28.791427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2a6b49b2-92b5-47c2-a6b7-cbfcf90f8bf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:28.795023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:28.822680 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2a6b49b2-92b5-47c2-a6b7-cbfcf90f8bf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046446 Sep 01 05:20:28.823242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 395/757] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:28 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:20:29.105315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2ffcdb14-3e1c-4eaf-9e80-65d2402620b1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:29.105765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2ffcdb14-3e1c-4eaf-9e80-65d2402620b1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:29.111666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2ffcdb14-3e1c-4eaf-9e80-65d2402620b1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:29.112153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2ffcdb14-3e1c-4eaf-9e80-65d2402620b1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:29.112639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2ffcdb14-3e1c-4eaf-9e80-65d2402620b1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:29.113393 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2ffcdb14-3e1c-4eaf-9e80-65d2402620b1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:29.113846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2ffcdb14-3e1c-4eaf-9e80-65d2402620b1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:29.114269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2ffcdb14-3e1c-4eaf-9e80-65d2402620b1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:29.138113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2ffcdb14-3e1c-4eaf-9e80-65d2402620b1 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104/ips" status: 200 len: 145 microversion: 2.1 time: 0.036710 Sep 01 05:20:29.138670 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 363/758] 10.222.0.49 () {58 vars in 1248 bytes} [Thu Sep 1 05:20:29 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:29.547397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c3c327f2-d471-4e33-ba51-7bb74c79a48e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:29.549593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c3c327f2-d471-4e33-ba51-7bb74c79a48e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:29.555519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3c327f2-d471-4e33-ba51-7bb74c79a48e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:29.556590 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3c327f2-d471-4e33-ba51-7bb74c79a48e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:29.557062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3c327f2-d471-4e33-ba51-7bb74c79a48e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:29.557766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3c327f2-d471-4e33-ba51-7bb74c79a48e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:29.558251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3c327f2-d471-4e33-ba51-7bb74c79a48e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:29.558940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3c327f2-d471-4e33-ba51-7bb74c79a48e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:29.590351 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c3c327f2-d471-4e33-ba51-7bb74c79a48e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046884 Sep 01 05:20:29.590917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 396/759] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:29 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:29.834965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-03d769f3-5128-45db-81ef-a5057f7a77aa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:29.837723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-03d769f3-5128-45db-81ef-a5057f7a77aa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:29.844510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03d769f3-5128-45db-81ef-a5057f7a77aa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:29.845019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03d769f3-5128-45db-81ef-a5057f7a77aa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:29.845451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03d769f3-5128-45db-81ef-a5057f7a77aa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:29.846136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03d769f3-5128-45db-81ef-a5057f7a77aa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:29.846580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03d769f3-5128-45db-81ef-a5057f7a77aa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:29.847026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03d769f3-5128-45db-81ef-a5057f7a77aa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:29.877584 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-03d769f3-5128-45db-81ef-a5057f7a77aa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046540 Sep 01 05:20:29.878304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 364/760] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:29 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:30.603894 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6734e905-f3e5-4db8-9803-ddd841774929 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:30.606125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6734e905-f3e5-4db8-9803-ddd841774929 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:30.612629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6734e905-f3e5-4db8-9803-ddd841774929 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:30.613153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6734e905-f3e5-4db8-9803-ddd841774929 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:30.613592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6734e905-f3e5-4db8-9803-ddd841774929 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:30.614276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6734e905-f3e5-4db8-9803-ddd841774929 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:30.614727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6734e905-f3e5-4db8-9803-ddd841774929 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:30.615150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6734e905-f3e5-4db8-9803-ddd841774929 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:30.646737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6734e905-f3e5-4db8-9803-ddd841774929 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047173 Sep 01 05:20:30.647297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 397/761] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:30 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:30.890692 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9487ed45-8a6e-4e2c-84bb-819f1cfcbb66 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:30.892848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9487ed45-8a6e-4e2c-84bb-819f1cfcbb66 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:30.899299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9487ed45-8a6e-4e2c-84bb-819f1cfcbb66 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:30.899940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9487ed45-8a6e-4e2c-84bb-819f1cfcbb66 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:30.900606 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9487ed45-8a6e-4e2c-84bb-819f1cfcbb66 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:30.901331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9487ed45-8a6e-4e2c-84bb-819f1cfcbb66 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:30.901784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9487ed45-8a6e-4e2c-84bb-819f1cfcbb66 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:30.902208 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9487ed45-8a6e-4e2c-84bb-819f1cfcbb66 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:30.932531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9487ed45-8a6e-4e2c-84bb-819f1cfcbb66 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045705 Sep 01 05:20:30.933112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 365/762] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:30 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:31.659423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-565e386e-b9ac-4710-af82-ef6d27766fce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:31.661564 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-565e386e-b9ac-4710-af82-ef6d27766fce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:31.668610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-565e386e-b9ac-4710-af82-ef6d27766fce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:31.669123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-565e386e-b9ac-4710-af82-ef6d27766fce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:31.669552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-565e386e-b9ac-4710-af82-ef6d27766fce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:31.670228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-565e386e-b9ac-4710-af82-ef6d27766fce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:31.670674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-565e386e-b9ac-4710-af82-ef6d27766fce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:31.671090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-565e386e-b9ac-4710-af82-ef6d27766fce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:31.701108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-565e386e-b9ac-4710-af82-ef6d27766fce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045598 Sep 01 05:20:31.701651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 398/763] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:31 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:31.945534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-47f7396c-74ce-47f2-9816-fe1e0c106d92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:31.947704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-47f7396c-74ce-47f2-9816-fe1e0c106d92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:31.954179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-47f7396c-74ce-47f2-9816-fe1e0c106d92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:31.954658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-47f7396c-74ce-47f2-9816-fe1e0c106d92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:31.955124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-47f7396c-74ce-47f2-9816-fe1e0c106d92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:31.955809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-47f7396c-74ce-47f2-9816-fe1e0c106d92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:31.956253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-47f7396c-74ce-47f2-9816-fe1e0c106d92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:31.956672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-47f7396c-74ce-47f2-9816-fe1e0c106d92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:31.985741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-47f7396c-74ce-47f2-9816-fe1e0c106d92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044223 Sep 01 05:20:31.986287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 366/764] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:32.713874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7659ae20-7621-4a36-9b3b-184d242af251 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:32.715991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7659ae20-7621-4a36-9b3b-184d242af251 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:32.722280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7659ae20-7621-4a36-9b3b-184d242af251 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:32.722756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7659ae20-7621-4a36-9b3b-184d242af251 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:32.723197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7659ae20-7621-4a36-9b3b-184d242af251 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:32.723862 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7659ae20-7621-4a36-9b3b-184d242af251 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:32.724306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7659ae20-7621-4a36-9b3b-184d242af251 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:32.724721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7659ae20-7621-4a36-9b3b-184d242af251 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:32.753392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7659ae20-7621-4a36-9b3b-184d242af251 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Sep 01 05:20:32.753929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 399/765] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:32 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:32.998652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6283bb5f-c769-4cc8-bc81-92cb1f70e3e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:33.000768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6283bb5f-c769-4cc8-bc81-92cb1f70e3e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:33.007215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6283bb5f-c769-4cc8-bc81-92cb1f70e3e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.007695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6283bb5f-c769-4cc8-bc81-92cb1f70e3e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.008152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6283bb5f-c769-4cc8-bc81-92cb1f70e3e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.008845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6283bb5f-c769-4cc8-bc81-92cb1f70e3e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.010050 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6283bb5f-c769-4cc8-bc81-92cb1f70e3e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.010587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6283bb5f-c769-4cc8-bc81-92cb1f70e3e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.040171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6283bb5f-c769-4cc8-bc81-92cb1f70e3e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045444 Sep 01 05:20:33.040656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 367/766] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:33.766441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-771b96ff-98a1-4d88-83d4-43c916297971 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:33.768477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-771b96ff-98a1-4d88-83d4-43c916297971 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:33.775435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-771b96ff-98a1-4d88-83d4-43c916297971 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.775916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-771b96ff-98a1-4d88-83d4-43c916297971 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.776345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-771b96ff-98a1-4d88-83d4-43c916297971 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.777052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-771b96ff-98a1-4d88-83d4-43c916297971 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.777502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-771b96ff-98a1-4d88-83d4-43c916297971 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.777925 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-771b96ff-98a1-4d88-83d4-43c916297971 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.807879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-771b96ff-98a1-4d88-83d4-43c916297971 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045426 Sep 01 05:20:33.808461 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 400/767] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:34.051768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-765cc7ad-0f8b-4687-8202-76a01e8cadc6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:34.053869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-765cc7ad-0f8b-4687-8202-76a01e8cadc6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:34.060707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-765cc7ad-0f8b-4687-8202-76a01e8cadc6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:34.061210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-765cc7ad-0f8b-4687-8202-76a01e8cadc6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:34.061638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-765cc7ad-0f8b-4687-8202-76a01e8cadc6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:34.062308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-765cc7ad-0f8b-4687-8202-76a01e8cadc6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:34.062749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-765cc7ad-0f8b-4687-8202-76a01e8cadc6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:34.063163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-765cc7ad-0f8b-4687-8202-76a01e8cadc6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:34.093053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-765cc7ad-0f8b-4687-8202-76a01e8cadc6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045338 Sep 01 05:20:34.093590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 368/768] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:34.820341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d8e2cbe0-843f-4dfb-b83f-71a0a9a7a41f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:34.822518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d8e2cbe0-843f-4dfb-b83f-71a0a9a7a41f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:34.829037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8e2cbe0-843f-4dfb-b83f-71a0a9a7a41f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:34.829518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8e2cbe0-843f-4dfb-b83f-71a0a9a7a41f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:34.829951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8e2cbe0-843f-4dfb-b83f-71a0a9a7a41f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:34.830641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8e2cbe0-843f-4dfb-b83f-71a0a9a7a41f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:34.831103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8e2cbe0-843f-4dfb-b83f-71a0a9a7a41f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:34.831537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8e2cbe0-843f-4dfb-b83f-71a0a9a7a41f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:34.862121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d8e2cbe0-843f-4dfb-b83f-71a0a9a7a41f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045723 Sep 01 05:20:34.862674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 401/769] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:35.106417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-885cc6e5-2f82-48ab-9522-f1cec8b322a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:35.108560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-885cc6e5-2f82-48ab-9522-f1cec8b322a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:35.115006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-885cc6e5-2f82-48ab-9522-f1cec8b322a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:35.115486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-885cc6e5-2f82-48ab-9522-f1cec8b322a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:35.116049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-885cc6e5-2f82-48ab-9522-f1cec8b322a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:35.116986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-885cc6e5-2f82-48ab-9522-f1cec8b322a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:35.117439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-885cc6e5-2f82-48ab-9522-f1cec8b322a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:35.117859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-885cc6e5-2f82-48ab-9522-f1cec8b322a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:35.146852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-885cc6e5-2f82-48ab-9522-f1cec8b322a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045324 Sep 01 05:20:35.147325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 369/770] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:35.874878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5af84846-b1be-4c2b-b107-fc70876165ff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:35.877108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5af84846-b1be-4c2b-b107-fc70876165ff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:35.883280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5af84846-b1be-4c2b-b107-fc70876165ff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:35.883772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5af84846-b1be-4c2b-b107-fc70876165ff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:35.884878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5af84846-b1be-4c2b-b107-fc70876165ff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:35.885770 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5af84846-b1be-4c2b-b107-fc70876165ff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:35.886199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5af84846-b1be-4c2b-b107-fc70876165ff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:35.886625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5af84846-b1be-4c2b-b107-fc70876165ff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:35.916702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5af84846-b1be-4c2b-b107-fc70876165ff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045836 Sep 01 05:20:35.917290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 402/771] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:35 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:36.159669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-af2311cf-ac21-4a02-8602-efcce24787d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:36.161802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-af2311cf-ac21-4a02-8602-efcce24787d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:36.168091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2311cf-ac21-4a02-8602-efcce24787d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:36.168562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2311cf-ac21-4a02-8602-efcce24787d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:36.169035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2311cf-ac21-4a02-8602-efcce24787d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:36.169704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2311cf-ac21-4a02-8602-efcce24787d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:36.170145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2311cf-ac21-4a02-8602-efcce24787d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:36.170555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2311cf-ac21-4a02-8602-efcce24787d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:36.201442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-af2311cf-ac21-4a02-8602-efcce24787d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045794 Sep 01 05:20:36.201988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 370/772] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:36.928651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e1a6bbaf-643f-4344-90b6-5cbf63bdff83 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:36.931352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e1a6bbaf-643f-4344-90b6-5cbf63bdff83 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:36.938224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e1a6bbaf-643f-4344-90b6-5cbf63bdff83 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:36.938704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e1a6bbaf-643f-4344-90b6-5cbf63bdff83 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:36.939138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e1a6bbaf-643f-4344-90b6-5cbf63bdff83 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:36.939817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e1a6bbaf-643f-4344-90b6-5cbf63bdff83 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:36.940266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e1a6bbaf-643f-4344-90b6-5cbf63bdff83 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:36.940717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e1a6bbaf-643f-4344-90b6-5cbf63bdff83 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:36.969844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e1a6bbaf-643f-4344-90b6-5cbf63bdff83 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045128 Sep 01 05:20:36.970494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 403/773] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:36 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:37.214440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b77d4809-1985-4e87-a3b1-68562336f5d8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:37.216535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b77d4809-1985-4e87-a3b1-68562336f5d8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:37.222895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b77d4809-1985-4e87-a3b1-68562336f5d8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:37.223521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b77d4809-1985-4e87-a3b1-68562336f5d8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:37.223962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b77d4809-1985-4e87-a3b1-68562336f5d8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:37.224642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b77d4809-1985-4e87-a3b1-68562336f5d8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:37.225115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b77d4809-1985-4e87-a3b1-68562336f5d8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:37.225532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b77d4809-1985-4e87-a3b1-68562336f5d8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:37.254437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b77d4809-1985-4e87-a3b1-68562336f5d8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044574 Sep 01 05:20:37.254988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 371/774] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:37 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:37.982053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b9099219-7539-430c-bd3e-32f9dde04364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:37.984158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b9099219-7539-430c-bd3e-32f9dde04364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:37.990453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9099219-7539-430c-bd3e-32f9dde04364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:37.990927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9099219-7539-430c-bd3e-32f9dde04364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:37.991357 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9099219-7539-430c-bd3e-32f9dde04364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:37.992030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9099219-7539-430c-bd3e-32f9dde04364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:37.992474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9099219-7539-430c-bd3e-32f9dde04364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:37.992913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9099219-7539-430c-bd3e-32f9dde04364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:38.022320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b9099219-7539-430c-bd3e-32f9dde04364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Sep 01 05:20:38.022894 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 404/775] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:37 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:38.266434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0865bdf9-c592-4c69-baa1-6876660f6762 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:38.268536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0865bdf9-c592-4c69-baa1-6876660f6762 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:38.274603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0865bdf9-c592-4c69-baa1-6876660f6762 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:38.275278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0865bdf9-c592-4c69-baa1-6876660f6762 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:38.275762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0865bdf9-c592-4c69-baa1-6876660f6762 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:38.276444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0865bdf9-c592-4c69-baa1-6876660f6762 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:38.276912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0865bdf9-c592-4c69-baa1-6876660f6762 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:38.277332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0865bdf9-c592-4c69-baa1-6876660f6762 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:38.307084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0865bdf9-c592-4c69-baa1-6876660f6762 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044601 Sep 01 05:20:38.307636 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 372/776] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:38 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:39.035261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b98c5ad5-cc02-46a9-bade-b2ef4ae836a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:39.037395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b98c5ad5-cc02-46a9-bade-b2ef4ae836a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:39.044450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b98c5ad5-cc02-46a9-bade-b2ef4ae836a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:39.044955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b98c5ad5-cc02-46a9-bade-b2ef4ae836a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:39.045393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b98c5ad5-cc02-46a9-bade-b2ef4ae836a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:39.046068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b98c5ad5-cc02-46a9-bade-b2ef4ae836a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:39.046512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b98c5ad5-cc02-46a9-bade-b2ef4ae836a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:39.046926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b98c5ad5-cc02-46a9-bade-b2ef4ae836a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:39.075916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b98c5ad5-cc02-46a9-bade-b2ef4ae836a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044647 Sep 01 05:20:39.076470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 405/777] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:39.319645 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-69f406d8-3007-4eff-8996-45612926d874 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:39.322682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-69f406d8-3007-4eff-8996-45612926d874 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:39.329153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-69f406d8-3007-4eff-8996-45612926d874 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:39.329635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-69f406d8-3007-4eff-8996-45612926d874 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:39.330071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-69f406d8-3007-4eff-8996-45612926d874 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:39.330754 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-69f406d8-3007-4eff-8996-45612926d874 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:39.331205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-69f406d8-3007-4eff-8996-45612926d874 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:39.331628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-69f406d8-3007-4eff-8996-45612926d874 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:39.362041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-69f406d8-3007-4eff-8996-45612926d874 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046387 Sep 01 05:20:39.362586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 373/778] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:39 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:40.087488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-527a112b-b7c0-495a-ac1f-f45a458a55d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:40.089731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-527a112b-b7c0-495a-ac1f-f45a458a55d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:40.096246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-527a112b-b7c0-495a-ac1f-f45a458a55d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:40.096720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-527a112b-b7c0-495a-ac1f-f45a458a55d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:40.097180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-527a112b-b7c0-495a-ac1f-f45a458a55d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:40.097855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-527a112b-b7c0-495a-ac1f-f45a458a55d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:40.098302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-527a112b-b7c0-495a-ac1f-f45a458a55d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:40.098714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-527a112b-b7c0-495a-ac1f-f45a458a55d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:40.129515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-527a112b-b7c0-495a-ac1f-f45a458a55d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045917 Sep 01 05:20:40.130064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 406/779] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:40 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:40.374501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9f596c78-8ec5-4beb-a6b7-e9ea25c4e404 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:40.376669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9f596c78-8ec5-4beb-a6b7-e9ea25c4e404 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:40.383143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f596c78-8ec5-4beb-a6b7-e9ea25c4e404 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:40.383618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f596c78-8ec5-4beb-a6b7-e9ea25c4e404 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:40.384052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f596c78-8ec5-4beb-a6b7-e9ea25c4e404 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:40.384854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f596c78-8ec5-4beb-a6b7-e9ea25c4e404 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:40.385304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f596c78-8ec5-4beb-a6b7-e9ea25c4e404 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:40.385729 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f596c78-8ec5-4beb-a6b7-e9ea25c4e404 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:40.414580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9f596c78-8ec5-4beb-a6b7-e9ea25c4e404 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044104 Sep 01 05:20:40.415122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 374/780] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:41.141823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-286dc0cb-6f65-4497-8ca6-09cdc1e6fb28 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:41.143957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-286dc0cb-6f65-4497-8ca6-09cdc1e6fb28 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:41.150982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-286dc0cb-6f65-4497-8ca6-09cdc1e6fb28 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:41.151456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-286dc0cb-6f65-4497-8ca6-09cdc1e6fb28 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:41.151883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-286dc0cb-6f65-4497-8ca6-09cdc1e6fb28 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:41.152555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-286dc0cb-6f65-4497-8ca6-09cdc1e6fb28 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:41.153043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-286dc0cb-6f65-4497-8ca6-09cdc1e6fb28 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:41.153462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-286dc0cb-6f65-4497-8ca6-09cdc1e6fb28 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:41.184794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-286dc0cb-6f65-4497-8ca6-09cdc1e6fb28 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046896 Sep 01 05:20:41.185337 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 407/781] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:41.427670 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b5ff9267-eb93-4f8d-abfd-bbcf0f8bff0c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:41.429882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b5ff9267-eb93-4f8d-abfd-bbcf0f8bff0c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:41.436567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5ff9267-eb93-4f8d-abfd-bbcf0f8bff0c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:41.437080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5ff9267-eb93-4f8d-abfd-bbcf0f8bff0c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:41.437512 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5ff9267-eb93-4f8d-abfd-bbcf0f8bff0c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:41.438185 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5ff9267-eb93-4f8d-abfd-bbcf0f8bff0c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:41.438624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5ff9267-eb93-4f8d-abfd-bbcf0f8bff0c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:41.439038 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5ff9267-eb93-4f8d-abfd-bbcf0f8bff0c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:41.468404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b5ff9267-eb93-4f8d-abfd-bbcf0f8bff0c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044762 Sep 01 05:20:41.468965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 375/782] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:42.196243 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cf8e0257-7a31-4eae-9427-b14b30098a9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:42.198956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cf8e0257-7a31-4eae-9427-b14b30098a9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:42.205558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf8e0257-7a31-4eae-9427-b14b30098a9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:42.206070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf8e0257-7a31-4eae-9427-b14b30098a9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:42.206512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf8e0257-7a31-4eae-9427-b14b30098a9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:42.207201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf8e0257-7a31-4eae-9427-b14b30098a9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:42.207656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf8e0257-7a31-4eae-9427-b14b30098a9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:42.208080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf8e0257-7a31-4eae-9427-b14b30098a9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:42.237289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cf8e0257-7a31-4eae-9427-b14b30098a9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044983 Sep 01 05:20:42.237842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 408/783] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:42 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:42.481471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0ee05ebe-a347-475c-bbe8-734a07f59872 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:42.483515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0ee05ebe-a347-475c-bbe8-734a07f59872 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:42.489911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ee05ebe-a347-475c-bbe8-734a07f59872 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:42.490389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ee05ebe-a347-475c-bbe8-734a07f59872 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:42.490823 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ee05ebe-a347-475c-bbe8-734a07f59872 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:42.491503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ee05ebe-a347-475c-bbe8-734a07f59872 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:42.491949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ee05ebe-a347-475c-bbe8-734a07f59872 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:42.492367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ee05ebe-a347-475c-bbe8-734a07f59872 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:42.506669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:42.522702 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0ee05ebe-a347-475c-bbe8-734a07f59872 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046054 Sep 01 05:20:42.523253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 376/784] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:43.250042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-74da1628-fbdb-4dc6-bcc9-f619feec7112 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:43.252083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-74da1628-fbdb-4dc6-bcc9-f619feec7112 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:43.258370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74da1628-fbdb-4dc6-bcc9-f619feec7112 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:43.258860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74da1628-fbdb-4dc6-bcc9-f619feec7112 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:43.259808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74da1628-fbdb-4dc6-bcc9-f619feec7112 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:43.260490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74da1628-fbdb-4dc6-bcc9-f619feec7112 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:43.260976 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74da1628-fbdb-4dc6-bcc9-f619feec7112 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:43.261398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74da1628-fbdb-4dc6-bcc9-f619feec7112 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:43.291027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-74da1628-fbdb-4dc6-bcc9-f619feec7112 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045001 Sep 01 05:20:43.291586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 409/785] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:43 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:43.535008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9f803bbe-0d2f-4b9c-8c96-7cb4f4887185 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:43.537085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9f803bbe-0d2f-4b9c-8c96-7cb4f4887185 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:43.544463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f803bbe-0d2f-4b9c-8c96-7cb4f4887185 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:43.544982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f803bbe-0d2f-4b9c-8c96-7cb4f4887185 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:43.545408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f803bbe-0d2f-4b9c-8c96-7cb4f4887185 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:43.546076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f803bbe-0d2f-4b9c-8c96-7cb4f4887185 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:43.546516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f803bbe-0d2f-4b9c-8c96-7cb4f4887185 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:43.546928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f803bbe-0d2f-4b9c-8c96-7cb4f4887185 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:43.576151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9f803bbe-0d2f-4b9c-8c96-7cb4f4887185 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045167 Sep 01 05:20:43.576691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 377/786] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:44.303018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9e8da06d-8cbc-4adc-a329-5f4b5449b6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:44.305183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9e8da06d-8cbc-4adc-a329-5f4b5449b6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:44.311730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e8da06d-8cbc-4adc-a329-5f4b5449b6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:44.312208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e8da06d-8cbc-4adc-a329-5f4b5449b6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:44.312636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e8da06d-8cbc-4adc-a329-5f4b5449b6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:44.313338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e8da06d-8cbc-4adc-a329-5f4b5449b6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:44.313783 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e8da06d-8cbc-4adc-a329-5f4b5449b6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:44.314199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e8da06d-8cbc-4adc-a329-5f4b5449b6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:44.343599 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9e8da06d-8cbc-4adc-a329-5f4b5449b6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044524 Sep 01 05:20:44.344141 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 410/787] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:44 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:44.589438 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bac71522-0229-4a0f-9968-a3d8c4817532 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:44.591565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bac71522-0229-4a0f-9968-a3d8c4817532 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:44.598008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bac71522-0229-4a0f-9968-a3d8c4817532 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:44.598488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bac71522-0229-4a0f-9968-a3d8c4817532 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:44.598920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bac71522-0229-4a0f-9968-a3d8c4817532 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:44.599597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bac71522-0229-4a0f-9968-a3d8c4817532 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:44.600042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bac71522-0229-4a0f-9968-a3d8c4817532 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:44.600458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bac71522-0229-4a0f-9968-a3d8c4817532 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:44.630262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bac71522-0229-4a0f-9968-a3d8c4817532 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045528 Sep 01 05:20:44.630813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 378/788] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:20:45.355699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5efd6a2a-e130-47de-83d2-ec35e5432e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:45.357836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5efd6a2a-e130-47de-83d2-ec35e5432e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:45.364118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5efd6a2a-e130-47de-83d2-ec35e5432e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:45.364591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5efd6a2a-e130-47de-83d2-ec35e5432e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:45.365069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5efd6a2a-e130-47de-83d2-ec35e5432e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:45.365746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5efd6a2a-e130-47de-83d2-ec35e5432e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:45.366190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5efd6a2a-e130-47de-83d2-ec35e5432e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:45.366605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5efd6a2a-e130-47de-83d2-ec35e5432e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:45.391285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:45.396408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5efd6a2a-e130-47de-83d2-ec35e5432e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044777 Sep 01 05:20:45.396991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 411/789] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:45.643323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-298ae5d1-faae-4f48-987e-bb11a8924755 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:45.645435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-298ae5d1-faae-4f48-987e-bb11a8924755 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:45.647681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=60 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:45.653095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-298ae5d1-faae-4f48-987e-bb11a8924755 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:45.653565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-298ae5d1-faae-4f48-987e-bb11a8924755 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:45.653992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-298ae5d1-faae-4f48-987e-bb11a8924755 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:45.654663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-298ae5d1-faae-4f48-987e-bb11a8924755 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:45.655107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-298ae5d1-faae-4f48-987e-bb11a8924755 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:45.655518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-298ae5d1-faae-4f48-987e-bb11a8924755 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:45.686275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-298ae5d1-faae-4f48-987e-bb11a8924755 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046893 Sep 01 05:20:45.687021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 379/790] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:45 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:46.409334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5bc731ec-dcbd-444a-880d-2d157cb06812 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:46.411451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5bc731ec-dcbd-444a-880d-2d157cb06812 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:46.418213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5bc731ec-dcbd-444a-880d-2d157cb06812 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:46.418695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5bc731ec-dcbd-444a-880d-2d157cb06812 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:46.419117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5bc731ec-dcbd-444a-880d-2d157cb06812 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:46.419790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5bc731ec-dcbd-444a-880d-2d157cb06812 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:46.420235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5bc731ec-dcbd-444a-880d-2d157cb06812 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:46.420654 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5bc731ec-dcbd-444a-880d-2d157cb06812 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:46.451254 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5bc731ec-dcbd-444a-880d-2d157cb06812 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045738 Sep 01 05:20:46.451737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 412/791] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:46 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:46.699658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1730d9c9-2770-4e80-bd46-a5d2fccead19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:46.701999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1730d9c9-2770-4e80-bd46-a5d2fccead19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:46.708888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1730d9c9-2770-4e80-bd46-a5d2fccead19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:46.709610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1730d9c9-2770-4e80-bd46-a5d2fccead19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:46.710045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1730d9c9-2770-4e80-bd46-a5d2fccead19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:46.710756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1730d9c9-2770-4e80-bd46-a5d2fccead19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:46.711200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1730d9c9-2770-4e80-bd46-a5d2fccead19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:46.711615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1730d9c9-2770-4e80-bd46-a5d2fccead19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:46.740956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1730d9c9-2770-4e80-bd46-a5d2fccead19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045898 Sep 01 05:20:46.741505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 380/792] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:47.463483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-789bafa3-7326-440e-ad07-f107cf6a0c2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:47.465713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-789bafa3-7326-440e-ad07-f107cf6a0c2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:47.472030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-789bafa3-7326-440e-ad07-f107cf6a0c2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:47.472511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-789bafa3-7326-440e-ad07-f107cf6a0c2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:47.473015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-789bafa3-7326-440e-ad07-f107cf6a0c2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:47.473697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-789bafa3-7326-440e-ad07-f107cf6a0c2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:47.474179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-789bafa3-7326-440e-ad07-f107cf6a0c2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:47.474601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-789bafa3-7326-440e-ad07-f107cf6a0c2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:47.505065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-789bafa3-7326-440e-ad07-f107cf6a0c2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045622 Sep 01 05:20:47.505631 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 413/793] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:47.753369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4292fa73-c10a-4363-b8f4-ec54f8b84d9a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:47.755402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4292fa73-c10a-4363-b8f4-ec54f8b84d9a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:47.761912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4292fa73-c10a-4363-b8f4-ec54f8b84d9a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:47.762383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4292fa73-c10a-4363-b8f4-ec54f8b84d9a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:47.762810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4292fa73-c10a-4363-b8f4-ec54f8b84d9a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:47.763482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4292fa73-c10a-4363-b8f4-ec54f8b84d9a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:47.763922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4292fa73-c10a-4363-b8f4-ec54f8b84d9a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:47.764332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4292fa73-c10a-4363-b8f4-ec54f8b84d9a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:47.793613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4292fa73-c10a-4363-b8f4-ec54f8b84d9a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044304 Sep 01 05:20:47.794154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 381/794] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:47 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:48.517141 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-384bbb14-fe6a-4ee3-9be8-48567a7abc71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:48.519288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-384bbb14-fe6a-4ee3-9be8-48567a7abc71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:48.521556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=58 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:48.527033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-384bbb14-fe6a-4ee3-9be8-48567a7abc71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:48.527507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-384bbb14-fe6a-4ee3-9be8-48567a7abc71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:48.527935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-384bbb14-fe6a-4ee3-9be8-48567a7abc71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:48.528609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-384bbb14-fe6a-4ee3-9be8-48567a7abc71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:48.529084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-384bbb14-fe6a-4ee3-9be8-48567a7abc71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:48.529502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-384bbb14-fe6a-4ee3-9be8-48567a7abc71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:48.559013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-384bbb14-fe6a-4ee3-9be8-48567a7abc71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045757 Sep 01 05:20:48.559742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 414/795] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:48 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:48.805937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3a8d299d-17e9-4831-aba1-699f4c0260ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:48.808148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3a8d299d-17e9-4831-aba1-699f4c0260ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:48.814991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a8d299d-17e9-4831-aba1-699f4c0260ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:48.815403 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a8d299d-17e9-4831-aba1-699f4c0260ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:48.815828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a8d299d-17e9-4831-aba1-699f4c0260ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:48.816528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a8d299d-17e9-4831-aba1-699f4c0260ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:48.817005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a8d299d-17e9-4831-aba1-699f4c0260ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:48.817419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a8d299d-17e9-4831-aba1-699f4c0260ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:48.846911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3a8d299d-17e9-4831-aba1-699f4c0260ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044977 Sep 01 05:20:48.847458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 382/796] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:49.571347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dc676c81-ac28-40e2-99fd-e0e234b78266 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:49.573554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dc676c81-ac28-40e2-99fd-e0e234b78266 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:49.579998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc676c81-ac28-40e2-99fd-e0e234b78266 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:49.580483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc676c81-ac28-40e2-99fd-e0e234b78266 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:49.580945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc676c81-ac28-40e2-99fd-e0e234b78266 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:49.581625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc676c81-ac28-40e2-99fd-e0e234b78266 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:49.582074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc676c81-ac28-40e2-99fd-e0e234b78266 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:49.582492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc676c81-ac28-40e2-99fd-e0e234b78266 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:49.612419 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dc676c81-ac28-40e2-99fd-e0e234b78266 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044949 Sep 01 05:20:49.612921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 415/797] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:49 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:49.859358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5d87b87b-af73-45e3-b31c-6c9af2b690e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:49.861567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5d87b87b-af73-45e3-b31c-6c9af2b690e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:49.868274 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d87b87b-af73-45e3-b31c-6c9af2b690e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:49.868732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d87b87b-af73-45e3-b31c-6c9af2b690e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:49.869420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d87b87b-af73-45e3-b31c-6c9af2b690e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:49.870115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d87b87b-af73-45e3-b31c-6c9af2b690e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:49.870569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d87b87b-af73-45e3-b31c-6c9af2b690e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:49.870995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d87b87b-af73-45e3-b31c-6c9af2b690e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:49.901723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5d87b87b-af73-45e3-b31c-6c9af2b690e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046357 Sep 01 05:20:49.902280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 383/798] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:49 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:50.624670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3ff9af6b-4c12-4c1e-af3b-9b0216133256 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:50.626731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3ff9af6b-4c12-4c1e-af3b-9b0216133256 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:50.633161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3ff9af6b-4c12-4c1e-af3b-9b0216133256 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:50.633636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3ff9af6b-4c12-4c1e-af3b-9b0216133256 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:50.634066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3ff9af6b-4c12-4c1e-af3b-9b0216133256 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:50.635240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3ff9af6b-4c12-4c1e-af3b-9b0216133256 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:50.635686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3ff9af6b-4c12-4c1e-af3b-9b0216133256 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:50.636099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3ff9af6b-4c12-4c1e-af3b-9b0216133256 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:50.666079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3ff9af6b-4c12-4c1e-af3b-9b0216133256 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Sep 01 05:20:50.666624 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 416/799] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:50 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:50.914130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-47fd669f-ec69-4cf9-bcbd-425b3d3e192d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:50.916355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-47fd669f-ec69-4cf9-bcbd-425b3d3e192d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:50.923593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-47fd669f-ec69-4cf9-bcbd-425b3d3e192d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:50.924073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-47fd669f-ec69-4cf9-bcbd-425b3d3e192d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:50.924503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-47fd669f-ec69-4cf9-bcbd-425b3d3e192d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:50.925210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-47fd669f-ec69-4cf9-bcbd-425b3d3e192d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:50.925657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-47fd669f-ec69-4cf9-bcbd-425b3d3e192d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:50.926074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-47fd669f-ec69-4cf9-bcbd-425b3d3e192d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:50.955119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-47fd669f-ec69-4cf9-bcbd-425b3d3e192d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045035 Sep 01 05:20:50.955665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 384/800] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:51.678187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-79cd996a-a695-4010-b014-6a09272b4170 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:51.680297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-79cd996a-a695-4010-b014-6a09272b4170 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:51.687485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-79cd996a-a695-4010-b014-6a09272b4170 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:51.687960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-79cd996a-a695-4010-b014-6a09272b4170 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:51.688389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-79cd996a-a695-4010-b014-6a09272b4170 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:51.689096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-79cd996a-a695-4010-b014-6a09272b4170 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:51.689540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-79cd996a-a695-4010-b014-6a09272b4170 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:51.689962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-79cd996a-a695-4010-b014-6a09272b4170 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:51.719511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-79cd996a-a695-4010-b014-6a09272b4170 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Sep 01 05:20:51.719986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 417/801] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:51.968206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e7b9ccd5-1c7e-48d8-aba5-6199f744c8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:51.970436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e7b9ccd5-1c7e-48d8-aba5-6199f744c8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:51.976763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7b9ccd5-1c7e-48d8-aba5-6199f744c8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:51.977275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7b9ccd5-1c7e-48d8-aba5-6199f744c8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:51.977714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7b9ccd5-1c7e-48d8-aba5-6199f744c8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:51.979092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7b9ccd5-1c7e-48d8-aba5-6199f744c8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:51.979545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7b9ccd5-1c7e-48d8-aba5-6199f744c8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:51.979975 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7b9ccd5-1c7e-48d8-aba5-6199f744c8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:52.009290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e7b9ccd5-1c7e-48d8-aba5-6199f744c8a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045116 Sep 01 05:20:52.009879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 385/802] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:51 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:52.732581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-70f59f7b-5c62-4d7d-92fc-c6861d1dacbe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:52.734839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-70f59f7b-5c62-4d7d-92fc-c6861d1dacbe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:52.741301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70f59f7b-5c62-4d7d-92fc-c6861d1dacbe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:52.741794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70f59f7b-5c62-4d7d-92fc-c6861d1dacbe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:52.742236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70f59f7b-5c62-4d7d-92fc-c6861d1dacbe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:52.742922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70f59f7b-5c62-4d7d-92fc-c6861d1dacbe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:52.743374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70f59f7b-5c62-4d7d-92fc-c6861d1dacbe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:52.744449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70f59f7b-5c62-4d7d-92fc-c6861d1dacbe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:52.774623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-70f59f7b-5c62-4d7d-92fc-c6861d1dacbe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046599 Sep 01 05:20:52.775448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 418/803] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:53.022246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-66a65be4-c605-4457-aa2f-33db9d32de8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:53.024727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-66a65be4-c605-4457-aa2f-33db9d32de8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:53.032087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-66a65be4-c605-4457-aa2f-33db9d32de8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:53.032578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-66a65be4-c605-4457-aa2f-33db9d32de8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:53.033047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-66a65be4-c605-4457-aa2f-33db9d32de8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:53.033736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-66a65be4-c605-4457-aa2f-33db9d32de8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:53.034196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-66a65be4-c605-4457-aa2f-33db9d32de8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:53.034611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-66a65be4-c605-4457-aa2f-33db9d32de8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:53.070364 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-66a65be4-c605-4457-aa2f-33db9d32de8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052455 Sep 01 05:20:53.070926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 386/804] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:53.788237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a870f2ad-9f00-43ab-8c7f-39e803ce1336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:53.790346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a870f2ad-9f00-43ab-8c7f-39e803ce1336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:53.797385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a870f2ad-9f00-43ab-8c7f-39e803ce1336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:53.797863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a870f2ad-9f00-43ab-8c7f-39e803ce1336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:53.798294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a870f2ad-9f00-43ab-8c7f-39e803ce1336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:53.798980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a870f2ad-9f00-43ab-8c7f-39e803ce1336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:53.799429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a870f2ad-9f00-43ab-8c7f-39e803ce1336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:53.799845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a870f2ad-9f00-43ab-8c7f-39e803ce1336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:53.834118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a870f2ad-9f00-43ab-8c7f-39e803ce1336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050980 Sep 01 05:20:53.834777 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 419/805] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:54.083675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-34255dbf-14be-4a1a-9d89-c066f7d85723 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:54.085758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-34255dbf-14be-4a1a-9d89-c066f7d85723 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:54.092690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34255dbf-14be-4a1a-9d89-c066f7d85723 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:54.093202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34255dbf-14be-4a1a-9d89-c066f7d85723 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:54.093631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34255dbf-14be-4a1a-9d89-c066f7d85723 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:54.094300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34255dbf-14be-4a1a-9d89-c066f7d85723 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:54.094739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34255dbf-14be-4a1a-9d89-c066f7d85723 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:54.095150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34255dbf-14be-4a1a-9d89-c066f7d85723 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:54.124318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-34255dbf-14be-4a1a-9d89-c066f7d85723 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044725 Sep 01 05:20:54.124891 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 387/806] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:54.846595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-863dfbea-9d31-4317-922b-78d4be72794f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:54.848753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-863dfbea-9d31-4317-922b-78d4be72794f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:54.855608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-863dfbea-9d31-4317-922b-78d4be72794f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:54.856090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-863dfbea-9d31-4317-922b-78d4be72794f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:54.856619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-863dfbea-9d31-4317-922b-78d4be72794f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:54.857358 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-863dfbea-9d31-4317-922b-78d4be72794f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:54.857819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-863dfbea-9d31-4317-922b-78d4be72794f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:54.858246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-863dfbea-9d31-4317-922b-78d4be72794f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:54.888751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-863dfbea-9d31-4317-922b-78d4be72794f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046108 Sep 01 05:20:54.889342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 420/807] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:55.137032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-55d2056e-88a9-4c2c-ac94-f5aca1d766cd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:55.139194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-55d2056e-88a9-4c2c-ac94-f5aca1d766cd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:55.145565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55d2056e-88a9-4c2c-ac94-f5aca1d766cd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:55.146040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55d2056e-88a9-4c2c-ac94-f5aca1d766cd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:55.146467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55d2056e-88a9-4c2c-ac94-f5aca1d766cd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:55.147140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55d2056e-88a9-4c2c-ac94-f5aca1d766cd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:55.147581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55d2056e-88a9-4c2c-ac94-f5aca1d766cd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:55.147996 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55d2056e-88a9-4c2c-ac94-f5aca1d766cd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:55.177206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-55d2056e-88a9-4c2c-ac94-f5aca1d766cd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044325 Sep 01 05:20:55.177743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 388/808] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:55.901237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d632b12a-4760-4ade-9009-74c6e01f0798 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:55.903422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d632b12a-4760-4ade-9009-74c6e01f0798 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:55.909779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d632b12a-4760-4ade-9009-74c6e01f0798 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:55.910261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d632b12a-4760-4ade-9009-74c6e01f0798 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:55.910689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d632b12a-4760-4ade-9009-74c6e01f0798 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:55.911361 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d632b12a-4760-4ade-9009-74c6e01f0798 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:55.911807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d632b12a-4760-4ade-9009-74c6e01f0798 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:55.912221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d632b12a-4760-4ade-9009-74c6e01f0798 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:55.942778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d632b12a-4760-4ade-9009-74c6e01f0798 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 Sep 01 05:20:55.943330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 421/809] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:55 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:56.133296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-81c8843b-ea94-41ec-a685-6cd817d69051 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:56.133797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-81c8843b-ea94-41ec-a685-6cd817d69051 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:56.140431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81c8843b-ea94-41ec-a685-6cd817d69051 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:56.141061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81c8843b-ea94-41ec-a685-6cd817d69051 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:56.141373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81c8843b-ea94-41ec-a685-6cd817d69051 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:56.142047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81c8843b-ea94-41ec-a685-6cd817d69051 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:56.142494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81c8843b-ea94-41ec-a685-6cd817d69051 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:56.142910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81c8843b-ea94-41ec-a685-6cd817d69051 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:56.168654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-81c8843b-ea94-41ec-a685-6cd817d69051 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:20:56.190363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-978d4ccb-bda4-419e-9471-88a35eabeefa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:56.192481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-978d4ccb-bda4-419e-9471-88a35eabeefa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:56.200038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-978d4ccb-bda4-419e-9471-88a35eabeefa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:56.200520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-978d4ccb-bda4-419e-9471-88a35eabeefa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:56.200988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-978d4ccb-bda4-419e-9471-88a35eabeefa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:56.201680 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-978d4ccb-bda4-419e-9471-88a35eabeefa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:56.202123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-978d4ccb-bda4-419e-9471-88a35eabeefa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:56.202541 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-978d4ccb-bda4-419e-9471-88a35eabeefa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:56.235898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-978d4ccb-bda4-419e-9471-88a35eabeefa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049437 Sep 01 05:20:56.237370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 422/810] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:20:56.247677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-81c8843b-ea94-41ec-a685-6cd817d69051 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 204 len: 0 microversion: 2.1 time: 0.117944 Sep 01 05:20:56.248312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 389/811] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:20:56 2022] DELETE /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:20:56.256658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c34bf3c5-8457-4353-8d0f-9d8628822c39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:56.257298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c34bf3c5-8457-4353-8d0f-9d8628822c39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:56.263832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c34bf3c5-8457-4353-8d0f-9d8628822c39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:56.264316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c34bf3c5-8457-4353-8d0f-9d8628822c39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:56.264750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c34bf3c5-8457-4353-8d0f-9d8628822c39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:56.265482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c34bf3c5-8457-4353-8d0f-9d8628822c39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:56.265932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c34bf3c5-8457-4353-8d0f-9d8628822c39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:56.266351 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c34bf3c5-8457-4353-8d0f-9d8628822c39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:56.399702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c34bf3c5-8457-4353-8d0f-9d8628822c39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:56.408150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c34bf3c5-8457-4353-8d0f-9d8628822c39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1577 microversion: 2.1 time: 0.155339 Sep 01 05:20:56.408724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 423/812] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:56 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:20:56.955541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-94884a41-3f3b-4764-961e-1978c08fc8fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:56.957877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-94884a41-3f3b-4764-961e-1978c08fc8fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:56.964245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-94884a41-3f3b-4764-961e-1978c08fc8fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:56.964707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-94884a41-3f3b-4764-961e-1978c08fc8fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:56.965157 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-94884a41-3f3b-4764-961e-1978c08fc8fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:56.965825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-94884a41-3f3b-4764-961e-1978c08fc8fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:56.966268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-94884a41-3f3b-4764-961e-1978c08fc8fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:56.966683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-94884a41-3f3b-4764-961e-1978c08fc8fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:56.995777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-94884a41-3f3b-4764-961e-1978c08fc8fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044558 Sep 01 05:20:56.996249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 390/813] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:57.249840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-42daab6d-970a-41bd-bba5-a378f3b90290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:57.252028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-42daab6d-970a-41bd-bba5-a378f3b90290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:57.258473 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42daab6d-970a-41bd-bba5-a378f3b90290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:57.258944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42daab6d-970a-41bd-bba5-a378f3b90290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:57.259516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42daab6d-970a-41bd-bba5-a378f3b90290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:57.260162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42daab6d-970a-41bd-bba5-a378f3b90290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:57.260607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42daab6d-970a-41bd-bba5-a378f3b90290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:57.261050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42daab6d-970a-41bd-bba5-a378f3b90290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:57.290160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-42daab6d-970a-41bd-bba5-a378f3b90290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044336 Sep 01 05:20:57.291350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 424/814] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:57.428835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-68171aca-14d6-41d0-b66f-1a5b9a20e256 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:57.429444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-68171aca-14d6-41d0-b66f-1a5b9a20e256 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:57.436916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68171aca-14d6-41d0-b66f-1a5b9a20e256 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:57.437390 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68171aca-14d6-41d0-b66f-1a5b9a20e256 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:57.437815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68171aca-14d6-41d0-b66f-1a5b9a20e256 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:57.438484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68171aca-14d6-41d0-b66f-1a5b9a20e256 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:57.438932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68171aca-14d6-41d0-b66f-1a5b9a20e256 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:57.439345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68171aca-14d6-41d0-b66f-1a5b9a20e256 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:57.455007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:57.577140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-68171aca-14d6-41d0-b66f-1a5b9a20e256 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:57.584848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-68171aca-14d6-41d0-b66f-1a5b9a20e256 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1577 microversion: 2.1 time: 0.159812 Sep 01 05:20:57.585411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 391/815] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:57 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:58.007537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-739f302e-9f5a-4dfe-9dd6-c1ede57d81a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:58.010207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-739f302e-9f5a-4dfe-9dd6-c1ede57d81a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:58.015610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-739f302e-9f5a-4dfe-9dd6-c1ede57d81a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:58.016088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-739f302e-9f5a-4dfe-9dd6-c1ede57d81a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:58.016519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-739f302e-9f5a-4dfe-9dd6-c1ede57d81a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:58.017229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-739f302e-9f5a-4dfe-9dd6-c1ede57d81a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:58.017755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-739f302e-9f5a-4dfe-9dd6-c1ede57d81a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:58.018204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-739f302e-9f5a-4dfe-9dd6-c1ede57d81a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:58.048678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-739f302e-9f5a-4dfe-9dd6-c1ede57d81a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Sep 01 05:20:58.049328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 425/816] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:58 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:58.303317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9e3d9eb8-466b-497f-bc90-73f563973950 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:58.305446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9e3d9eb8-466b-497f-bc90-73f563973950 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:58.312324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9e3d9eb8-466b-497f-bc90-73f563973950 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:58.312846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9e3d9eb8-466b-497f-bc90-73f563973950 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:58.313286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9e3d9eb8-466b-497f-bc90-73f563973950 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:58.313991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9e3d9eb8-466b-497f-bc90-73f563973950 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:58.314446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9e3d9eb8-466b-497f-bc90-73f563973950 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:58.314869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9e3d9eb8-466b-497f-bc90-73f563973950 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:58.347777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9e3d9eb8-466b-497f-bc90-73f563973950 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048549 Sep 01 05:20:58.348380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 392/817] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:58.607043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-71553292-fa7c-4462-ad1c-94a991a7b51a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:58.607648 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-71553292-fa7c-4462-ad1c-94a991a7b51a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:58.614047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71553292-fa7c-4462-ad1c-94a991a7b51a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:58.614523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71553292-fa7c-4462-ad1c-94a991a7b51a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:58.614950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71553292-fa7c-4462-ad1c-94a991a7b51a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:58.615635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71553292-fa7c-4462-ad1c-94a991a7b51a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:58.616078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71553292-fa7c-4462-ad1c-94a991a7b51a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:58.616558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71553292-fa7c-4462-ad1c-94a991a7b51a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:58.828466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-71553292-fa7c-4462-ad1c-94a991a7b51a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:58.839138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-71553292-fa7c-4462-ad1c-94a991a7b51a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1577 microversion: 2.1 time: 0.236259 Sep 01 05:20:58.852977 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 426/818] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:58 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1577 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:59.062255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cfc603cd-b271-4916-86b6-950fffb64af8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:59.064342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cfc603cd-b271-4916-86b6-950fffb64af8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:59.071428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfc603cd-b271-4916-86b6-950fffb64af8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:59.071998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfc603cd-b271-4916-86b6-950fffb64af8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:59.072645 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfc603cd-b271-4916-86b6-950fffb64af8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:59.073363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfc603cd-b271-4916-86b6-950fffb64af8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:59.073966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfc603cd-b271-4916-86b6-950fffb64af8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:59.081809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfc603cd-b271-4916-86b6-950fffb64af8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:59.116077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-9a4edc6a-ef6a-477d-9459-024d59b97e34 req-ee20e822-8fcc-458c-81e3-da429276ba1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d673fb27-cefb-470e-85e8-9189c59d1c5c", "name": "network-vif-deleted", "tag": "08c5bdfa-3bfb-49da-bc35-8290867af5b9"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:59.120167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cfc603cd-b271-4916-86b6-950fffb64af8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062168 Sep 01 05:20:59.125555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 393/819] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:20:59 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:59.125848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9a4edc6a-ef6a-477d-9459-024d59b97e34 req-ee20e822-8fcc-458c-81e3-da429276ba1b service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:59.126380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9a4edc6a-ef6a-477d-9459-024d59b97e34 req-ee20e822-8fcc-458c-81e3-da429276ba1b service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:59.126926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9a4edc6a-ef6a-477d-9459-024d59b97e34 req-ee20e822-8fcc-458c-81e3-da429276ba1b service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:59.142932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-9a4edc6a-ef6a-477d-9459-024d59b97e34 req-ee20e822-8fcc-458c-81e3-da429276ba1b service nova] Creating event network-vif-deleted:08c5bdfa-3bfb-49da-bc35-8290867af5b9 for instance d673fb27-cefb-470e-85e8-9189c59d1c5c on hv-cinder-85391 Sep 01 05:20:59.148483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-9a4edc6a-ef6a-477d-9459-024d59b97e34 req-ee20e822-8fcc-458c-81e3-da429276ba1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036004 Sep 01 05:20:59.152994 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 427/820] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:20:59.360019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2be1a044-35a1-4e7b-acd6-0cfe681b19b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:59.362604 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2be1a044-35a1-4e7b-acd6-0cfe681b19b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:59.371075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2be1a044-35a1-4e7b-acd6-0cfe681b19b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:59.371559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2be1a044-35a1-4e7b-acd6-0cfe681b19b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:59.371992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2be1a044-35a1-4e7b-acd6-0cfe681b19b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:59.372687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2be1a044-35a1-4e7b-acd6-0cfe681b19b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:59.373168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2be1a044-35a1-4e7b-acd6-0cfe681b19b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:59.373587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2be1a044-35a1-4e7b-acd6-0cfe681b19b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:59.404273 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2be1a044-35a1-4e7b-acd6-0cfe681b19b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048229 Sep 01 05:20:59.404860 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 394/821] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:20:59 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:59.861669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-19c787b3-a936-4ad4-a4ec-42d67d21d3b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:59.862297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-19c787b3-a936-4ad4-a4ec-42d67d21d3b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:59.869465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19c787b3-a936-4ad4-a4ec-42d67d21d3b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:59.869960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19c787b3-a936-4ad4-a4ec-42d67d21d3b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:59.870396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19c787b3-a936-4ad4-a4ec-42d67d21d3b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:59.871089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19c787b3-a936-4ad4-a4ec-42d67d21d3b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:59.871573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19c787b3-a936-4ad4-a4ec-42d67d21d3b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:59.872026 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19c787b3-a936-4ad4-a4ec-42d67d21d3b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:59.938588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-19c787b3-a936-4ad4-a4ec-42d67d21d3b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:59.946649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-19c787b3-a936-4ad4-a4ec-42d67d21d3b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.089513 Sep 01 05:20:59.947222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 428/822] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:59 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:00.133547 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-add1c403-34b1-4e8a-8ee4-000115dd7aa9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:00.138230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-add1c403-34b1-4e8a-8ee4-000115dd7aa9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:00.145300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-add1c403-34b1-4e8a-8ee4-000115dd7aa9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.145856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-add1c403-34b1-4e8a-8ee4-000115dd7aa9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.146357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-add1c403-34b1-4e8a-8ee4-000115dd7aa9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.147116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-add1c403-34b1-4e8a-8ee4-000115dd7aa9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.147630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-add1c403-34b1-4e8a-8ee4-000115dd7aa9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.148115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-add1c403-34b1-4e8a-8ee4-000115dd7aa9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.179907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-add1c403-34b1-4e8a-8ee4-000115dd7aa9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050825 Sep 01 05:21:00.180459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 395/823] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:00.416306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c1d18757-c5be-4fad-999c-96408e6b72b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:00.418397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c1d18757-c5be-4fad-999c-96408e6b72b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:00.424314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1d18757-c5be-4fad-999c-96408e6b72b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.424818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1d18757-c5be-4fad-999c-96408e6b72b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.425248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1d18757-c5be-4fad-999c-96408e6b72b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.425919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1d18757-c5be-4fad-999c-96408e6b72b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.426365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1d18757-c5be-4fad-999c-96408e6b72b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.426777 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1d18757-c5be-4fad-999c-96408e6b72b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.430376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:00.458665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c1d18757-c5be-4fad-999c-96408e6b72b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046947 Sep 01 05:21:00.459212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 429/824] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:00 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:00.969540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8d179441-0be3-40ca-826d-024ae8fc7b89 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:00.970064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8d179441-0be3-40ca-826d-024ae8fc7b89 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:00.975955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d179441-0be3-40ca-826d-024ae8fc7b89 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.976428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d179441-0be3-40ca-826d-024ae8fc7b89 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.976890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d179441-0be3-40ca-826d-024ae8fc7b89 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.977561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d179441-0be3-40ca-826d-024ae8fc7b89 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.978006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d179441-0be3-40ca-826d-024ae8fc7b89 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.978649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d179441-0be3-40ca-826d-024ae8fc7b89 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:01.037831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8d179441-0be3-40ca-826d-024ae8fc7b89 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:01.045667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8d179441-0be3-40ca-826d-024ae8fc7b89 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.080056 Sep 01 05:21:01.046221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 396/825] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:00 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:01.191610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b9b66b21-12e7-41fd-acb7-d5d0ee3a005f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:01.193822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b9b66b21-12e7-41fd-acb7-d5d0ee3a005f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:01.200413 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9b66b21-12e7-41fd-acb7-d5d0ee3a005f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:01.200944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9b66b21-12e7-41fd-acb7-d5d0ee3a005f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:01.201382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9b66b21-12e7-41fd-acb7-d5d0ee3a005f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:01.202068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9b66b21-12e7-41fd-acb7-d5d0ee3a005f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:01.202521 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9b66b21-12e7-41fd-acb7-d5d0ee3a005f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:01.202944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9b66b21-12e7-41fd-acb7-d5d0ee3a005f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:01.238590 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b9b66b21-12e7-41fd-acb7-d5d0ee3a005f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050876 Sep 01 05:21:01.239065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 430/826] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:01 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:21:01.471888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3a9945cd-8ac0-4402-852c-4a3c5de8f43c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:01.474043 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3a9945cd-8ac0-4402-852c-4a3c5de8f43c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:01.481028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a9945cd-8ac0-4402-852c-4a3c5de8f43c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:01.481505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a9945cd-8ac0-4402-852c-4a3c5de8f43c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:01.481937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a9945cd-8ac0-4402-852c-4a3c5de8f43c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:01.482613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a9945cd-8ac0-4402-852c-4a3c5de8f43c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:01.483059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a9945cd-8ac0-4402-852c-4a3c5de8f43c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:01.483475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a9945cd-8ac0-4402-852c-4a3c5de8f43c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:01.512509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3a9945cd-8ac0-4402-852c-4a3c5de8f43c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044602 Sep 01 05:21:01.513102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 397/827] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:02.065749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6b1b3a35-34ed-431f-9d6f-479d4ea0674d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:02.066393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6b1b3a35-34ed-431f-9d6f-479d4ea0674d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:02.072948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b1b3a35-34ed-431f-9d6f-479d4ea0674d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:02.073428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b1b3a35-34ed-431f-9d6f-479d4ea0674d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:02.073862 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b1b3a35-34ed-431f-9d6f-479d4ea0674d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:02.074545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b1b3a35-34ed-431f-9d6f-479d4ea0674d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:02.074996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b1b3a35-34ed-431f-9d6f-479d4ea0674d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:02.075417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b1b3a35-34ed-431f-9d6f-479d4ea0674d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:02.136409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6b1b3a35-34ed-431f-9d6f-479d4ea0674d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:02.144056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6b1b3a35-34ed-431f-9d6f-479d4ea0674d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082183 Sep 01 05:21:02.144608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 431/828] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:02 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:02.251024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f52bad0f-9cd9-4408-9453-ade172653e44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:02.253207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f52bad0f-9cd9-4408-9453-ade172653e44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:02.259015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f52bad0f-9cd9-4408-9453-ade172653e44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:02.260205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f52bad0f-9cd9-4408-9453-ade172653e44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:02.260645 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f52bad0f-9cd9-4408-9453-ade172653e44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:02.261347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f52bad0f-9cd9-4408-9453-ade172653e44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:02.261793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f52bad0f-9cd9-4408-9453-ade172653e44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:02.262208 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f52bad0f-9cd9-4408-9453-ade172653e44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:02.291682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f52bad0f-9cd9-4408-9453-ade172653e44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044545 Sep 01 05:21:02.292226 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 398/829] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:02 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:02.525157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-04274bb9-e7cc-4e91-9daa-2facf52aa52b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:02.527370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-04274bb9-e7cc-4e91-9daa-2facf52aa52b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:02.533735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-04274bb9-e7cc-4e91-9daa-2facf52aa52b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:02.534220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-04274bb9-e7cc-4e91-9daa-2facf52aa52b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:02.534651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-04274bb9-e7cc-4e91-9daa-2facf52aa52b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:02.535332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-04274bb9-e7cc-4e91-9daa-2facf52aa52b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:02.535792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-04274bb9-e7cc-4e91-9daa-2facf52aa52b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:02.536209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-04274bb9-e7cc-4e91-9daa-2facf52aa52b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:02.567222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-04274bb9-e7cc-4e91-9daa-2facf52aa52b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046260 Sep 01 05:21:02.567775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 432/830] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:03.165600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1fd15ea2-89e5-459d-bccf-f3bf0942197c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:03.166369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1fd15ea2-89e5-459d-bccf-f3bf0942197c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:03.172843 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fd15ea2-89e5-459d-bccf-f3bf0942197c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:03.173330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fd15ea2-89e5-459d-bccf-f3bf0942197c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:03.173763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fd15ea2-89e5-459d-bccf-f3bf0942197c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:03.174445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fd15ea2-89e5-459d-bccf-f3bf0942197c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:03.174898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fd15ea2-89e5-459d-bccf-f3bf0942197c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:03.175325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fd15ea2-89e5-459d-bccf-f3bf0942197c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:03.241214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1fd15ea2-89e5-459d-bccf-f3bf0942197c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:03.249727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1fd15ea2-89e5-459d-bccf-f3bf0942197c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088145 Sep 01 05:21:03.250299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 399/831] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:03 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:03.304007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7028c9da-495d-4ae3-999c-83af246ca6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:03.306197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7028c9da-495d-4ae3-999c-83af246ca6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:03.313095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7028c9da-495d-4ae3-999c-83af246ca6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:03.313581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7028c9da-495d-4ae3-999c-83af246ca6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:03.314020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7028c9da-495d-4ae3-999c-83af246ca6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:03.314708 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7028c9da-495d-4ae3-999c-83af246ca6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:03.315163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7028c9da-495d-4ae3-999c-83af246ca6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:03.315590 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7028c9da-495d-4ae3-999c-83af246ca6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:03.345096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7028c9da-495d-4ae3-999c-83af246ca6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 Sep 01 05:21:03.345765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 433/832] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:03 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:03.579595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a6c84d74-be85-4c90-bb7c-e4e70174094d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:03.581721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a6c84d74-be85-4c90-bb7c-e4e70174094d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:03.588137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6c84d74-be85-4c90-bb7c-e4e70174094d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:03.588615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6c84d74-be85-4c90-bb7c-e4e70174094d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:03.589073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6c84d74-be85-4c90-bb7c-e4e70174094d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:03.589753 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6c84d74-be85-4c90-bb7c-e4e70174094d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:03.590206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6c84d74-be85-4c90-bb7c-e4e70174094d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:03.590622 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6c84d74-be85-4c90-bb7c-e4e70174094d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:03.619918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a6c84d74-be85-4c90-bb7c-e4e70174094d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044302 Sep 01 05:21:03.620459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 400/833] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:04.270430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-27331b0f-4da2-4578-af22-a9dd83915c42 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:04.271075 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-27331b0f-4da2-4578-af22-a9dd83915c42 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:04.278082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-27331b0f-4da2-4578-af22-a9dd83915c42 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:04.278559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-27331b0f-4da2-4578-af22-a9dd83915c42 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:04.279131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-27331b0f-4da2-4578-af22-a9dd83915c42 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:04.279945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-27331b0f-4da2-4578-af22-a9dd83915c42 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:04.280392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-27331b0f-4da2-4578-af22-a9dd83915c42 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:04.281173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-27331b0f-4da2-4578-af22-a9dd83915c42 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:04.350694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-27331b0f-4da2-4578-af22-a9dd83915c42 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:04.357773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2de87e41-cf41-4895-919f-24363019c0c6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:04.359276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-27331b0f-4da2-4578-af22-a9dd83915c42 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.092647 Sep 01 05:21:04.359841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 434/834] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:04 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:04.359999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2de87e41-cf41-4895-919f-24363019c0c6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:04.366298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2de87e41-cf41-4895-919f-24363019c0c6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:04.366771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2de87e41-cf41-4895-919f-24363019c0c6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:04.367204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2de87e41-cf41-4895-919f-24363019c0c6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:04.367886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2de87e41-cf41-4895-919f-24363019c0c6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:04.368327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2de87e41-cf41-4895-919f-24363019c0c6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:04.368739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2de87e41-cf41-4895-919f-24363019c0c6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:04.396882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2de87e41-cf41-4895-919f-24363019c0c6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043505 Sep 01 05:21:04.397421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 401/835] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:21:04.631653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-35e19bc8-4163-433f-abfd-84371181fd10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:04.633799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-35e19bc8-4163-433f-abfd-84371181fd10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:04.639703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35e19bc8-4163-433f-abfd-84371181fd10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:04.640185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35e19bc8-4163-433f-abfd-84371181fd10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:04.640618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35e19bc8-4163-433f-abfd-84371181fd10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:04.641335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35e19bc8-4163-433f-abfd-84371181fd10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:04.641784 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35e19bc8-4163-433f-abfd-84371181fd10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:04.642201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35e19bc8-4163-433f-abfd-84371181fd10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:04.671749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-35e19bc8-4163-433f-abfd-84371181fd10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044108 Sep 01 05:21:04.672288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 435/836] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:05.379728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5a746ef9-9490-4e7e-9651-c8c18bcb8580 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:05.380331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5a746ef9-9490-4e7e-9651-c8c18bcb8580 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:05.386925 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a746ef9-9490-4e7e-9651-c8c18bcb8580 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:05.387406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a746ef9-9490-4e7e-9651-c8c18bcb8580 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:05.387842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a746ef9-9490-4e7e-9651-c8c18bcb8580 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:05.388529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a746ef9-9490-4e7e-9651-c8c18bcb8580 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:05.389010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a746ef9-9490-4e7e-9651-c8c18bcb8580 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:05.389437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a746ef9-9490-4e7e-9651-c8c18bcb8580 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:05.409669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-26a9603e-f46c-4262-8fb6-786a3b687a52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:05.411804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-26a9603e-f46c-4262-8fb6-786a3b687a52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:05.418948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26a9603e-f46c-4262-8fb6-786a3b687a52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:05.419438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26a9603e-f46c-4262-8fb6-786a3b687a52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:05.419883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26a9603e-f46c-4262-8fb6-786a3b687a52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:05.420575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26a9603e-f46c-4262-8fb6-786a3b687a52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:05.421058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26a9603e-f46c-4262-8fb6-786a3b687a52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:05.421485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26a9603e-f46c-4262-8fb6-786a3b687a52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:05.452056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5a746ef9-9490-4e7e-9651-c8c18bcb8580 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:05.452405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-26a9603e-f46c-4262-8fb6-786a3b687a52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046551 Sep 01 05:21:05.453010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 436/837] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:05 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:21:05.459749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5a746ef9-9490-4e7e-9651-c8c18bcb8580 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083836 Sep 01 05:21:05.460297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 402/838] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:05 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:05.683651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7fe2a3b5-2666-4cc2-9277-7d5e4834516a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:05.686059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7fe2a3b5-2666-4cc2-9277-7d5e4834516a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:05.691976 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fe2a3b5-2666-4cc2-9277-7d5e4834516a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:05.692455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fe2a3b5-2666-4cc2-9277-7d5e4834516a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:05.692920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fe2a3b5-2666-4cc2-9277-7d5e4834516a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:05.693606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fe2a3b5-2666-4cc2-9277-7d5e4834516a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:05.694061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fe2a3b5-2666-4cc2-9277-7d5e4834516a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:05.694487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fe2a3b5-2666-4cc2-9277-7d5e4834516a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:05.725964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7fe2a3b5-2666-4cc2-9277-7d5e4834516a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046448 Sep 01 05:21:05.726512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 437/839] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:06.464498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2d243b1d-04cd-4267-8b73-fafac958ecd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:06.466655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2d243b1d-04cd-4267-8b73-fafac958ecd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:06.473084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d243b1d-04cd-4267-8b73-fafac958ecd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:06.473561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d243b1d-04cd-4267-8b73-fafac958ecd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:06.473991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d243b1d-04cd-4267-8b73-fafac958ecd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:06.474663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d243b1d-04cd-4267-8b73-fafac958ecd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:06.475112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d243b1d-04cd-4267-8b73-fafac958ecd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:06.475524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d243b1d-04cd-4267-8b73-fafac958ecd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:06.481580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bec73ddd-b117-42b5-bb67-8c47df124225 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:06.482189 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bec73ddd-b117-42b5-bb67-8c47df124225 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:06.488548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bec73ddd-b117-42b5-bb67-8c47df124225 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:06.489196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bec73ddd-b117-42b5-bb67-8c47df124225 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:06.489639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bec73ddd-b117-42b5-bb67-8c47df124225 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:06.490328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bec73ddd-b117-42b5-bb67-8c47df124225 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:06.490783 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bec73ddd-b117-42b5-bb67-8c47df124225 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:06.491205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bec73ddd-b117-42b5-bb67-8c47df124225 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:06.506977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2d243b1d-04cd-4267-8b73-fafac958ecd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046266 Sep 01 05:21:06.507476 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 403/840] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:06 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:06.554675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bec73ddd-b117-42b5-bb67-8c47df124225 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:06.563179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bec73ddd-b117-42b5-bb67-8c47df124225 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085977 Sep 01 05:21:06.563743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 438/841] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:06 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:21:06.738332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-90f7335e-608b-4c03-ad55-794cf6effb51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:06.740359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-90f7335e-608b-4c03-ad55-794cf6effb51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:06.746371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90f7335e-608b-4c03-ad55-794cf6effb51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:06.746845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90f7335e-608b-4c03-ad55-794cf6effb51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:06.747271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90f7335e-608b-4c03-ad55-794cf6effb51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:06.748018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90f7335e-608b-4c03-ad55-794cf6effb51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:06.748457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90f7335e-608b-4c03-ad55-794cf6effb51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:06.748897 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90f7335e-608b-4c03-ad55-794cf6effb51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:06.777494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-90f7335e-608b-4c03-ad55-794cf6effb51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043217 Sep 01 05:21:06.778023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 404/842] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:07.519296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1d84f552-f7ec-43ac-a8a2-9a7a57834768 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:07.521465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1d84f552-f7ec-43ac-a8a2-9a7a57834768 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:07.527981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d84f552-f7ec-43ac-a8a2-9a7a57834768 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:07.528467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d84f552-f7ec-43ac-a8a2-9a7a57834768 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:07.528944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d84f552-f7ec-43ac-a8a2-9a7a57834768 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:07.529630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d84f552-f7ec-43ac-a8a2-9a7a57834768 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:07.530085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d84f552-f7ec-43ac-a8a2-9a7a57834768 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:07.530506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d84f552-f7ec-43ac-a8a2-9a7a57834768 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:07.561609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1d84f552-f7ec-43ac-a8a2-9a7a57834768 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046339 Sep 01 05:21:07.562168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 439/843] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:07 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:07.583186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-563c9d8e-fa5d-464f-9961-6700052b3512 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:07.583793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-563c9d8e-fa5d-464f-9961-6700052b3512 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:07.590150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-563c9d8e-fa5d-464f-9961-6700052b3512 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:07.590613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-563c9d8e-fa5d-464f-9961-6700052b3512 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:07.591047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-563c9d8e-fa5d-464f-9961-6700052b3512 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:07.591726 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-563c9d8e-fa5d-464f-9961-6700052b3512 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:07.592176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-563c9d8e-fa5d-464f-9961-6700052b3512 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:07.592597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-563c9d8e-fa5d-464f-9961-6700052b3512 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:07.652631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-563c9d8e-fa5d-464f-9961-6700052b3512 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:07.660235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-563c9d8e-fa5d-464f-9961-6700052b3512 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.080806 Sep 01 05:21:07.660809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 405/844] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:07 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:07.789876 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2b1da82d-63c9-4768-95f6-9b7a799c3ede tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:07.792410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2b1da82d-63c9-4768-95f6-9b7a799c3ede tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:07.798626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b1da82d-63c9-4768-95f6-9b7a799c3ede tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:07.799232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b1da82d-63c9-4768-95f6-9b7a799c3ede tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:07.799674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b1da82d-63c9-4768-95f6-9b7a799c3ede tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:07.800356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b1da82d-63c9-4768-95f6-9b7a799c3ede tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:07.800840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b1da82d-63c9-4768-95f6-9b7a799c3ede tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:07.801267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b1da82d-63c9-4768-95f6-9b7a799c3ede tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:07.830916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2b1da82d-63c9-4768-95f6-9b7a799c3ede tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045072 Sep 01 05:21:07.831465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 440/845] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:07 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:08.573848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-60326afd-0b57-4ec1-80c8-df2bcace96fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:08.576009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-60326afd-0b57-4ec1-80c8-df2bcace96fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:08.582129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60326afd-0b57-4ec1-80c8-df2bcace96fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:08.582607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60326afd-0b57-4ec1-80c8-df2bcace96fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:08.583042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60326afd-0b57-4ec1-80c8-df2bcace96fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:08.583718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60326afd-0b57-4ec1-80c8-df2bcace96fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:08.584252 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60326afd-0b57-4ec1-80c8-df2bcace96fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:08.584580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60326afd-0b57-4ec1-80c8-df2bcace96fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:08.613472 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-60326afd-0b57-4ec1-80c8-df2bcace96fc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Sep 01 05:21:08.614013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 406/846] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:08 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:08.681544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-32146816-85b7-4d32-aa76-cd07e028f18f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:08.682153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-32146816-85b7-4d32-aa76-cd07e028f18f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:08.689125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-32146816-85b7-4d32-aa76-cd07e028f18f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:08.689602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-32146816-85b7-4d32-aa76-cd07e028f18f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:08.690029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-32146816-85b7-4d32-aa76-cd07e028f18f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:08.690708 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-32146816-85b7-4d32-aa76-cd07e028f18f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:08.691153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-32146816-85b7-4d32-aa76-cd07e028f18f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:08.691597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-32146816-85b7-4d32-aa76-cd07e028f18f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:08.753116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-32146816-85b7-4d32-aa76-cd07e028f18f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:08.761284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-32146816-85b7-4d32-aa76-cd07e028f18f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083075 Sep 01 05:21:08.761991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 441/847] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:08 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:08.843996 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-90a1646a-038a-434c-977b-f83151630c68 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:08.846096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-90a1646a-038a-434c-977b-f83151630c68 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:08.852336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90a1646a-038a-434c-977b-f83151630c68 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:08.852846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90a1646a-038a-434c-977b-f83151630c68 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:08.853280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90a1646a-038a-434c-977b-f83151630c68 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:08.853962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90a1646a-038a-434c-977b-f83151630c68 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:08.855026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90a1646a-038a-434c-977b-f83151630c68 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:08.855459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90a1646a-038a-434c-977b-f83151630c68 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:08.883798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-90a1646a-038a-434c-977b-f83151630c68 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043819 Sep 01 05:21:08.884343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 407/848] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:09.626049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c4eabbf9-74f6-46be-8fe2-707b32e08ed0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:09.628202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c4eabbf9-74f6-46be-8fe2-707b32e08ed0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:09.634167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4eabbf9-74f6-46be-8fe2-707b32e08ed0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:09.634650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4eabbf9-74f6-46be-8fe2-707b32e08ed0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:09.635097 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4eabbf9-74f6-46be-8fe2-707b32e08ed0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:09.636416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4eabbf9-74f6-46be-8fe2-707b32e08ed0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:09.636833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4eabbf9-74f6-46be-8fe2-707b32e08ed0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:09.637261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4eabbf9-74f6-46be-8fe2-707b32e08ed0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:09.665730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c4eabbf9-74f6-46be-8fe2-707b32e08ed0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 Sep 01 05:21:09.666280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 442/849] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:09 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:21:09.782111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7010d394-7322-4aa9-b0ea-615edb735c96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:09.782643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7010d394-7322-4aa9-b0ea-615edb735c96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:09.788988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7010d394-7322-4aa9-b0ea-615edb735c96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:09.789466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7010d394-7322-4aa9-b0ea-615edb735c96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:09.789892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7010d394-7322-4aa9-b0ea-615edb735c96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:09.790563 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7010d394-7322-4aa9-b0ea-615edb735c96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:09.791008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7010d394-7322-4aa9-b0ea-615edb735c96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:09.791422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7010d394-7322-4aa9-b0ea-615edb735c96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:09.794067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:09.854039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7010d394-7322-4aa9-b0ea-615edb735c96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:09.862004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7010d394-7322-4aa9-b0ea-615edb735c96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083864 Sep 01 05:21:09.862576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 408/850] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:09 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:09.896227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b6eecb1a-ce4a-4bb2-bb90-3a1b83d1e5c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:09.897956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b6eecb1a-ce4a-4bb2-bb90-3a1b83d1e5c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:09.904356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6eecb1a-ce4a-4bb2-bb90-3a1b83d1e5c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:09.904866 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6eecb1a-ce4a-4bb2-bb90-3a1b83d1e5c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:09.905303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6eecb1a-ce4a-4bb2-bb90-3a1b83d1e5c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:09.905981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6eecb1a-ce4a-4bb2-bb90-3a1b83d1e5c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:09.906430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6eecb1a-ce4a-4bb2-bb90-3a1b83d1e5c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:09.906849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6eecb1a-ce4a-4bb2-bb90-3a1b83d1e5c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:09.937460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b6eecb1a-ce4a-4bb2-bb90-3a1b83d1e5c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045501 Sep 01 05:21:09.938021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 443/851] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:09 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:21:10.678519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d8b9bb7f-0c66-49d3-bf8e-e1106cfd14a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:10.681238 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d8b9bb7f-0c66-49d3-bf8e-e1106cfd14a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:10.688383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8b9bb7f-0c66-49d3-bf8e-e1106cfd14a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:10.688900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8b9bb7f-0c66-49d3-bf8e-e1106cfd14a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:10.689448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8b9bb7f-0c66-49d3-bf8e-e1106cfd14a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:10.690239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8b9bb7f-0c66-49d3-bf8e-e1106cfd14a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:10.690681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8b9bb7f-0c66-49d3-bf8e-e1106cfd14a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:10.691095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8b9bb7f-0c66-49d3-bf8e-e1106cfd14a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:10.722284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d8b9bb7f-0c66-49d3-bf8e-e1106cfd14a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048078 Sep 01 05:21:10.722830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 409/852] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:10.883049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b3061f90-bd15-4f1d-9580-8c86917444e7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:10.883688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b3061f90-bd15-4f1d-9580-8c86917444e7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:10.890561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b3061f90-bd15-4f1d-9580-8c86917444e7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:10.891040 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b3061f90-bd15-4f1d-9580-8c86917444e7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:10.891476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b3061f90-bd15-4f1d-9580-8c86917444e7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:10.892173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b3061f90-bd15-4f1d-9580-8c86917444e7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:10.892627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b3061f90-bd15-4f1d-9580-8c86917444e7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:10.893076 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b3061f90-bd15-4f1d-9580-8c86917444e7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:10.950908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-62472326-8640-425f-8d37-b097ff5dbe48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:10.952978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-62472326-8640-425f-8d37-b097ff5dbe48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:10.955873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b3061f90-bd15-4f1d-9580-8c86917444e7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:10.959528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62472326-8640-425f-8d37-b097ff5dbe48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:10.960005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62472326-8640-425f-8d37-b097ff5dbe48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:10.960463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62472326-8640-425f-8d37-b097ff5dbe48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:10.961178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62472326-8640-425f-8d37-b097ff5dbe48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:10.961624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62472326-8640-425f-8d37-b097ff5dbe48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:10.962039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62472326-8640-425f-8d37-b097ff5dbe48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:10.963625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b3061f90-bd15-4f1d-9580-8c86917444e7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084445 Sep 01 05:21:10.965366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 444/853] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:10 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:10.992166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-62472326-8640-425f-8d37-b097ff5dbe48 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046387 Sep 01 05:21:10.992703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 410/854] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:10 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:21:11.735219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9ca3920c-ee2f-477e-97b0-89a03ce4fb70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:11.737387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9ca3920c-ee2f-477e-97b0-89a03ce4fb70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:11.743361 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9ca3920c-ee2f-477e-97b0-89a03ce4fb70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:11.743837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9ca3920c-ee2f-477e-97b0-89a03ce4fb70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:11.744266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9ca3920c-ee2f-477e-97b0-89a03ce4fb70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:11.745070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9ca3920c-ee2f-477e-97b0-89a03ce4fb70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:11.746149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9ca3920c-ee2f-477e-97b0-89a03ce4fb70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:11.746727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9ca3920c-ee2f-477e-97b0-89a03ce4fb70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:11.771271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:11.776210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9ca3920c-ee2f-477e-97b0-89a03ce4fb70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045048 Sep 01 05:21:11.777430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 445/855] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:11 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:11.987192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c3501609-6e61-47b6-a880-e3238fe275dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:11.987802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c3501609-6e61-47b6-a880-e3238fe275dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:11.994205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c3501609-6e61-47b6-a880-e3238fe275dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:11.994683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c3501609-6e61-47b6-a880-e3238fe275dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:11.995113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c3501609-6e61-47b6-a880-e3238fe275dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:11.995988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c3501609-6e61-47b6-a880-e3238fe275dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:11.996237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c3501609-6e61-47b6-a880-e3238fe275dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:11.996655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c3501609-6e61-47b6-a880-e3238fe275dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:12.003491 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-72d83e34-2f2f-4e6d-ae4e-f77c56a272d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:12.005739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-72d83e34-2f2f-4e6d-ae4e-f77c56a272d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:12.012902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72d83e34-2f2f-4e6d-ae4e-f77c56a272d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:12.013380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72d83e34-2f2f-4e6d-ae4e-f77c56a272d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:12.013819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72d83e34-2f2f-4e6d-ae4e-f77c56a272d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:12.014498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72d83e34-2f2f-4e6d-ae4e-f77c56a272d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:12.014946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72d83e34-2f2f-4e6d-ae4e-f77c56a272d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:12.015395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72d83e34-2f2f-4e6d-ae4e-f77c56a272d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:12.046568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-72d83e34-2f2f-4e6d-ae4e-f77c56a272d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046846 Sep 01 05:21:12.047048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 446/856] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:21:12.063293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c3501609-6e61-47b6-a880-e3238fe275dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:12.071067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c3501609-6e61-47b6-a880-e3238fe275dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087682 Sep 01 05:21:12.071632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 411/857] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:11 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:12.789272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7d908628-d68a-4e84-8e4e-2f38061afbf2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:12.791606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7d908628-d68a-4e84-8e4e-2f38061afbf2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:12.797749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7d908628-d68a-4e84-8e4e-2f38061afbf2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:12.798224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7d908628-d68a-4e84-8e4e-2f38061afbf2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:12.798658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7d908628-d68a-4e84-8e4e-2f38061afbf2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:12.799330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7d908628-d68a-4e84-8e4e-2f38061afbf2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:12.799776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7d908628-d68a-4e84-8e4e-2f38061afbf2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:12.800191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7d908628-d68a-4e84-8e4e-2f38061afbf2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:12.831591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7d908628-d68a-4e84-8e4e-2f38061afbf2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046536 Sep 01 05:21:12.832134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 447/858] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:12 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:13.059567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-174b2bfc-9e65-4c12-a822-4d59ebb4d343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:13.061912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-174b2bfc-9e65-4c12-a822-4d59ebb4d343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:13.068322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-174b2bfc-9e65-4c12-a822-4d59ebb4d343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:13.068827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-174b2bfc-9e65-4c12-a822-4d59ebb4d343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:13.069265 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-174b2bfc-9e65-4c12-a822-4d59ebb4d343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:13.069947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-174b2bfc-9e65-4c12-a822-4d59ebb4d343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:13.070398 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-174b2bfc-9e65-4c12-a822-4d59ebb4d343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:13.070820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-174b2bfc-9e65-4c12-a822-4d59ebb4d343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:13.091516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dd1c960b-57f3-428a-8e99-4d1a8deab5a5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:13.092127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dd1c960b-57f3-428a-8e99-4d1a8deab5a5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:13.098280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd1c960b-57f3-428a-8e99-4d1a8deab5a5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:13.098755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd1c960b-57f3-428a-8e99-4d1a8deab5a5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:13.099183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd1c960b-57f3-428a-8e99-4d1a8deab5a5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:13.099862 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd1c960b-57f3-428a-8e99-4d1a8deab5a5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:13.099964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-174b2bfc-9e65-4c12-a822-4d59ebb4d343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045098 Sep 01 05:21:13.100306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd1c960b-57f3-428a-8e99-4d1a8deab5a5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:13.100750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 412/859] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:13 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:13.100906 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd1c960b-57f3-428a-8e99-4d1a8deab5a5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:13.164600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dd1c960b-57f3-428a-8e99-4d1a8deab5a5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:13.172870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dd1c960b-57f3-428a-8e99-4d1a8deab5a5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085356 Sep 01 05:21:13.173432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 448/860] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:13 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:21:13.843768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d9537b00-a808-4131-8d44-8a197ff8cf5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:13.845859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d9537b00-a808-4131-8d44-8a197ff8cf5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:13.851983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9537b00-a808-4131-8d44-8a197ff8cf5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:13.852484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9537b00-a808-4131-8d44-8a197ff8cf5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:13.852939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9537b00-a808-4131-8d44-8a197ff8cf5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:13.853618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9537b00-a808-4131-8d44-8a197ff8cf5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:13.854062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9537b00-a808-4131-8d44-8a197ff8cf5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:13.854478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9537b00-a808-4131-8d44-8a197ff8cf5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:13.884186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d9537b00-a808-4131-8d44-8a197ff8cf5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044502 Sep 01 05:21:13.884734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 413/861] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:14.112226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7c0078ce-4cfc-47b4-8e78-40852b206575 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:14.114333 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7c0078ce-4cfc-47b4-8e78-40852b206575 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:14.121392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7c0078ce-4cfc-47b4-8e78-40852b206575 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:14.121875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7c0078ce-4cfc-47b4-8e78-40852b206575 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:14.122303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7c0078ce-4cfc-47b4-8e78-40852b206575 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:14.123028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7c0078ce-4cfc-47b4-8e78-40852b206575 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:14.123456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7c0078ce-4cfc-47b4-8e78-40852b206575 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:14.123870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7c0078ce-4cfc-47b4-8e78-40852b206575 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:14.153308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7c0078ce-4cfc-47b4-8e78-40852b206575 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045127 Sep 01 05:21:14.153861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 449/862] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:14.194149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1d3c5e57-d30b-4bef-b313-e26991c10d73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:14.194747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1d3c5e57-d30b-4bef-b313-e26991c10d73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:14.201239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d3c5e57-d30b-4bef-b313-e26991c10d73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:14.201714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d3c5e57-d30b-4bef-b313-e26991c10d73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:14.202137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d3c5e57-d30b-4bef-b313-e26991c10d73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:14.202807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d3c5e57-d30b-4bef-b313-e26991c10d73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:14.203247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d3c5e57-d30b-4bef-b313-e26991c10d73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:14.203668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d3c5e57-d30b-4bef-b313-e26991c10d73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:14.265227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1d3c5e57-d30b-4bef-b313-e26991c10d73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:14.273048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1d3c5e57-d30b-4bef-b313-e26991c10d73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082533 Sep 01 05:21:14.273605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 414/863] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:14 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:14.896543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-032f3a01-61a6-4231-82cd-e9dc59302460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:14.898719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-032f3a01-61a6-4231-82cd-e9dc59302460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:14.904707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-032f3a01-61a6-4231-82cd-e9dc59302460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:14.905232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-032f3a01-61a6-4231-82cd-e9dc59302460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:14.905665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-032f3a01-61a6-4231-82cd-e9dc59302460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:14.906346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-032f3a01-61a6-4231-82cd-e9dc59302460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:14.906795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-032f3a01-61a6-4231-82cd-e9dc59302460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:14.907214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-032f3a01-61a6-4231-82cd-e9dc59302460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:14.937272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-032f3a01-61a6-4231-82cd-e9dc59302460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Sep 01 05:21:14.937831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 450/864] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:14 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:15.165138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f8fe9362-8818-4362-94d7-61d8b2360f8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:15.167221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f8fe9362-8818-4362-94d7-61d8b2360f8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:15.173954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8fe9362-8818-4362-94d7-61d8b2360f8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:15.174431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8fe9362-8818-4362-94d7-61d8b2360f8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:15.174864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8fe9362-8818-4362-94d7-61d8b2360f8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:15.175544 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8fe9362-8818-4362-94d7-61d8b2360f8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:15.175990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8fe9362-8818-4362-94d7-61d8b2360f8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:15.176414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8fe9362-8818-4362-94d7-61d8b2360f8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:15.206333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f8fe9362-8818-4362-94d7-61d8b2360f8a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045324 Sep 01 05:21:15.206964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 415/865] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:15.294413 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bc5a8333-cdef-4599-a027-7ec15cc95da2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:15.295030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bc5a8333-cdef-4599-a027-7ec15cc95da2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:15.301396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc5a8333-cdef-4599-a027-7ec15cc95da2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:15.301881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc5a8333-cdef-4599-a027-7ec15cc95da2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:15.302324 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc5a8333-cdef-4599-a027-7ec15cc95da2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:15.303012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc5a8333-cdef-4599-a027-7ec15cc95da2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:15.303465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc5a8333-cdef-4599-a027-7ec15cc95da2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:15.303892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc5a8333-cdef-4599-a027-7ec15cc95da2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:15.365142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bc5a8333-cdef-4599-a027-7ec15cc95da2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:15.372796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bc5a8333-cdef-4599-a027-7ec15cc95da2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082306 Sep 01 05:21:15.373362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 451/866] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:15 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:15.950048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f4a96fcb-1a9f-407b-93d2-6bd5c849aacc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:15.952163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f4a96fcb-1a9f-407b-93d2-6bd5c849aacc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:15.954120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:15.959323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4a96fcb-1a9f-407b-93d2-6bd5c849aacc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:15.959804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4a96fcb-1a9f-407b-93d2-6bd5c849aacc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:15.960238 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4a96fcb-1a9f-407b-93d2-6bd5c849aacc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:15.960958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4a96fcb-1a9f-407b-93d2-6bd5c849aacc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:15.961410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4a96fcb-1a9f-407b-93d2-6bd5c849aacc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:15.961831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4a96fcb-1a9f-407b-93d2-6bd5c849aacc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:15.991963 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f4a96fcb-1a9f-407b-93d2-6bd5c849aacc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046422 Sep 01 05:21:15.992508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 416/867] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:16.218794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-081532ca-7f32-4fef-844f-46af2f1492c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:16.220928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-081532ca-7f32-4fef-844f-46af2f1492c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:16.226856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-081532ca-7f32-4fef-844f-46af2f1492c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:16.227325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-081532ca-7f32-4fef-844f-46af2f1492c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:16.227751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-081532ca-7f32-4fef-844f-46af2f1492c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:16.228420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-081532ca-7f32-4fef-844f-46af2f1492c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:16.228915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-081532ca-7f32-4fef-844f-46af2f1492c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:16.229330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-081532ca-7f32-4fef-844f-46af2f1492c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:16.258700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-081532ca-7f32-4fef-844f-46af2f1492c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043991 Sep 01 05:21:16.259247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 452/868] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:16 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:16.393344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-06d269ea-bcd1-4d39-9478-faf453b9c6b3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:16.393946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-06d269ea-bcd1-4d39-9478-faf453b9c6b3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:16.400247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06d269ea-bcd1-4d39-9478-faf453b9c6b3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:16.400721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06d269ea-bcd1-4d39-9478-faf453b9c6b3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:16.401179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06d269ea-bcd1-4d39-9478-faf453b9c6b3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:16.402491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06d269ea-bcd1-4d39-9478-faf453b9c6b3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:16.402937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06d269ea-bcd1-4d39-9478-faf453b9c6b3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:16.403350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06d269ea-bcd1-4d39-9478-faf453b9c6b3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:16.466110 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-06d269ea-bcd1-4d39-9478-faf453b9c6b3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:16.473978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-06d269ea-bcd1-4d39-9478-faf453b9c6b3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084374 Sep 01 05:21:16.474480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 417/869] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:16 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:17.005622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-96ad94e5-ee8e-4fdf-ac9c-e4e3b8c6f6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:17.007776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-96ad94e5-ee8e-4fdf-ac9c-e4e3b8c6f6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:17.015082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96ad94e5-ee8e-4fdf-ac9c-e4e3b8c6f6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:17.015562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96ad94e5-ee8e-4fdf-ac9c-e4e3b8c6f6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:17.015998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96ad94e5-ee8e-4fdf-ac9c-e4e3b8c6f6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:17.016711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96ad94e5-ee8e-4fdf-ac9c-e4e3b8c6f6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:17.017311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96ad94e5-ee8e-4fdf-ac9c-e4e3b8c6f6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:17.017736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96ad94e5-ee8e-4fdf-ac9c-e4e3b8c6f6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:17.047282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-96ad94e5-ee8e-4fdf-ac9c-e4e3b8c6f6bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045681 Sep 01 05:21:17.047829 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 453/870] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:17 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:17.271312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-73d1fcd8-3109-4da5-8d50-2d8ab9d37488 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:17.273421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-73d1fcd8-3109-4da5-8d50-2d8ab9d37488 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:17.279419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73d1fcd8-3109-4da5-8d50-2d8ab9d37488 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:17.279889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73d1fcd8-3109-4da5-8d50-2d8ab9d37488 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:17.280317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73d1fcd8-3109-4da5-8d50-2d8ab9d37488 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:17.281018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73d1fcd8-3109-4da5-8d50-2d8ab9d37488 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:17.281462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73d1fcd8-3109-4da5-8d50-2d8ab9d37488 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:17.281877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73d1fcd8-3109-4da5-8d50-2d8ab9d37488 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:17.312411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-73d1fcd8-3109-4da5-8d50-2d8ab9d37488 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045172 Sep 01 05:21:17.312976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 418/871] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:17 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:17.495325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c3351fd8-e0ba-4731-b66b-f55067288597 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:17.496273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c3351fd8-e0ba-4731-b66b-f55067288597 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:17.502260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3351fd8-e0ba-4731-b66b-f55067288597 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:17.502742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3351fd8-e0ba-4731-b66b-f55067288597 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:17.503175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3351fd8-e0ba-4731-b66b-f55067288597 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:17.503853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3351fd8-e0ba-4731-b66b-f55067288597 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:17.504302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3351fd8-e0ba-4731-b66b-f55067288597 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:17.504723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3351fd8-e0ba-4731-b66b-f55067288597 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:17.566633 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c3351fd8-e0ba-4731-b66b-f55067288597 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:17.574907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c3351fd8-e0ba-4731-b66b-f55067288597 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083376 Sep 01 05:21:17.575465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 454/872] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:17 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:18.059916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7a1e623a-54bd-427f-97ee-7ffe78aa969b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:18.062287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7a1e623a-54bd-427f-97ee-7ffe78aa969b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:18.068545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7a1e623a-54bd-427f-97ee-7ffe78aa969b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.069057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7a1e623a-54bd-427f-97ee-7ffe78aa969b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.069487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7a1e623a-54bd-427f-97ee-7ffe78aa969b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.070159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7a1e623a-54bd-427f-97ee-7ffe78aa969b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.070603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7a1e623a-54bd-427f-97ee-7ffe78aa969b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.071017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7a1e623a-54bd-427f-97ee-7ffe78aa969b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.100615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7a1e623a-54bd-427f-97ee-7ffe78aa969b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045581 Sep 01 05:21:18.101192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 419/873] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:18 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:18.323984 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6eb318ee-8ac5-4166-aa8f-cdb74780f30b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:18.326227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6eb318ee-8ac5-4166-aa8f-cdb74780f30b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:18.332810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6eb318ee-8ac5-4166-aa8f-cdb74780f30b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.333280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6eb318ee-8ac5-4166-aa8f-cdb74780f30b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.333734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6eb318ee-8ac5-4166-aa8f-cdb74780f30b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.334408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6eb318ee-8ac5-4166-aa8f-cdb74780f30b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.334849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6eb318ee-8ac5-4166-aa8f-cdb74780f30b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.335262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6eb318ee-8ac5-4166-aa8f-cdb74780f30b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.364725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6eb318ee-8ac5-4166-aa8f-cdb74780f30b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044891 Sep 01 05:21:18.365302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 455/874] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:18 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:18.596087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bc7dc7c2-4c76-4a88-952f-5805f261c3d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:18.596614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bc7dc7c2-4c76-4a88-952f-5805f261c3d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:18.602580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc7dc7c2-4c76-4a88-952f-5805f261c3d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.603053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc7dc7c2-4c76-4a88-952f-5805f261c3d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.603477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc7dc7c2-4c76-4a88-952f-5805f261c3d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.604147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc7dc7c2-4c76-4a88-952f-5805f261c3d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.604588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc7dc7c2-4c76-4a88-952f-5805f261c3d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.605650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc7dc7c2-4c76-4a88-952f-5805f261c3d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.665017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bc7dc7c2-4c76-4a88-952f-5805f261c3d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:18.673479 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bc7dc7c2-4c76-4a88-952f-5805f261c3d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081256 Sep 01 05:21:18.674027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 420/875] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:18 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:19.113207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-318c2ecc-e903-4612-84dc-70f01f13fcbf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:19.115357 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-318c2ecc-e903-4612-84dc-70f01f13fcbf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:19.117207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=84 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:19.122730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-318c2ecc-e903-4612-84dc-70f01f13fcbf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.123231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-318c2ecc-e903-4612-84dc-70f01f13fcbf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.123670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-318c2ecc-e903-4612-84dc-70f01f13fcbf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.124349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-318c2ecc-e903-4612-84dc-70f01f13fcbf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.124816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-318c2ecc-e903-4612-84dc-70f01f13fcbf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.125235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-318c2ecc-e903-4612-84dc-70f01f13fcbf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.155415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-318c2ecc-e903-4612-84dc-70f01f13fcbf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046244 Sep 01 05:21:19.155956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 456/876] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:19 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:19.377520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-283b88dd-5593-44cc-8e66-37930262ccf2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:19.379671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-283b88dd-5593-44cc-8e66-37930262ccf2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:19.386210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-283b88dd-5593-44cc-8e66-37930262ccf2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.387402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-283b88dd-5593-44cc-8e66-37930262ccf2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.387931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-283b88dd-5593-44cc-8e66-37930262ccf2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.388669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-283b88dd-5593-44cc-8e66-37930262ccf2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.389201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-283b88dd-5593-44cc-8e66-37930262ccf2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.389711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-283b88dd-5593-44cc-8e66-37930262ccf2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.418626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-283b88dd-5593-44cc-8e66-37930262ccf2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044984 Sep 01 05:21:19.419097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 421/877] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:19 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:19.694039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f5264bab-74de-4824-b25f-27bbe4f9f7e3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:19.694588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f5264bab-74de-4824-b25f-27bbe4f9f7e3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:19.701622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f5264bab-74de-4824-b25f-27bbe4f9f7e3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.702102 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f5264bab-74de-4824-b25f-27bbe4f9f7e3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.702536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f5264bab-74de-4824-b25f-27bbe4f9f7e3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.703215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f5264bab-74de-4824-b25f-27bbe4f9f7e3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.703667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f5264bab-74de-4824-b25f-27bbe4f9f7e3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.704085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f5264bab-74de-4824-b25f-27bbe4f9f7e3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.766638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f5264bab-74de-4824-b25f-27bbe4f9f7e3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:19.774563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f5264bab-74de-4824-b25f-27bbe4f9f7e3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084425 Sep 01 05:21:19.775188 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 457/878] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:19 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:20.168155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-df38afb8-2a0c-4561-afe3-7b1e92e8785d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:20.170310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-df38afb8-2a0c-4561-afe3-7b1e92e8785d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:20.176204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df38afb8-2a0c-4561-afe3-7b1e92e8785d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.176686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df38afb8-2a0c-4561-afe3-7b1e92e8785d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.177149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df38afb8-2a0c-4561-afe3-7b1e92e8785d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.177833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df38afb8-2a0c-4561-afe3-7b1e92e8785d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.178281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df38afb8-2a0c-4561-afe3-7b1e92e8785d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.178699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df38afb8-2a0c-4561-afe3-7b1e92e8785d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.208470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-df38afb8-2a0c-4561-afe3-7b1e92e8785d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Sep 01 05:21:20.209059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 422/879] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:20 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:20.430665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-eb6f9a4f-73b3-49b0-b287-e62e51d96db1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:20.432813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-eb6f9a4f-73b3-49b0-b287-e62e51d96db1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:20.439621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eb6f9a4f-73b3-49b0-b287-e62e51d96db1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.440096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eb6f9a4f-73b3-49b0-b287-e62e51d96db1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.440519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eb6f9a4f-73b3-49b0-b287-e62e51d96db1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.441222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eb6f9a4f-73b3-49b0-b287-e62e51d96db1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.441665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eb6f9a4f-73b3-49b0-b287-e62e51d96db1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.442079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eb6f9a4f-73b3-49b0-b287-e62e51d96db1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.470600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-eb6f9a4f-73b3-49b0-b287-e62e51d96db1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044042 Sep 01 05:21:20.471136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 458/880] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:20.797629 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0514cdc6-6065-4794-aab3-68e66dc6f2c0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:20.798262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0514cdc6-6065-4794-aab3-68e66dc6f2c0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:20.804082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0514cdc6-6065-4794-aab3-68e66dc6f2c0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.804553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0514cdc6-6065-4794-aab3-68e66dc6f2c0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.805017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0514cdc6-6065-4794-aab3-68e66dc6f2c0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.805690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0514cdc6-6065-4794-aab3-68e66dc6f2c0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.806131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0514cdc6-6065-4794-aab3-68e66dc6f2c0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.806541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0514cdc6-6065-4794-aab3-68e66dc6f2c0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.869589 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0514cdc6-6065-4794-aab3-68e66dc6f2c0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:20.877927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0514cdc6-6065-4794-aab3-68e66dc6f2c0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085428 Sep 01 05:21:20.878498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 423/881] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:20 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:21.220520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6c9c534d-864b-411f-9ce0-ed4a9a7520ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:21.222718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6c9c534d-864b-411f-9ce0-ed4a9a7520ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:21.229343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c9c534d-864b-411f-9ce0-ed4a9a7520ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.229915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c9c534d-864b-411f-9ce0-ed4a9a7520ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.230300 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c9c534d-864b-411f-9ce0-ed4a9a7520ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.231050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c9c534d-864b-411f-9ce0-ed4a9a7520ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.231494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c9c534d-864b-411f-9ce0-ed4a9a7520ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.231909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c9c534d-864b-411f-9ce0-ed4a9a7520ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.260710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6c9c534d-864b-411f-9ce0-ed4a9a7520ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044179 Sep 01 05:21:21.261890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 459/882] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:21 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:21:21.483083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ce58d508-0e6f-4c0a-8f63-726db58d23dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:21.485147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ce58d508-0e6f-4c0a-8f63-726db58d23dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:21.491036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce58d508-0e6f-4c0a-8f63-726db58d23dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.491507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce58d508-0e6f-4c0a-8f63-726db58d23dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.491932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce58d508-0e6f-4c0a-8f63-726db58d23dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.492607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce58d508-0e6f-4c0a-8f63-726db58d23dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.493071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce58d508-0e6f-4c0a-8f63-726db58d23dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.493483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce58d508-0e6f-4c0a-8f63-726db58d23dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.518484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:21.524037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ce58d508-0e6f-4c0a-8f63-726db58d23dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045255 Sep 01 05:21:21.524588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 424/883] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:21 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:21.898835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-acb34e3f-9fad-45bf-811b-0f191330e5ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:21.899455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-acb34e3f-9fad-45bf-811b-0f191330e5ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:21.905534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-acb34e3f-9fad-45bf-811b-0f191330e5ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.906018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-acb34e3f-9fad-45bf-811b-0f191330e5ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.906449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-acb34e3f-9fad-45bf-811b-0f191330e5ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.907128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-acb34e3f-9fad-45bf-811b-0f191330e5ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.907578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-acb34e3f-9fad-45bf-811b-0f191330e5ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.907997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-acb34e3f-9fad-45bf-811b-0f191330e5ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.971955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-acb34e3f-9fad-45bf-811b-0f191330e5ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:21.979592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-acb34e3f-9fad-45bf-811b-0f191330e5ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084657 Sep 01 05:21:21.980730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 460/884] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:21 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:22.273674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f8764637-df61-4024-8d10-619673603d40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:22.275777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f8764637-df61-4024-8d10-619673603d40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:22.282693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8764637-df61-4024-8d10-619673603d40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:22.283168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8764637-df61-4024-8d10-619673603d40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:22.283605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8764637-df61-4024-8d10-619673603d40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:22.284365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8764637-df61-4024-8d10-619673603d40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:22.284844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8764637-df61-4024-8d10-619673603d40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:22.285258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8764637-df61-4024-8d10-619673603d40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:22.315597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f8764637-df61-4024-8d10-619673603d40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045869 Sep 01 05:21:22.316153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 425/885] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:22 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:22.536991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d3d4aaf2-3d9d-41e5-920b-e7bce2688766 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:22.539094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d3d4aaf2-3d9d-41e5-920b-e7bce2688766 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:22.546641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d3d4aaf2-3d9d-41e5-920b-e7bce2688766 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:22.547115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d3d4aaf2-3d9d-41e5-920b-e7bce2688766 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:22.547542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d3d4aaf2-3d9d-41e5-920b-e7bce2688766 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:22.548216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d3d4aaf2-3d9d-41e5-920b-e7bce2688766 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:22.548662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d3d4aaf2-3d9d-41e5-920b-e7bce2688766 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:22.549118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d3d4aaf2-3d9d-41e5-920b-e7bce2688766 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:22.578109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d3d4aaf2-3d9d-41e5-920b-e7bce2688766 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045179 Sep 01 05:21:22.578661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 461/886] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:23.001492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-40ebfbdb-b7d1-4077-872d-cc525df32ba5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:23.002098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-40ebfbdb-b7d1-4077-872d-cc525df32ba5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:23.007916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40ebfbdb-b7d1-4077-872d-cc525df32ba5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:23.008394 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40ebfbdb-b7d1-4077-872d-cc525df32ba5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:23.008838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40ebfbdb-b7d1-4077-872d-cc525df32ba5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:23.009508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40ebfbdb-b7d1-4077-872d-cc525df32ba5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:23.009951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40ebfbdb-b7d1-4077-872d-cc525df32ba5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:23.010366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40ebfbdb-b7d1-4077-872d-cc525df32ba5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:23.072727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40ebfbdb-b7d1-4077-872d-cc525df32ba5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:23.080998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-40ebfbdb-b7d1-4077-872d-cc525df32ba5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083560 Sep 01 05:21:23.081566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 426/887] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:22 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:23.328470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7aec05d1-0442-458e-8332-90d099e758ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:23.330519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7aec05d1-0442-458e-8332-90d099e758ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:23.336614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7aec05d1-0442-458e-8332-90d099e758ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:23.337129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7aec05d1-0442-458e-8332-90d099e758ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:23.337561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7aec05d1-0442-458e-8332-90d099e758ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:23.338293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7aec05d1-0442-458e-8332-90d099e758ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:23.338736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7aec05d1-0442-458e-8332-90d099e758ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:23.339150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7aec05d1-0442-458e-8332-90d099e758ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:23.353222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:23.369332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7aec05d1-0442-458e-8332-90d099e758ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Sep 01 05:21:23.369879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 462/888] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:23 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:23.589733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-eada325a-94fb-48d7-a39a-36936bdb3fe2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:23.592801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-eada325a-94fb-48d7-a39a-36936bdb3fe2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:23.599137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eada325a-94fb-48d7-a39a-36936bdb3fe2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:23.599611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eada325a-94fb-48d7-a39a-36936bdb3fe2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:23.600040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eada325a-94fb-48d7-a39a-36936bdb3fe2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:23.600715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eada325a-94fb-48d7-a39a-36936bdb3fe2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:23.601187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eada325a-94fb-48d7-a39a-36936bdb3fe2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:23.601604 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eada325a-94fb-48d7-a39a-36936bdb3fe2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:23.631619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-eada325a-94fb-48d7-a39a-36936bdb3fe2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045917 Sep 01 05:21:23.632155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 427/889] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:24.101765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d88d3ec6-2c5d-499a-ad62-5d8e15768dd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:24.102378 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d88d3ec6-2c5d-499a-ad62-5d8e15768dd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:24.109337 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d88d3ec6-2c5d-499a-ad62-5d8e15768dd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.109803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d88d3ec6-2c5d-499a-ad62-5d8e15768dd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.110229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d88d3ec6-2c5d-499a-ad62-5d8e15768dd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.110904 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d88d3ec6-2c5d-499a-ad62-5d8e15768dd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.111351 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d88d3ec6-2c5d-499a-ad62-5d8e15768dd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.111764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d88d3ec6-2c5d-499a-ad62-5d8e15768dd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.174897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d88d3ec6-2c5d-499a-ad62-5d8e15768dd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:24.182913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d88d3ec6-2c5d-499a-ad62-5d8e15768dd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085230 Sep 01 05:21:24.183496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 463/890] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:24 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:24.381763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ec829be7-c643-4a59-b8ca-b529a7346e4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:24.383892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ec829be7-c643-4a59-b8ca-b529a7346e4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:24.389988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec829be7-c643-4a59-b8ca-b529a7346e4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.390439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec829be7-c643-4a59-b8ca-b529a7346e4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.390862 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec829be7-c643-4a59-b8ca-b529a7346e4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.391534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec829be7-c643-4a59-b8ca-b529a7346e4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.391976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec829be7-c643-4a59-b8ca-b529a7346e4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.392394 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec829be7-c643-4a59-b8ca-b529a7346e4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.422960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ec829be7-c643-4a59-b8ca-b529a7346e4f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045201 Sep 01 05:21:24.423494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 428/891] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:24 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:24.644367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d9b4cfbb-0477-4293-9000-764076ebdc6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:24.646461 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d9b4cfbb-0477-4293-9000-764076ebdc6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:24.652350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9b4cfbb-0477-4293-9000-764076ebdc6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.652867 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9b4cfbb-0477-4293-9000-764076ebdc6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.654117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9b4cfbb-0477-4293-9000-764076ebdc6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.654950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9b4cfbb-0477-4293-9000-764076ebdc6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.655404 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9b4cfbb-0477-4293-9000-764076ebdc6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.655820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9b4cfbb-0477-4293-9000-764076ebdc6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.684196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d9b4cfbb-0477-4293-9000-764076ebdc6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043917 Sep 01 05:21:24.685089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 464/892] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:25.204631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a7ac73d4-f33c-4603-8e63-4d9f72282a97 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:25.205224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a7ac73d4-f33c-4603-8e63-4d9f72282a97 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:25.211818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7ac73d4-f33c-4603-8e63-4d9f72282a97 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:25.212304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7ac73d4-f33c-4603-8e63-4d9f72282a97 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:25.212741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7ac73d4-f33c-4603-8e63-4d9f72282a97 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:25.213493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7ac73d4-f33c-4603-8e63-4d9f72282a97 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:25.213946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7ac73d4-f33c-4603-8e63-4d9f72282a97 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:25.214373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7ac73d4-f33c-4603-8e63-4d9f72282a97 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:25.276872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a7ac73d4-f33c-4603-8e63-4d9f72282a97 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:25.285002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a7ac73d4-f33c-4603-8e63-4d9f72282a97 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084939 Sep 01 05:21:25.285579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 429/893] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:25 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:25.435942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6baa1a91-92d4-4b10-86aa-af1268213014 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:25.438103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6baa1a91-92d4-4b10-86aa-af1268213014 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:25.444467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6baa1a91-92d4-4b10-86aa-af1268213014 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:25.444990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6baa1a91-92d4-4b10-86aa-af1268213014 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:25.445430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6baa1a91-92d4-4b10-86aa-af1268213014 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:25.446114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6baa1a91-92d4-4b10-86aa-af1268213014 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:25.446568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6baa1a91-92d4-4b10-86aa-af1268213014 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:25.446992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6baa1a91-92d4-4b10-86aa-af1268213014 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:25.476181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6baa1a91-92d4-4b10-86aa-af1268213014 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045441 Sep 01 05:21:25.476660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 465/894] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:25 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:25.697507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3825736c-8ba6-4203-9531-587b8f31238c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:25.699631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3825736c-8ba6-4203-9531-587b8f31238c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:25.705544 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3825736c-8ba6-4203-9531-587b8f31238c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:25.706012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3825736c-8ba6-4203-9531-587b8f31238c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:25.706434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3825736c-8ba6-4203-9531-587b8f31238c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:25.707102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3825736c-8ba6-4203-9531-587b8f31238c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:25.707542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3825736c-8ba6-4203-9531-587b8f31238c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:25.707953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3825736c-8ba6-4203-9531-587b8f31238c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:25.737247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3825736c-8ba6-4203-9531-587b8f31238c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043575 Sep 01 05:21:25.737722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 430/895] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:26.306312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-71eacc96-34e3-4680-87d0-56f357ed4f88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:26.306930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-71eacc96-34e3-4680-87d0-56f357ed4f88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:26.313886 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71eacc96-34e3-4680-87d0-56f357ed4f88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.314370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71eacc96-34e3-4680-87d0-56f357ed4f88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.314806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71eacc96-34e3-4680-87d0-56f357ed4f88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.315488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71eacc96-34e3-4680-87d0-56f357ed4f88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.315942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71eacc96-34e3-4680-87d0-56f357ed4f88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.316366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71eacc96-34e3-4680-87d0-56f357ed4f88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.376658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-71eacc96-34e3-4680-87d0-56f357ed4f88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:26.384329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-71eacc96-34e3-4680-87d0-56f357ed4f88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081930 Sep 01 05:21:26.384903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 466/896] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:26 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:26.488647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b531017c-f2c6-49e1-a2ac-445acde94e69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:26.490786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b531017c-f2c6-49e1-a2ac-445acde94e69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:26.497733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b531017c-f2c6-49e1-a2ac-445acde94e69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.498221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b531017c-f2c6-49e1-a2ac-445acde94e69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.498649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b531017c-f2c6-49e1-a2ac-445acde94e69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.499320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b531017c-f2c6-49e1-a2ac-445acde94e69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.499763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b531017c-f2c6-49e1-a2ac-445acde94e69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.500177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b531017c-f2c6-49e1-a2ac-445acde94e69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.529583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b531017c-f2c6-49e1-a2ac-445acde94e69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Sep 01 05:21:26.530121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 431/897] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:26 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:26.749455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1406d158-28fb-4288-83e7-41e118599ace tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:26.751570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1406d158-28fb-4288-83e7-41e118599ace tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:26.758002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1406d158-28fb-4288-83e7-41e118599ace tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.758479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1406d158-28fb-4288-83e7-41e118599ace tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.758909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1406d158-28fb-4288-83e7-41e118599ace tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.759577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1406d158-28fb-4288-83e7-41e118599ace tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.760020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1406d158-28fb-4288-83e7-41e118599ace tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.760433 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1406d158-28fb-4288-83e7-41e118599ace tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.789759 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1406d158-28fb-4288-83e7-41e118599ace tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044283 Sep 01 05:21:26.790294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 467/898] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:27.408146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6b47c097-476e-44f9-9487-ddb0eddd170f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:27.408755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6b47c097-476e-44f9-9487-ddb0eddd170f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:27.414654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b47c097-476e-44f9-9487-ddb0eddd170f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:27.415129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b47c097-476e-44f9-9487-ddb0eddd170f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:27.415563 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b47c097-476e-44f9-9487-ddb0eddd170f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:27.416237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b47c097-476e-44f9-9487-ddb0eddd170f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:27.416686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b47c097-476e-44f9-9487-ddb0eddd170f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:27.417138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b47c097-476e-44f9-9487-ddb0eddd170f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:27.478291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6b47c097-476e-44f9-9487-ddb0eddd170f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:27.485951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6b47c097-476e-44f9-9487-ddb0eddd170f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081690 Sep 01 05:21:27.486515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 432/899] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:27 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:27.541512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-238fe1b6-01d1-46c2-a010-cdd2bee43f7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:27.543765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-238fe1b6-01d1-46c2-a010-cdd2bee43f7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:27.550323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-238fe1b6-01d1-46c2-a010-cdd2bee43f7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:27.550806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-238fe1b6-01d1-46c2-a010-cdd2bee43f7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:27.551244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-238fe1b6-01d1-46c2-a010-cdd2bee43f7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:27.551920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-238fe1b6-01d1-46c2-a010-cdd2bee43f7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:27.552371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-238fe1b6-01d1-46c2-a010-cdd2bee43f7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:27.552810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-238fe1b6-01d1-46c2-a010-cdd2bee43f7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:27.584000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-238fe1b6-01d1-46c2-a010-cdd2bee43f7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046387 Sep 01 05:21:27.584554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 468/900] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:27 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:27.802702 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-daf9313c-74d6-4c81-94c9-a4984e88fb39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:27.804891 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-daf9313c-74d6-4c81-94c9-a4984e88fb39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:27.812553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-daf9313c-74d6-4c81-94c9-a4984e88fb39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:27.813073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-daf9313c-74d6-4c81-94c9-a4984e88fb39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:27.813506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-daf9313c-74d6-4c81-94c9-a4984e88fb39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:27.814195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-daf9313c-74d6-4c81-94c9-a4984e88fb39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:27.814645 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-daf9313c-74d6-4c81-94c9-a4984e88fb39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:27.815065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-daf9313c-74d6-4c81-94c9-a4984e88fb39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:27.844721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-daf9313c-74d6-4c81-94c9-a4984e88fb39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045912 Sep 01 05:21:27.845312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 433/901] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:27 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:28.507275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8d29d161-c4a5-443e-9618-ac5665154fe3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:28.507878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8d29d161-c4a5-443e-9618-ac5665154fe3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:28.514931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d29d161-c4a5-443e-9618-ac5665154fe3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.515411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d29d161-c4a5-443e-9618-ac5665154fe3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.515845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d29d161-c4a5-443e-9618-ac5665154fe3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.516528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d29d161-c4a5-443e-9618-ac5665154fe3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.517013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d29d161-c4a5-443e-9618-ac5665154fe3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.517434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d29d161-c4a5-443e-9618-ac5665154fe3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.578229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8d29d161-c4a5-443e-9618-ac5665154fe3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:28.585987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8d29d161-c4a5-443e-9618-ac5665154fe3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082640 Sep 01 05:21:28.586556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 469/902] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:28 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:28.596914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3ff25b39-d525-4163-b690-8836bb04e2f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:28.599024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3ff25b39-d525-4163-b690-8836bb04e2f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:28.604935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ff25b39-d525-4163-b690-8836bb04e2f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.605410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ff25b39-d525-4163-b690-8836bb04e2f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.605839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ff25b39-d525-4163-b690-8836bb04e2f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.606560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ff25b39-d525-4163-b690-8836bb04e2f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.607006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ff25b39-d525-4163-b690-8836bb04e2f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.607421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ff25b39-d525-4163-b690-8836bb04e2f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.636167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3ff25b39-d525-4163-b690-8836bb04e2f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043161 Sep 01 05:21:28.636704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 434/903] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:28 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:28.857378 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0482751b-425a-47b4-9507-6c4a6ecc3e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:28.859433 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0482751b-425a-47b4-9507-6c4a6ecc3e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:28.865499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0482751b-425a-47b4-9507-6c4a6ecc3e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.865993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0482751b-425a-47b4-9507-6c4a6ecc3e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.866432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0482751b-425a-47b4-9507-6c4a6ecc3e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.867140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0482751b-425a-47b4-9507-6c4a6ecc3e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.867594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0482751b-425a-47b4-9507-6c4a6ecc3e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.868016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0482751b-425a-47b4-9507-6c4a6ecc3e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.898465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0482751b-425a-47b4-9507-6c4a6ecc3e43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045483 Sep 01 05:21:28.899027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 470/904] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:28 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:29.608147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-37afcc44-ff4d-4c76-bd21-4754f65a9c5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:29.608755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-37afcc44-ff4d-4c76-bd21-4754f65a9c5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:29.615445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37afcc44-ff4d-4c76-bd21-4754f65a9c5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:29.615917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37afcc44-ff4d-4c76-bd21-4754f65a9c5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:29.616340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37afcc44-ff4d-4c76-bd21-4754f65a9c5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:29.617039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37afcc44-ff4d-4c76-bd21-4754f65a9c5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:29.617482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37afcc44-ff4d-4c76-bd21-4754f65a9c5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:29.617895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37afcc44-ff4d-4c76-bd21-4754f65a9c5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:29.648921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f574dd68-4f71-4d64-91b1-b7e1011bfdd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:29.651068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f574dd68-4f71-4d64-91b1-b7e1011bfdd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:29.658312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f574dd68-4f71-4d64-91b1-b7e1011bfdd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:29.658798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f574dd68-4f71-4d64-91b1-b7e1011bfdd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:29.659238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f574dd68-4f71-4d64-91b1-b7e1011bfdd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:29.659936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f574dd68-4f71-4d64-91b1-b7e1011bfdd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:29.660393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f574dd68-4f71-4d64-91b1-b7e1011bfdd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:29.660840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f574dd68-4f71-4d64-91b1-b7e1011bfdd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:29.683310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-37afcc44-ff4d-4c76-bd21-4754f65a9c5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:29.691223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-37afcc44-ff4d-4c76-bd21-4754f65a9c5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087604 Sep 01 05:21:29.691444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f574dd68-4f71-4d64-91b1-b7e1011bfdd7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046433 Sep 01 05:21:29.691795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 435/905] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:29 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:29.692003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 471/906] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:29 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:21:29.910535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b0c00e0d-bf62-4d86-b2ea-08a63cbf82dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:29.912728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b0c00e0d-bf62-4d86-b2ea-08a63cbf82dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:29.919300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0c00e0d-bf62-4d86-b2ea-08a63cbf82dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:29.920041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0c00e0d-bf62-4d86-b2ea-08a63cbf82dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:29.920505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0c00e0d-bf62-4d86-b2ea-08a63cbf82dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:29.921260 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0c00e0d-bf62-4d86-b2ea-08a63cbf82dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:29.921711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0c00e0d-bf62-4d86-b2ea-08a63cbf82dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:29.922129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0c00e0d-bf62-4d86-b2ea-08a63cbf82dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:29.952874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b0c00e0d-bf62-4d86-b2ea-08a63cbf82dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046235 Sep 01 05:21:29.953432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 436/907] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:29 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:30.703947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9eeb89a0-7335-4bc4-82be-e02d40db5460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:30.706159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9eeb89a0-7335-4bc4-82be-e02d40db5460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:30.711178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1d2f48d6-9ccd-46a6-9553-78ea532ed284 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:30.711788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1d2f48d6-9ccd-46a6-9553-78ea532ed284 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:30.712595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9eeb89a0-7335-4bc4-82be-e02d40db5460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:30.713114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9eeb89a0-7335-4bc4-82be-e02d40db5460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:30.713555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9eeb89a0-7335-4bc4-82be-e02d40db5460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:30.714256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9eeb89a0-7335-4bc4-82be-e02d40db5460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:30.714695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9eeb89a0-7335-4bc4-82be-e02d40db5460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:30.715114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9eeb89a0-7335-4bc4-82be-e02d40db5460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:30.718038 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d2f48d6-9ccd-46a6-9553-78ea532ed284 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:30.718508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d2f48d6-9ccd-46a6-9553-78ea532ed284 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:30.718933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d2f48d6-9ccd-46a6-9553-78ea532ed284 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:30.719609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d2f48d6-9ccd-46a6-9553-78ea532ed284 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:30.720057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d2f48d6-9ccd-46a6-9553-78ea532ed284 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:30.720469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d2f48d6-9ccd-46a6-9553-78ea532ed284 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:30.745656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9eeb89a0-7335-4bc4-82be-e02d40db5460 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046035 Sep 01 05:21:30.746228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 472/908] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:30 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:30.783513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1d2f48d6-9ccd-46a6-9553-78ea532ed284 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:30.791175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1d2f48d6-9ccd-46a6-9553-78ea532ed284 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083749 Sep 01 05:21:30.791763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 437/909] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:30 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:21:30.964339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-648077cf-bdb2-465e-ac6d-a034e84d6270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:30.966497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-648077cf-bdb2-465e-ac6d-a034e84d6270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:30.973568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-648077cf-bdb2-465e-ac6d-a034e84d6270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:30.974046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-648077cf-bdb2-465e-ac6d-a034e84d6270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:30.974476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-648077cf-bdb2-465e-ac6d-a034e84d6270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:30.975162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-648077cf-bdb2-465e-ac6d-a034e84d6270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:30.975611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-648077cf-bdb2-465e-ac6d-a034e84d6270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:30.976030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-648077cf-bdb2-465e-ac6d-a034e84d6270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:31.006271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-648077cf-bdb2-465e-ac6d-a034e84d6270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045996 Sep 01 05:21:31.006810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 473/910] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:30 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:31.758465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-85dbb8d8-70e9-4759-98cf-a3fe75468e47 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:31.760594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-85dbb8d8-70e9-4759-98cf-a3fe75468e47 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:31.767253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85dbb8d8-70e9-4759-98cf-a3fe75468e47 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:31.767742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85dbb8d8-70e9-4759-98cf-a3fe75468e47 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:31.768182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85dbb8d8-70e9-4759-98cf-a3fe75468e47 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:31.768918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85dbb8d8-70e9-4759-98cf-a3fe75468e47 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:31.769373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85dbb8d8-70e9-4759-98cf-a3fe75468e47 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:31.769809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85dbb8d8-70e9-4759-98cf-a3fe75468e47 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:31.801230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-85dbb8d8-70e9-4759-98cf-a3fe75468e47 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046606 Sep 01 05:21:31.801798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 438/911] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:31 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:31.811698 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dbcfa827-e2ea-4647-bfb5-a96f31929579 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:31.812315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dbcfa827-e2ea-4647-bfb5-a96f31929579 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:31.818683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbcfa827-e2ea-4647-bfb5-a96f31929579 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:31.819164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbcfa827-e2ea-4647-bfb5-a96f31929579 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:31.819599 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbcfa827-e2ea-4647-bfb5-a96f31929579 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:31.820289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbcfa827-e2ea-4647-bfb5-a96f31929579 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:31.820742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbcfa827-e2ea-4647-bfb5-a96f31929579 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:31.821186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbcfa827-e2ea-4647-bfb5-a96f31929579 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:31.895934 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dbcfa827-e2ea-4647-bfb5-a96f31929579 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:31.903674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dbcfa827-e2ea-4647-bfb5-a96f31929579 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.096113 Sep 01 05:21:31.904820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 474/912] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:31 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:32.018693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fda13d58-0ee8-49eb-9e75-dcaf3720f0c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:32.020881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fda13d58-0ee8-49eb-9e75-dcaf3720f0c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:32.026899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fda13d58-0ee8-49eb-9e75-dcaf3720f0c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.027378 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fda13d58-0ee8-49eb-9e75-dcaf3720f0c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.027815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fda13d58-0ee8-49eb-9e75-dcaf3720f0c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:32.028497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fda13d58-0ee8-49eb-9e75-dcaf3720f0c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.028974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fda13d58-0ee8-49eb-9e75-dcaf3720f0c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.030033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fda13d58-0ee8-49eb-9e75-dcaf3720f0c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:32.058568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fda13d58-0ee8-49eb-9e75-dcaf3720f0c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043853 Sep 01 05:21:32.059115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 439/913] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:32.814355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-00a08524-cc31-4778-839d-a8e8278a4b02 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:32.816518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-00a08524-cc31-4778-839d-a8e8278a4b02 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:32.822969 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-00a08524-cc31-4778-839d-a8e8278a4b02 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.823452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-00a08524-cc31-4778-839d-a8e8278a4b02 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.823887 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-00a08524-cc31-4778-839d-a8e8278a4b02 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:32.824566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-00a08524-cc31-4778-839d-a8e8278a4b02 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.825048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-00a08524-cc31-4778-839d-a8e8278a4b02 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.825472 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-00a08524-cc31-4778-839d-a8e8278a4b02 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:32.854578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-00a08524-cc31-4778-839d-a8e8278a4b02 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045056 Sep 01 05:21:32.855149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 475/914] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:32 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:32.925776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-58e411e0-e76f-4780-ae6a-d6a7da2bbab1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:32.926387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-58e411e0-e76f-4780-ae6a-d6a7da2bbab1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:32.932701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58e411e0-e76f-4780-ae6a-d6a7da2bbab1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.933206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58e411e0-e76f-4780-ae6a-d6a7da2bbab1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.933635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58e411e0-e76f-4780-ae6a-d6a7da2bbab1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:32.934304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58e411e0-e76f-4780-ae6a-d6a7da2bbab1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.934745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58e411e0-e76f-4780-ae6a-d6a7da2bbab1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.935159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58e411e0-e76f-4780-ae6a-d6a7da2bbab1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:33.000107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-58e411e0-e76f-4780-ae6a-d6a7da2bbab1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:33.007616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-58e411e0-e76f-4780-ae6a-d6a7da2bbab1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085642 Sep 01 05:21:33.008170 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 440/915] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:32 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:33.070384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-eeb24dd7-f140-4302-8209-a4d07cf7336d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:33.072492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-eeb24dd7-f140-4302-8209-a4d07cf7336d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:33.078457 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eeb24dd7-f140-4302-8209-a4d07cf7336d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:33.078939 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eeb24dd7-f140-4302-8209-a4d07cf7336d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:33.079373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eeb24dd7-f140-4302-8209-a4d07cf7336d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:33.080049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eeb24dd7-f140-4302-8209-a4d07cf7336d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:33.080500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eeb24dd7-f140-4302-8209-a4d07cf7336d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:33.080957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eeb24dd7-f140-4302-8209-a4d07cf7336d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:33.110152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-eeb24dd7-f140-4302-8209-a4d07cf7336d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043812 Sep 01 05:21:33.110699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 476/916] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:33.867730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-26a1d4f7-adab-4f26-9851-2142c6db8c5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:33.869823 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-26a1d4f7-adab-4f26-9851-2142c6db8c5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:33.876625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26a1d4f7-adab-4f26-9851-2142c6db8c5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:33.877135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26a1d4f7-adab-4f26-9851-2142c6db8c5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:33.877570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26a1d4f7-adab-4f26-9851-2142c6db8c5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:33.878583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26a1d4f7-adab-4f26-9851-2142c6db8c5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:33.879034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26a1d4f7-adab-4f26-9851-2142c6db8c5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:33.879454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26a1d4f7-adab-4f26-9851-2142c6db8c5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:33.892796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:33.909807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-26a1d4f7-adab-4f26-9851-2142c6db8c5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046151 Sep 01 05:21:33.910364 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 441/917] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:34.028455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-baca21fc-8c68-4589-bc27-2caa849922e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:34.029592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-baca21fc-8c68-4589-bc27-2caa849922e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:34.036140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-baca21fc-8c68-4589-bc27-2caa849922e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:34.036620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-baca21fc-8c68-4589-bc27-2caa849922e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:34.037094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-baca21fc-8c68-4589-bc27-2caa849922e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:34.037776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-baca21fc-8c68-4589-bc27-2caa849922e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:34.038228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-baca21fc-8c68-4589-bc27-2caa849922e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:34.038650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-baca21fc-8c68-4589-bc27-2caa849922e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:34.101768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-baca21fc-8c68-4589-bc27-2caa849922e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:34.110218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-baca21fc-8c68-4589-bc27-2caa849922e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085658 Sep 01 05:21:34.110772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 477/918] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:34 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:21:34.121586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c15c7b8f-8fd0-4002-b475-bab031840543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:34.123826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c15c7b8f-8fd0-4002-b475-bab031840543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:34.130227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c15c7b8f-8fd0-4002-b475-bab031840543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:34.130707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c15c7b8f-8fd0-4002-b475-bab031840543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:34.131141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c15c7b8f-8fd0-4002-b475-bab031840543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:34.131826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c15c7b8f-8fd0-4002-b475-bab031840543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:34.132275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c15c7b8f-8fd0-4002-b475-bab031840543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:34.132694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c15c7b8f-8fd0-4002-b475-bab031840543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:34.163081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c15c7b8f-8fd0-4002-b475-bab031840543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045468 Sep 01 05:21:34.163637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 442/919] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:34.923602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f53b55f1-2b39-4476-afd2-987daf9dc40a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:34.925751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f53b55f1-2b39-4476-afd2-987daf9dc40a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:34.931643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f53b55f1-2b39-4476-afd2-987daf9dc40a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:34.932183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f53b55f1-2b39-4476-afd2-987daf9dc40a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:34.932608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f53b55f1-2b39-4476-afd2-987daf9dc40a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:34.933317 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f53b55f1-2b39-4476-afd2-987daf9dc40a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:34.933758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f53b55f1-2b39-4476-afd2-987daf9dc40a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:34.934171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f53b55f1-2b39-4476-afd2-987daf9dc40a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:34.963851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f53b55f1-2b39-4476-afd2-987daf9dc40a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045286 Sep 01 05:21:34.964392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 478/920] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:35.130801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1068614c-17b8-486d-9aa9-b8ca268083b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:35.131413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1068614c-17b8-486d-9aa9-b8ca268083b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:35.137916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1068614c-17b8-486d-9aa9-b8ca268083b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:35.138396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1068614c-17b8-486d-9aa9-b8ca268083b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:35.138829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1068614c-17b8-486d-9aa9-b8ca268083b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:35.139518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1068614c-17b8-486d-9aa9-b8ca268083b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:35.139970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1068614c-17b8-486d-9aa9-b8ca268083b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:35.140384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1068614c-17b8-486d-9aa9-b8ca268083b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:35.176080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9a8aabf9-5b18-467a-8019-e1362dc40e5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:35.178164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9a8aabf9-5b18-467a-8019-e1362dc40e5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:35.184791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a8aabf9-5b18-467a-8019-e1362dc40e5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:35.185288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a8aabf9-5b18-467a-8019-e1362dc40e5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:35.186744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a8aabf9-5b18-467a-8019-e1362dc40e5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:35.187451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a8aabf9-5b18-467a-8019-e1362dc40e5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:35.187909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a8aabf9-5b18-467a-8019-e1362dc40e5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:35.188336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a8aabf9-5b18-467a-8019-e1362dc40e5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:35.190854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:35.202930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1068614c-17b8-486d-9aa9-b8ca268083b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:35.210603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1068614c-17b8-486d-9aa9-b8ca268083b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083755 Sep 01 05:21:35.211170 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 443/921] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:35 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:35.219277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9a8aabf9-5b18-467a-8019-e1362dc40e5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047226 Sep 01 05:21:35.219834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 479/922] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:21:35.977375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4929e3b4-bc2b-409c-9e86-3be92b45656a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:35.979532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4929e3b4-bc2b-409c-9e86-3be92b45656a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:35.986576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4929e3b4-bc2b-409c-9e86-3be92b45656a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:35.987068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4929e3b4-bc2b-409c-9e86-3be92b45656a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:35.987501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4929e3b4-bc2b-409c-9e86-3be92b45656a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:35.988184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4929e3b4-bc2b-409c-9e86-3be92b45656a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:35.988695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4929e3b4-bc2b-409c-9e86-3be92b45656a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:35.995244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4929e3b4-bc2b-409c-9e86-3be92b45656a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:36.025792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4929e3b4-bc2b-409c-9e86-3be92b45656a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052374 Sep 01 05:21:36.026346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 444/923] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:35 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:36.231603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-60a8e4e4-eb4e-462f-8b6c-c701fe667b73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:36.232155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e1744b4f-26c3-408c-9d87-0507ee2d76b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:36.232548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-60a8e4e4-eb4e-462f-8b6c-c701fe667b73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:36.233867 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e1744b4f-26c3-408c-9d87-0507ee2d76b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:36.238827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60a8e4e4-eb4e-462f-8b6c-c701fe667b73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:36.239309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60a8e4e4-eb4e-462f-8b6c-c701fe667b73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:36.239742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60a8e4e4-eb4e-462f-8b6c-c701fe667b73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:36.240029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e1744b4f-26c3-408c-9d87-0507ee2d76b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:36.240453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60a8e4e4-eb4e-462f-8b6c-c701fe667b73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:36.240562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e1744b4f-26c3-408c-9d87-0507ee2d76b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:36.240927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60a8e4e4-eb4e-462f-8b6c-c701fe667b73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:36.241056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e1744b4f-26c3-408c-9d87-0507ee2d76b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:36.241345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60a8e4e4-eb4e-462f-8b6c-c701fe667b73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:36.241623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e1744b4f-26c3-408c-9d87-0507ee2d76b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:36.242065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e1744b4f-26c3-408c-9d87-0507ee2d76b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:36.242481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e1744b4f-26c3-408c-9d87-0507ee2d76b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:36.272831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e1744b4f-26c3-408c-9d87-0507ee2d76b3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045284 Sep 01 05:21:36.273396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 445/924] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:36.303958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-60a8e4e4-eb4e-462f-8b6c-c701fe667b73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:36.312439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-60a8e4e4-eb4e-462f-8b6c-c701fe667b73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085007 Sep 01 05:21:36.313038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 480/925] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:36 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:37.037980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9f973e13-3e22-49ef-aeb1-f3702d535bc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:37.040090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9f973e13-3e22-49ef-aeb1-f3702d535bc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:37.047578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f973e13-3e22-49ef-aeb1-f3702d535bc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.048050 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f973e13-3e22-49ef-aeb1-f3702d535bc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.048477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f973e13-3e22-49ef-aeb1-f3702d535bc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.049244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f973e13-3e22-49ef-aeb1-f3702d535bc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.049688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f973e13-3e22-49ef-aeb1-f3702d535bc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.050102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f973e13-3e22-49ef-aeb1-f3702d535bc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.078795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9f973e13-3e22-49ef-aeb1-f3702d535bc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044769 Sep 01 05:21:37.079341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 446/926] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:37 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:37.285958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b2a209de-72a8-450e-9f40-22f2c2914e98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:37.288258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b2a209de-72a8-450e-9f40-22f2c2914e98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:37.294736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2a209de-72a8-450e-9f40-22f2c2914e98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.295273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2a209de-72a8-450e-9f40-22f2c2914e98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.295724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2a209de-72a8-450e-9f40-22f2c2914e98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.296399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2a209de-72a8-450e-9f40-22f2c2914e98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.296864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2a209de-72a8-450e-9f40-22f2c2914e98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.297281 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2a209de-72a8-450e-9f40-22f2c2914e98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.326680 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b2a209de-72a8-450e-9f40-22f2c2914e98 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044796 Sep 01 05:21:37.327399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 481/927] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:37 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:37.333020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-43693539-078f-4ae4-8054-4469f5d08f13 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:37.333627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-43693539-078f-4ae4-8054-4469f5d08f13 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:37.339974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-43693539-078f-4ae4-8054-4469f5d08f13 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.340442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-43693539-078f-4ae4-8054-4469f5d08f13 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.340901 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-43693539-078f-4ae4-8054-4469f5d08f13 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.341571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-43693539-078f-4ae4-8054-4469f5d08f13 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.342701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-43693539-078f-4ae4-8054-4469f5d08f13 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.343143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-43693539-078f-4ae4-8054-4469f5d08f13 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.406491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-43693539-078f-4ae4-8054-4469f5d08f13 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:37.414147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-43693539-078f-4ae4-8054-4469f5d08f13 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084832 Sep 01 05:21:37.414704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 447/928] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:37 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:38.090735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-550d2a40-d2b1-44a0-ab53-a9c9a0f37cb0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:38.093614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-550d2a40-d2b1-44a0-ab53-a9c9a0f37cb0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:38.099570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-550d2a40-d2b1-44a0-ab53-a9c9a0f37cb0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:38.100050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-550d2a40-d2b1-44a0-ab53-a9c9a0f37cb0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:38.100486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-550d2a40-d2b1-44a0-ab53-a9c9a0f37cb0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:38.101199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-550d2a40-d2b1-44a0-ab53-a9c9a0f37cb0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:38.101653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-550d2a40-d2b1-44a0-ab53-a9c9a0f37cb0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:38.102076 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-550d2a40-d2b1-44a0-ab53-a9c9a0f37cb0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:38.131001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-550d2a40-d2b1-44a0-ab53-a9c9a0f37cb0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Sep 01 05:21:38.131555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 482/929] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:38 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:38.339166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2aec7e28-cc6d-4fcf-9ac1-e425b6a41431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:38.341352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2aec7e28-cc6d-4fcf-9ac1-e425b6a41431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:38.348199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2aec7e28-cc6d-4fcf-9ac1-e425b6a41431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:38.348675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2aec7e28-cc6d-4fcf-9ac1-e425b6a41431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:38.349150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2aec7e28-cc6d-4fcf-9ac1-e425b6a41431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:38.349833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2aec7e28-cc6d-4fcf-9ac1-e425b6a41431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:38.350278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2aec7e28-cc6d-4fcf-9ac1-e425b6a41431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:38.350694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2aec7e28-cc6d-4fcf-9ac1-e425b6a41431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:38.379756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2aec7e28-cc6d-4fcf-9ac1-e425b6a41431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044772 Sep 01 05:21:38.380296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 448/930] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:38 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:38.434592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-94b65bdb-05b9-4fca-bd8c-1c009f35ddda tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:38.435138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-94b65bdb-05b9-4fca-bd8c-1c009f35ddda tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:38.442597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94b65bdb-05b9-4fca-bd8c-1c009f35ddda tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:38.443159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94b65bdb-05b9-4fca-bd8c-1c009f35ddda tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:38.443590 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94b65bdb-05b9-4fca-bd8c-1c009f35ddda tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:38.444273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94b65bdb-05b9-4fca-bd8c-1c009f35ddda tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:38.444719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94b65bdb-05b9-4fca-bd8c-1c009f35ddda tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:38.445160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94b65bdb-05b9-4fca-bd8c-1c009f35ddda tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:38.506146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-94b65bdb-05b9-4fca-bd8c-1c009f35ddda tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:38.514914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-94b65bdb-05b9-4fca-bd8c-1c009f35ddda tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083038 Sep 01 05:21:38.515474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 483/931] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:38 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:39.144044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-faf74090-09c7-4bc6-9e99-73da2298641f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:39.146252 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-faf74090-09c7-4bc6-9e99-73da2298641f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:39.152087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-faf74090-09c7-4bc6-9e99-73da2298641f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:39.152574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-faf74090-09c7-4bc6-9e99-73da2298641f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:39.153039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-faf74090-09c7-4bc6-9e99-73da2298641f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:39.153724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-faf74090-09c7-4bc6-9e99-73da2298641f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:39.154278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-faf74090-09c7-4bc6-9e99-73da2298641f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:39.155234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-faf74090-09c7-4bc6-9e99-73da2298641f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:39.184855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-faf74090-09c7-4bc6-9e99-73da2298641f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044746 Sep 01 05:21:39.185405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 449/932] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:39.392103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-401e3559-e026-40c6-8147-8fb0afede121 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:39.394302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-401e3559-e026-40c6-8147-8fb0afede121 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:39.400181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-401e3559-e026-40c6-8147-8fb0afede121 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:39.400595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-401e3559-e026-40c6-8147-8fb0afede121 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:39.401066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-401e3559-e026-40c6-8147-8fb0afede121 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:39.401731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-401e3559-e026-40c6-8147-8fb0afede121 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:39.402181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-401e3559-e026-40c6-8147-8fb0afede121 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:39.402619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-401e3559-e026-40c6-8147-8fb0afede121 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:39.431302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-401e3559-e026-40c6-8147-8fb0afede121 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043836 Sep 01 05:21:39.431843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 484/933] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:39 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:39.535232 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d31cd880-a7f1-44e8-b030-6db14a4bf42d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:39.535869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d31cd880-a7f1-44e8-b030-6db14a4bf42d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:39.542460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d31cd880-a7f1-44e8-b030-6db14a4bf42d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:39.542941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d31cd880-a7f1-44e8-b030-6db14a4bf42d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:39.543374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d31cd880-a7f1-44e8-b030-6db14a4bf42d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:39.544054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d31cd880-a7f1-44e8-b030-6db14a4bf42d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:39.544502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d31cd880-a7f1-44e8-b030-6db14a4bf42d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:39.545561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d31cd880-a7f1-44e8-b030-6db14a4bf42d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:39.605066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d31cd880-a7f1-44e8-b030-6db14a4bf42d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:39.613073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d31cd880-a7f1-44e8-b030-6db14a4bf42d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081622 Sep 01 05:21:39.613628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 450/934] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:39 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:40.198343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fdeb72aa-daa7-4bf3-bee4-d9011924d269 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:40.200441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fdeb72aa-daa7-4bf3-bee4-d9011924d269 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:40.206907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fdeb72aa-daa7-4bf3-bee4-d9011924d269 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:40.207393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fdeb72aa-daa7-4bf3-bee4-d9011924d269 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:40.207850 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fdeb72aa-daa7-4bf3-bee4-d9011924d269 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:40.208540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fdeb72aa-daa7-4bf3-bee4-d9011924d269 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:40.209036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fdeb72aa-daa7-4bf3-bee4-d9011924d269 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:40.209464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fdeb72aa-daa7-4bf3-bee4-d9011924d269 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:40.242177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fdeb72aa-daa7-4bf3-bee4-d9011924d269 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047835 Sep 01 05:21:40.242733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 485/935] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:40 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:40.444363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d9418643-8186-49fb-8b30-2e8064f9d020 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:40.446498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d9418643-8186-49fb-8b30-2e8064f9d020 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:40.452582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9418643-8186-49fb-8b30-2e8064f9d020 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:40.453019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9418643-8186-49fb-8b30-2e8064f9d020 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:40.453484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9418643-8186-49fb-8b30-2e8064f9d020 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:40.454188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9418643-8186-49fb-8b30-2e8064f9d020 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:40.454635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9418643-8186-49fb-8b30-2e8064f9d020 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:40.455053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9418643-8186-49fb-8b30-2e8064f9d020 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:40.484261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d9418643-8186-49fb-8b30-2e8064f9d020 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042987 Sep 01 05:21:40.485528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 451/936] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:40.633521 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c180b563-b254-4249-8c36-8a5932e53c79 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:40.634131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c180b563-b254-4249-8c36-8a5932e53c79 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:40.640456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c180b563-b254-4249-8c36-8a5932e53c79 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:40.640972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c180b563-b254-4249-8c36-8a5932e53c79 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:40.641405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c180b563-b254-4249-8c36-8a5932e53c79 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:40.642084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c180b563-b254-4249-8c36-8a5932e53c79 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:40.642534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c180b563-b254-4249-8c36-8a5932e53c79 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:40.642957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c180b563-b254-4249-8c36-8a5932e53c79 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:40.709796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c180b563-b254-4249-8c36-8a5932e53c79 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:40.718086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c180b563-b254-4249-8c36-8a5932e53c79 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087816 Sep 01 05:21:40.718651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 486/937] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:40 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:41.254514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-48a4a874-1fe0-4da7-a0dd-61a6c61ab3c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:41.256650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-48a4a874-1fe0-4da7-a0dd-61a6c61ab3c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:41.263005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48a4a874-1fe0-4da7-a0dd-61a6c61ab3c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:41.263484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48a4a874-1fe0-4da7-a0dd-61a6c61ab3c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:41.263916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48a4a874-1fe0-4da7-a0dd-61a6c61ab3c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:41.265368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48a4a874-1fe0-4da7-a0dd-61a6c61ab3c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:41.265947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48a4a874-1fe0-4da7-a0dd-61a6c61ab3c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:41.266370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48a4a874-1fe0-4da7-a0dd-61a6c61ab3c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:41.296502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-48a4a874-1fe0-4da7-a0dd-61a6c61ab3c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Sep 01 05:21:41.297081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 452/938] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:41.497258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d74ff777-976b-42e1-8124-472e9f231727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:41.499423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d74ff777-976b-42e1-8124-472e9f231727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:41.505908 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d74ff777-976b-42e1-8124-472e9f231727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:41.506337 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d74ff777-976b-42e1-8124-472e9f231727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:41.506772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d74ff777-976b-42e1-8124-472e9f231727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:41.507453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d74ff777-976b-42e1-8124-472e9f231727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:41.507901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d74ff777-976b-42e1-8124-472e9f231727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:41.508338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d74ff777-976b-42e1-8124-472e9f231727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:41.538344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d74ff777-976b-42e1-8124-472e9f231727 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045064 Sep 01 05:21:41.538916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 487/939] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:41.739043 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bd5f00c7-b7e4-4673-833c-5ecf743361f1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:41.739654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bd5f00c7-b7e4-4673-833c-5ecf743361f1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:41.746061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bd5f00c7-b7e4-4673-833c-5ecf743361f1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:41.746539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bd5f00c7-b7e4-4673-833c-5ecf743361f1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:41.747083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bd5f00c7-b7e4-4673-833c-5ecf743361f1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:41.747764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bd5f00c7-b7e4-4673-833c-5ecf743361f1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:41.748216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bd5f00c7-b7e4-4673-833c-5ecf743361f1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:41.748632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bd5f00c7-b7e4-4673-833c-5ecf743361f1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:41.808750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bd5f00c7-b7e4-4673-833c-5ecf743361f1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:41.816591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bd5f00c7-b7e4-4673-833c-5ecf743361f1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081391 Sep 01 05:21:41.817185 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 453/940] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:41 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:42.308756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-67a20833-cbac-4147-9e7c-16696db9de6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:42.311269 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-67a20833-cbac-4147-9e7c-16696db9de6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:42.317616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67a20833-cbac-4147-9e7c-16696db9de6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:42.318096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67a20833-cbac-4147-9e7c-16696db9de6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:42.318527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67a20833-cbac-4147-9e7c-16696db9de6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:42.319206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67a20833-cbac-4147-9e7c-16696db9de6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:42.319652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67a20833-cbac-4147-9e7c-16696db9de6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:42.320068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67a20833-cbac-4147-9e7c-16696db9de6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:42.349546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-67a20833-cbac-4147-9e7c-16696db9de6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Sep 01 05:21:42.350080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 488/941] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:42 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:42.551138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b96dd1d7-ead2-4eed-a01d-7c919e0ee4c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:42.553336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b96dd1d7-ead2-4eed-a01d-7c919e0ee4c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:42.559830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b96dd1d7-ead2-4eed-a01d-7c919e0ee4c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:42.560253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b96dd1d7-ead2-4eed-a01d-7c919e0ee4c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:42.560686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b96dd1d7-ead2-4eed-a01d-7c919e0ee4c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:42.561767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b96dd1d7-ead2-4eed-a01d-7c919e0ee4c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:42.562221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b96dd1d7-ead2-4eed-a01d-7c919e0ee4c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:42.562650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b96dd1d7-ead2-4eed-a01d-7c919e0ee4c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:42.591766 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b96dd1d7-ead2-4eed-a01d-7c919e0ee4c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044617 Sep 01 05:21:42.592321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 454/942] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:42.837637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b81052a7-4c98-44f2-bc4c-5a5c9e54faf6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:42.838180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b81052a7-4c98-44f2-bc4c-5a5c9e54faf6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:42.844653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b81052a7-4c98-44f2-bc4c-5a5c9e54faf6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:42.845164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b81052a7-4c98-44f2-bc4c-5a5c9e54faf6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:42.845596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b81052a7-4c98-44f2-bc4c-5a5c9e54faf6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:42.846269 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b81052a7-4c98-44f2-bc4c-5a5c9e54faf6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:42.846719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b81052a7-4c98-44f2-bc4c-5a5c9e54faf6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:42.847146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b81052a7-4c98-44f2-bc4c-5a5c9e54faf6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:42.909241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b81052a7-4c98-44f2-bc4c-5a5c9e54faf6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:42.917030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b81052a7-4c98-44f2-bc4c-5a5c9e54faf6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083446 Sep 01 05:21:42.917601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 489/943] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:42 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:43.362439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ec7e12ba-91d6-4eb4-aefb-7ab17034723c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:43.364586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ec7e12ba-91d6-4eb4-aefb-7ab17034723c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:43.370525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec7e12ba-91d6-4eb4-aefb-7ab17034723c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:43.370996 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec7e12ba-91d6-4eb4-aefb-7ab17034723c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:43.371421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec7e12ba-91d6-4eb4-aefb-7ab17034723c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:43.372089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec7e12ba-91d6-4eb4-aefb-7ab17034723c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:43.372533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec7e12ba-91d6-4eb4-aefb-7ab17034723c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:43.372975 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec7e12ba-91d6-4eb4-aefb-7ab17034723c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:43.401889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ec7e12ba-91d6-4eb4-aefb-7ab17034723c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Sep 01 05:21:43.402442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 455/944] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:43 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:43.604702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9e7378ad-109c-424b-8da6-a4d127153975 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:43.606967 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9e7378ad-109c-424b-8da6-a4d127153975 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:43.613754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e7378ad-109c-424b-8da6-a4d127153975 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:43.614177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e7378ad-109c-424b-8da6-a4d127153975 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:43.614611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e7378ad-109c-424b-8da6-a4d127153975 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:43.615286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e7378ad-109c-424b-8da6-a4d127153975 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:43.615737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e7378ad-109c-424b-8da6-a4d127153975 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:43.616156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e7378ad-109c-424b-8da6-a4d127153975 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:43.646711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9e7378ad-109c-424b-8da6-a4d127153975 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045954 Sep 01 05:21:43.647253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 490/945] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:43.941911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9894755f-002f-4b5f-ab8e-e7538cf1899f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:43.942549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9894755f-002f-4b5f-ab8e-e7538cf1899f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:43.949031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9894755f-002f-4b5f-ab8e-e7538cf1899f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:43.949503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9894755f-002f-4b5f-ab8e-e7538cf1899f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:43.949930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9894755f-002f-4b5f-ab8e-e7538cf1899f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:43.950597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9894755f-002f-4b5f-ab8e-e7538cf1899f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:43.951039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9894755f-002f-4b5f-ab8e-e7538cf1899f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:43.951452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9894755f-002f-4b5f-ab8e-e7538cf1899f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:44.014339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9894755f-002f-4b5f-ab8e-e7538cf1899f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:44.022735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9894755f-002f-4b5f-ab8e-e7538cf1899f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084646 Sep 01 05:21:44.023302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 456/946] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:43 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:44.414361 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ab468a0e-b7aa-4341-9c20-0e3ba2aa773f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:44.416542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ab468a0e-b7aa-4341-9c20-0e3ba2aa773f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:44.423880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab468a0e-b7aa-4341-9c20-0e3ba2aa773f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:44.424362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab468a0e-b7aa-4341-9c20-0e3ba2aa773f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:44.424819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab468a0e-b7aa-4341-9c20-0e3ba2aa773f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:44.425502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab468a0e-b7aa-4341-9c20-0e3ba2aa773f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:44.425953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab468a0e-b7aa-4341-9c20-0e3ba2aa773f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:44.426374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab468a0e-b7aa-4341-9c20-0e3ba2aa773f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:44.455518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ab468a0e-b7aa-4341-9c20-0e3ba2aa773f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 Sep 01 05:21:44.456000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 491/947] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:44 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:44.659481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f72d235e-1f4e-4ed0-aa25-e4c8ce0cf0b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:44.661631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f72d235e-1f4e-4ed0-aa25-e4c8ce0cf0b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:44.667532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f72d235e-1f4e-4ed0-aa25-e4c8ce0cf0b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:44.668011 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f72d235e-1f4e-4ed0-aa25-e4c8ce0cf0b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:44.668443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f72d235e-1f4e-4ed0-aa25-e4c8ce0cf0b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:44.669165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f72d235e-1f4e-4ed0-aa25-e4c8ce0cf0b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:44.669612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f72d235e-1f4e-4ed0-aa25-e4c8ce0cf0b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:44.670029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f72d235e-1f4e-4ed0-aa25-e4c8ce0cf0b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:44.700478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f72d235e-1f4e-4ed0-aa25-e4c8ce0cf0b0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045541 Sep 01 05:21:44.701057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 457/948] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:45.044788 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b62e4c0e-16bf-4933-9fec-f24bb018fa53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:45.045412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b62e4c0e-16bf-4933-9fec-f24bb018fa53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:45.051636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b62e4c0e-16bf-4933-9fec-f24bb018fa53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:45.052121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b62e4c0e-16bf-4933-9fec-f24bb018fa53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:45.052554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b62e4c0e-16bf-4933-9fec-f24bb018fa53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:45.053262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b62e4c0e-16bf-4933-9fec-f24bb018fa53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:45.053713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b62e4c0e-16bf-4933-9fec-f24bb018fa53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:45.054133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b62e4c0e-16bf-4933-9fec-f24bb018fa53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:45.114940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b62e4c0e-16bf-4933-9fec-f24bb018fa53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:45.122682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b62e4c0e-16bf-4933-9fec-f24bb018fa53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081905 Sep 01 05:21:45.123236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 492/949] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:45 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:45.467847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-083a1b13-b9a5-4219-b163-6403342ed5b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:45.470051 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-083a1b13-b9a5-4219-b163-6403342ed5b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:45.476467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-083a1b13-b9a5-4219-b163-6403342ed5b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:45.476982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-083a1b13-b9a5-4219-b163-6403342ed5b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:45.477420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-083a1b13-b9a5-4219-b163-6403342ed5b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:45.478113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-083a1b13-b9a5-4219-b163-6403342ed5b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:45.478565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-083a1b13-b9a5-4219-b163-6403342ed5b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:45.478985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-083a1b13-b9a5-4219-b163-6403342ed5b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:45.482596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:45.655895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-083a1b13-b9a5-4219-b163-6403342ed5b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191522 Sep 01 05:21:45.656451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 458/950] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:45.713021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-01f007ce-af91-43b4-a18e-cbf1c7ec2971 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:45.715164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-01f007ce-af91-43b4-a18e-cbf1c7ec2971 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:45.722597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01f007ce-af91-43b4-a18e-cbf1c7ec2971 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:45.723018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01f007ce-af91-43b4-a18e-cbf1c7ec2971 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:45.723450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01f007ce-af91-43b4-a18e-cbf1c7ec2971 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:45.724127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01f007ce-af91-43b4-a18e-cbf1c7ec2971 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:45.724576 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01f007ce-af91-43b4-a18e-cbf1c7ec2971 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:45.725029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01f007ce-af91-43b4-a18e-cbf1c7ec2971 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:45.755429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-01f007ce-af91-43b4-a18e-cbf1c7ec2971 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046413 Sep 01 05:21:45.755976 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 493/951] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:45 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:46.146445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1991167c-7be8-4e3f-8090-0ce91d354f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:46.147170 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1991167c-7be8-4e3f-8090-0ce91d354f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:46.149027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=86 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:46.154161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1991167c-7be8-4e3f-8090-0ce91d354f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:46.154638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1991167c-7be8-4e3f-8090-0ce91d354f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:46.155067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1991167c-7be8-4e3f-8090-0ce91d354f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:46.155746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1991167c-7be8-4e3f-8090-0ce91d354f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:46.156197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1991167c-7be8-4e3f-8090-0ce91d354f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:46.156613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1991167c-7be8-4e3f-8090-0ce91d354f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:46.221362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1991167c-7be8-4e3f-8090-0ce91d354f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:46.229012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1991167c-7be8-4e3f-8090-0ce91d354f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086440 Sep 01 05:21:46.229550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 459/952] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:46 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:46.668165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c87e7d74-b6e7-4621-ad07-faa92d181277 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:46.670322 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c87e7d74-b6e7-4621-ad07-faa92d181277 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:46.676794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c87e7d74-b6e7-4621-ad07-faa92d181277 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:46.677312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c87e7d74-b6e7-4621-ad07-faa92d181277 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:46.677749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c87e7d74-b6e7-4621-ad07-faa92d181277 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:46.678432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c87e7d74-b6e7-4621-ad07-faa92d181277 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:46.678883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c87e7d74-b6e7-4621-ad07-faa92d181277 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:46.679307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c87e7d74-b6e7-4621-ad07-faa92d181277 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:46.708339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c87e7d74-b6e7-4621-ad07-faa92d181277 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044099 Sep 01 05:21:46.708917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 494/953] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:46 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:46.768002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-810eea47-05d0-4898-907d-744920bd66fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:46.770073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-810eea47-05d0-4898-907d-744920bd66fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:46.776347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-810eea47-05d0-4898-907d-744920bd66fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:46.776851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-810eea47-05d0-4898-907d-744920bd66fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:46.777283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-810eea47-05d0-4898-907d-744920bd66fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:46.777953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-810eea47-05d0-4898-907d-744920bd66fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:46.778397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-810eea47-05d0-4898-907d-744920bd66fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:46.778812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-810eea47-05d0-4898-907d-744920bd66fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:46.809455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-810eea47-05d0-4898-907d-744920bd66fe tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045458 Sep 01 05:21:46.809986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 460/954] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:47.249834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-01ef5d8e-1cc8-4663-af09-8e49b14b7e53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:47.250456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-01ef5d8e-1cc8-4663-af09-8e49b14b7e53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:47.256843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01ef5d8e-1cc8-4663-af09-8e49b14b7e53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:47.257323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01ef5d8e-1cc8-4663-af09-8e49b14b7e53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:47.257762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01ef5d8e-1cc8-4663-af09-8e49b14b7e53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:47.258463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01ef5d8e-1cc8-4663-af09-8e49b14b7e53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:47.258909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01ef5d8e-1cc8-4663-af09-8e49b14b7e53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:47.259331 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01ef5d8e-1cc8-4663-af09-8e49b14b7e53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:47.321015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-01ef5d8e-1cc8-4663-af09-8e49b14b7e53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:47.323258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:47.330698 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-01ef5d8e-1cc8-4663-af09-8e49b14b7e53 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084860 Sep 01 05:21:47.331267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 495/955] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:47 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:47.720964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4efe31bc-0409-40f0-b183-ae828719f055 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:47.723060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4efe31bc-0409-40f0-b183-ae828719f055 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:47.729033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4efe31bc-0409-40f0-b183-ae828719f055 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:47.729516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4efe31bc-0409-40f0-b183-ae828719f055 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:47.729950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4efe31bc-0409-40f0-b183-ae828719f055 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:47.730628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4efe31bc-0409-40f0-b183-ae828719f055 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:47.731081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4efe31bc-0409-40f0-b183-ae828719f055 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:47.731500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4efe31bc-0409-40f0-b183-ae828719f055 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:47.761017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4efe31bc-0409-40f0-b183-ae828719f055 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045045 Sep 01 05:21:47.761554 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 461/956] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:47.822114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8828b4f4-0279-48f8-99a6-9d45a8672100 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:47.824164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8828b4f4-0279-48f8-99a6-9d45a8672100 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:47.830706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8828b4f4-0279-48f8-99a6-9d45a8672100 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:47.831185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8828b4f4-0279-48f8-99a6-9d45a8672100 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:47.831618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8828b4f4-0279-48f8-99a6-9d45a8672100 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:47.832295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8828b4f4-0279-48f8-99a6-9d45a8672100 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:47.832744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8828b4f4-0279-48f8-99a6-9d45a8672100 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:47.833192 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8828b4f4-0279-48f8-99a6-9d45a8672100 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:47.862233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8828b4f4-0279-48f8-99a6-9d45a8672100 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044127 Sep 01 05:21:47.862777 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 496/957] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:47 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:48.352109 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-386caa9a-bf6f-4f1a-8ea9-0a7a3c996bb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:48.352704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-386caa9a-bf6f-4f1a-8ea9-0a7a3c996bb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:48.359979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-386caa9a-bf6f-4f1a-8ea9-0a7a3c996bb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:48.360456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-386caa9a-bf6f-4f1a-8ea9-0a7a3c996bb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:48.360912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-386caa9a-bf6f-4f1a-8ea9-0a7a3c996bb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:48.361616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-386caa9a-bf6f-4f1a-8ea9-0a7a3c996bb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:48.362059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-386caa9a-bf6f-4f1a-8ea9-0a7a3c996bb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:48.362475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-386caa9a-bf6f-4f1a-8ea9-0a7a3c996bb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:48.423741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-386caa9a-bf6f-4f1a-8ea9-0a7a3c996bb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:48.431259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-386caa9a-bf6f-4f1a-8ea9-0a7a3c996bb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082975 Sep 01 05:21:48.431804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 462/958] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:48 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:48.773771 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a80cf7e5-0191-42a6-b50c-21cbcfe59888 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:48.775934 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a80cf7e5-0191-42a6-b50c-21cbcfe59888 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:48.783497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a80cf7e5-0191-42a6-b50c-21cbcfe59888 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:48.783980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a80cf7e5-0191-42a6-b50c-21cbcfe59888 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:48.784415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a80cf7e5-0191-42a6-b50c-21cbcfe59888 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:48.785121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a80cf7e5-0191-42a6-b50c-21cbcfe59888 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:48.785580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a80cf7e5-0191-42a6-b50c-21cbcfe59888 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:48.786005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a80cf7e5-0191-42a6-b50c-21cbcfe59888 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:48.815966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a80cf7e5-0191-42a6-b50c-21cbcfe59888 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046137 Sep 01 05:21:48.816508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 497/959] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:48 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:48.875696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c15c76a5-08f3-4ffa-b665-9218eebd9883 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:48.878483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c15c76a5-08f3-4ffa-b665-9218eebd9883 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:48.885826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c15c76a5-08f3-4ffa-b665-9218eebd9883 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:48.886302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c15c76a5-08f3-4ffa-b665-9218eebd9883 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:48.886732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c15c76a5-08f3-4ffa-b665-9218eebd9883 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:48.887412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c15c76a5-08f3-4ffa-b665-9218eebd9883 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:48.887853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c15c76a5-08f3-4ffa-b665-9218eebd9883 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:48.888264 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c15c76a5-08f3-4ffa-b665-9218eebd9883 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:48.918934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c15c76a5-08f3-4ffa-b665-9218eebd9883 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048097 Sep 01 05:21:48.919481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 463/960] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:49.452697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-38c54947-e8a1-4d1e-a6ad-249521712dcb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:49.453326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-38c54947-e8a1-4d1e-a6ad-249521712dcb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:49.455159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=84 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:49.460063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38c54947-e8a1-4d1e-a6ad-249521712dcb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:49.460537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38c54947-e8a1-4d1e-a6ad-249521712dcb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:49.461000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38c54947-e8a1-4d1e-a6ad-249521712dcb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:49.461677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38c54947-e8a1-4d1e-a6ad-249521712dcb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:49.462132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38c54947-e8a1-4d1e-a6ad-249521712dcb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:49.462547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38c54947-e8a1-4d1e-a6ad-249521712dcb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:49.525260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-38c54947-e8a1-4d1e-a6ad-249521712dcb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:49.533592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-38c54947-e8a1-4d1e-a6ad-249521712dcb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085295 Sep 01 05:21:49.534163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 498/961] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:49 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:49.830414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cfaf9b78-9f32-42ef-aab2-72e6f374ece3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:49.832700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cfaf9b78-9f32-42ef-aab2-72e6f374ece3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:49.839308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfaf9b78-9f32-42ef-aab2-72e6f374ece3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:49.839786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfaf9b78-9f32-42ef-aab2-72e6f374ece3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:49.840213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfaf9b78-9f32-42ef-aab2-72e6f374ece3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:49.840915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfaf9b78-9f32-42ef-aab2-72e6f374ece3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:49.841361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfaf9b78-9f32-42ef-aab2-72e6f374ece3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:49.841775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfaf9b78-9f32-42ef-aab2-72e6f374ece3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:49.871674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cfaf9b78-9f32-42ef-aab2-72e6f374ece3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047205 Sep 01 05:21:49.872221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 464/962] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:49 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:49.931701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-93620101-ec3d-4dcb-a7ae-31481f1028c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:49.933853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-93620101-ec3d-4dcb-a7ae-31481f1028c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:49.941222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93620101-ec3d-4dcb-a7ae-31481f1028c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:49.941694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93620101-ec3d-4dcb-a7ae-31481f1028c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:49.942119 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93620101-ec3d-4dcb-a7ae-31481f1028c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:49.942787 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93620101-ec3d-4dcb-a7ae-31481f1028c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:49.943256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93620101-ec3d-4dcb-a7ae-31481f1028c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:49.943666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93620101-ec3d-4dcb-a7ae-31481f1028c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:49.973169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-93620101-ec3d-4dcb-a7ae-31481f1028c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045297 Sep 01 05:21:49.973756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 499/963] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:49 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:21:50.554222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2cd62ae0-d421-4bee-895a-b1aa2044e802 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:50.554755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2cd62ae0-d421-4bee-895a-b1aa2044e802 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:50.560656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cd62ae0-d421-4bee-895a-b1aa2044e802 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:50.561478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cd62ae0-d421-4bee-895a-b1aa2044e802 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:50.561971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cd62ae0-d421-4bee-895a-b1aa2044e802 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:50.562639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cd62ae0-d421-4bee-895a-b1aa2044e802 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:50.563078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cd62ae0-d421-4bee-895a-b1aa2044e802 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:50.563491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cd62ae0-d421-4bee-895a-b1aa2044e802 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:50.623714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2cd62ae0-d421-4bee-895a-b1aa2044e802 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:50.631638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2cd62ae0-d421-4bee-895a-b1aa2044e802 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081310 Sep 01 05:21:50.632198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 465/964] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:50 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:50.884908 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-90f678da-f91a-482e-8a5d-d57425021c50 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:50.887089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-90f678da-f91a-482e-8a5d-d57425021c50 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:50.893692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90f678da-f91a-482e-8a5d-d57425021c50 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:50.894177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90f678da-f91a-482e-8a5d-d57425021c50 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:50.894609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90f678da-f91a-482e-8a5d-d57425021c50 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:50.895289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90f678da-f91a-482e-8a5d-d57425021c50 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:50.895736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90f678da-f91a-482e-8a5d-d57425021c50 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:50.896148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90f678da-f91a-482e-8a5d-d57425021c50 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:50.926150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-90f678da-f91a-482e-8a5d-d57425021c50 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045204 Sep 01 05:21:50.926701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 500/965] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:50 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:50.985919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9a3b8330-8b8f-4bb3-9ac5-c1fb113d2b01 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:50.988067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9a3b8330-8b8f-4bb3-9ac5-c1fb113d2b01 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:50.994478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a3b8330-8b8f-4bb3-9ac5-c1fb113d2b01 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:50.994942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a3b8330-8b8f-4bb3-9ac5-c1fb113d2b01 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:50.995376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a3b8330-8b8f-4bb3-9ac5-c1fb113d2b01 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:50.996056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a3b8330-8b8f-4bb3-9ac5-c1fb113d2b01 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:50.996505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a3b8330-8b8f-4bb3-9ac5-c1fb113d2b01 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:50.996960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a3b8330-8b8f-4bb3-9ac5-c1fb113d2b01 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:51.026271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9a3b8330-8b8f-4bb3-9ac5-c1fb113d2b01 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044437 Sep 01 05:21:51.026819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 466/966] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:51.652088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e42b81b4-3bec-44eb-a087-f59c2072cb3d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:51.652698 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e42b81b4-3bec-44eb-a087-f59c2072cb3d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:51.659606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e42b81b4-3bec-44eb-a087-f59c2072cb3d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:51.660091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e42b81b4-3bec-44eb-a087-f59c2072cb3d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:51.660554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e42b81b4-3bec-44eb-a087-f59c2072cb3d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:51.661236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e42b81b4-3bec-44eb-a087-f59c2072cb3d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:51.661688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e42b81b4-3bec-44eb-a087-f59c2072cb3d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:51.662109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e42b81b4-3bec-44eb-a087-f59c2072cb3d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:51.723464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e42b81b4-3bec-44eb-a087-f59c2072cb3d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:51.731174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e42b81b4-3bec-44eb-a087-f59c2072cb3d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082927 Sep 01 05:21:51.731736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 501/967] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:51 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:51.938184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6ec4af72-02a4-4430-85a1-320571399eeb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:51.940297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6ec4af72-02a4-4430-85a1-320571399eeb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:51.946308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ec4af72-02a4-4430-85a1-320571399eeb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:51.946790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ec4af72-02a4-4430-85a1-320571399eeb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:51.947226 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ec4af72-02a4-4430-85a1-320571399eeb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:51.947908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ec4af72-02a4-4430-85a1-320571399eeb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:51.948361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ec4af72-02a4-4430-85a1-320571399eeb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:51.948793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ec4af72-02a4-4430-85a1-320571399eeb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:51.978277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6ec4af72-02a4-4430-85a1-320571399eeb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Sep 01 05:21:51.978818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 467/968] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:52.038649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b29fbff5-abdf-40b8-97a7-60773dba40fd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:52.040890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b29fbff5-abdf-40b8-97a7-60773dba40fd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:52.047699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b29fbff5-abdf-40b8-97a7-60773dba40fd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:52.048276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b29fbff5-abdf-40b8-97a7-60773dba40fd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:52.048714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b29fbff5-abdf-40b8-97a7-60773dba40fd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:52.049425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b29fbff5-abdf-40b8-97a7-60773dba40fd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:52.049879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b29fbff5-abdf-40b8-97a7-60773dba40fd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:52.050306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b29fbff5-abdf-40b8-97a7-60773dba40fd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:52.085990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b29fbff5-abdf-40b8-97a7-60773dba40fd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051305 Sep 01 05:21:52.086546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 502/969] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:52.752012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bf5af72d-eead-4c3d-85e2-94e89f68be8c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:52.752625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bf5af72d-eead-4c3d-85e2-94e89f68be8c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:52.759181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf5af72d-eead-4c3d-85e2-94e89f68be8c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:52.759662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf5af72d-eead-4c3d-85e2-94e89f68be8c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:52.760087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf5af72d-eead-4c3d-85e2-94e89f68be8c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:52.760767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf5af72d-eead-4c3d-85e2-94e89f68be8c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:52.761231 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf5af72d-eead-4c3d-85e2-94e89f68be8c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:52.761644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf5af72d-eead-4c3d-85e2-94e89f68be8c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:52.822768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bf5af72d-eead-4c3d-85e2-94e89f68be8c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:52.831003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bf5af72d-eead-4c3d-85e2-94e89f68be8c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083537 Sep 01 05:21:52.831569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 468/970] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:52 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:52.991498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-50ce35ec-9d5c-4c4f-a78d-2b829ba6bee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:52.993643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-50ce35ec-9d5c-4c4f-a78d-2b829ba6bee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:53.001011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-50ce35ec-9d5c-4c4f-a78d-2b829ba6bee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:53.001493 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-50ce35ec-9d5c-4c4f-a78d-2b829ba6bee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:53.001923 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-50ce35ec-9d5c-4c4f-a78d-2b829ba6bee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:53.002651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-50ce35ec-9d5c-4c4f-a78d-2b829ba6bee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:53.003044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-50ce35ec-9d5c-4c4f-a78d-2b829ba6bee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:53.003460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-50ce35ec-9d5c-4c4f-a78d-2b829ba6bee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:53.032666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-50ce35ec-9d5c-4c4f-a78d-2b829ba6bee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045095 Sep 01 05:21:53.033239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 503/971] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:53.098578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-79c56a01-c16a-41a7-9bd0-3aa96fa362d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:53.100752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-79c56a01-c16a-41a7-9bd0-3aa96fa362d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:53.106701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79c56a01-c16a-41a7-9bd0-3aa96fa362d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:53.107186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79c56a01-c16a-41a7-9bd0-3aa96fa362d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:53.107624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79c56a01-c16a-41a7-9bd0-3aa96fa362d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:53.108306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79c56a01-c16a-41a7-9bd0-3aa96fa362d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:53.108761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79c56a01-c16a-41a7-9bd0-3aa96fa362d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:53.109761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79c56a01-c16a-41a7-9bd0-3aa96fa362d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:53.138687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-79c56a01-c16a-41a7-9bd0-3aa96fa362d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044194 Sep 01 05:21:53.139223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 469/972] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:53.851813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3e9f570c-9629-4017-b2c1-730cbaf22851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:53.852416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3e9f570c-9629-4017-b2c1-730cbaf22851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:53.860489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3e9f570c-9629-4017-b2c1-730cbaf22851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:53.861066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3e9f570c-9629-4017-b2c1-730cbaf22851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:53.861508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3e9f570c-9629-4017-b2c1-730cbaf22851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:53.862207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3e9f570c-9629-4017-b2c1-730cbaf22851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:53.862658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3e9f570c-9629-4017-b2c1-730cbaf22851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:53.863084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3e9f570c-9629-4017-b2c1-730cbaf22851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:53.943011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3e9f570c-9629-4017-b2c1-730cbaf22851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:53.951100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3e9f570c-9629-4017-b2c1-730cbaf22851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.103442 Sep 01 05:21:53.951692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 504/973] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:53 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:54.044682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-78750d23-a0bb-49ca-8b8c-2dc1c20c642b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:54.046893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-78750d23-a0bb-49ca-8b8c-2dc1c20c642b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:54.054060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-78750d23-a0bb-49ca-8b8c-2dc1c20c642b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:54.054549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-78750d23-a0bb-49ca-8b8c-2dc1c20c642b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:54.054988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-78750d23-a0bb-49ca-8b8c-2dc1c20c642b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:54.055689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-78750d23-a0bb-49ca-8b8c-2dc1c20c642b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:54.056145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-78750d23-a0bb-49ca-8b8c-2dc1c20c642b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:54.056574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-78750d23-a0bb-49ca-8b8c-2dc1c20c642b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:54.088097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-78750d23-a0bb-49ca-8b8c-2dc1c20c642b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047253 Sep 01 05:21:54.088582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 470/974] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:54.152226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0b780e12-aa4c-4f56-94c9-faf6953b00cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:54.154409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0b780e12-aa4c-4f56-94c9-faf6953b00cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:54.161602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b780e12-aa4c-4f56-94c9-faf6953b00cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:54.162276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b780e12-aa4c-4f56-94c9-faf6953b00cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:54.162711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b780e12-aa4c-4f56-94c9-faf6953b00cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:54.163397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b780e12-aa4c-4f56-94c9-faf6953b00cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:54.163844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b780e12-aa4c-4f56-94c9-faf6953b00cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:54.164261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b780e12-aa4c-4f56-94c9-faf6953b00cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:54.194992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0b780e12-aa4c-4f56-94c9-faf6953b00cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046810 Sep 01 05:21:54.195549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 505/975] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:54.975949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2216e14f-bd75-436a-8d3c-6376177385fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:54.976569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2216e14f-bd75-436a-8d3c-6376177385fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:54.982443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2216e14f-bd75-436a-8d3c-6376177385fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:54.982926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2216e14f-bd75-436a-8d3c-6376177385fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:54.983360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2216e14f-bd75-436a-8d3c-6376177385fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:54.984040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2216e14f-bd75-436a-8d3c-6376177385fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:54.984798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2216e14f-bd75-436a-8d3c-6376177385fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:54.985299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2216e14f-bd75-436a-8d3c-6376177385fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:55.050649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2216e14f-bd75-436a-8d3c-6376177385fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:55.058728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2216e14f-bd75-436a-8d3c-6376177385fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086649 Sep 01 05:21:55.059284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 471/976] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:54 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:55.099578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1b7a2d7b-4b54-41ed-a196-81c09c3a74ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:55.101779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1b7a2d7b-4b54-41ed-a196-81c09c3a74ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:55.107836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b7a2d7b-4b54-41ed-a196-81c09c3a74ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:55.108311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b7a2d7b-4b54-41ed-a196-81c09c3a74ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:55.108747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b7a2d7b-4b54-41ed-a196-81c09c3a74ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:55.109525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b7a2d7b-4b54-41ed-a196-81c09c3a74ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:55.110023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b7a2d7b-4b54-41ed-a196-81c09c3a74ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:55.110438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b7a2d7b-4b54-41ed-a196-81c09c3a74ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:55.139391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1b7a2d7b-4b54-41ed-a196-81c09c3a74ae tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043802 Sep 01 05:21:55.139928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 506/977] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:55 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:55.208257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d947e5e2-113f-4462-8cd7-2911a32f48f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:55.210388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d947e5e2-113f-4462-8cd7-2911a32f48f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:55.216316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d947e5e2-113f-4462-8cd7-2911a32f48f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:55.216818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d947e5e2-113f-4462-8cd7-2911a32f48f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:55.217259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d947e5e2-113f-4462-8cd7-2911a32f48f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:55.217941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d947e5e2-113f-4462-8cd7-2911a32f48f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:55.218388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d947e5e2-113f-4462-8cd7-2911a32f48f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:55.219836 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d947e5e2-113f-4462-8cd7-2911a32f48f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:55.249446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d947e5e2-113f-4462-8cd7-2911a32f48f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045889 Sep 01 05:21:55.250511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 472/978] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:56.081670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-946e94e1-f594-43a4-adeb-de83542a1d54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:56.082274 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-946e94e1-f594-43a4-adeb-de83542a1d54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:56.089384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-946e94e1-f594-43a4-adeb-de83542a1d54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:56.089861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-946e94e1-f594-43a4-adeb-de83542a1d54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:56.090633 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-946e94e1-f594-43a4-adeb-de83542a1d54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:56.091317 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-946e94e1-f594-43a4-adeb-de83542a1d54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:56.091761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-946e94e1-f594-43a4-adeb-de83542a1d54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:56.092174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-946e94e1-f594-43a4-adeb-de83542a1d54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:56.151647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bdae8c95-0428-43af-8086-216d11c1cbb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:56.153730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bdae8c95-0428-43af-8086-216d11c1cbb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:56.154524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-946e94e1-f594-43a4-adeb-de83542a1d54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:56.161034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdae8c95-0428-43af-8086-216d11c1cbb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:56.161523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdae8c95-0428-43af-8086-216d11c1cbb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:56.161984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdae8c95-0428-43af-8086-216d11c1cbb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:56.162679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdae8c95-0428-43af-8086-216d11c1cbb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:56.163129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdae8c95-0428-43af-8086-216d11c1cbb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:56.163550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdae8c95-0428-43af-8086-216d11c1cbb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:56.163655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-946e94e1-f594-43a4-adeb-de83542a1d54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086813 Sep 01 05:21:56.164195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 507/979] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:56 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:56.193788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bdae8c95-0428-43af-8086-216d11c1cbb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046137 Sep 01 05:21:56.194333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 473/980] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:56.262328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dfe1fe3e-22de-4bb3-9bd6-09eb1f701c91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:56.264430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dfe1fe3e-22de-4bb3-9bd6-09eb1f701c91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:56.270998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dfe1fe3e-22de-4bb3-9bd6-09eb1f701c91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:56.271471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dfe1fe3e-22de-4bb3-9bd6-09eb1f701c91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:56.271908 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dfe1fe3e-22de-4bb3-9bd6-09eb1f701c91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:56.272579 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dfe1fe3e-22de-4bb3-9bd6-09eb1f701c91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:56.273049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dfe1fe3e-22de-4bb3-9bd6-09eb1f701c91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:56.273465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dfe1fe3e-22de-4bb3-9bd6-09eb1f701c91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:56.306064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dfe1fe3e-22de-4bb3-9bd6-09eb1f701c91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047764 Sep 01 05:21:56.306616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 508/981] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:57.184228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6ee7ff2a-039a-47eb-94dd-bcd4a7d79ed9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:57.184810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6ee7ff2a-039a-47eb-94dd-bcd4a7d79ed9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:57.192666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ee7ff2a-039a-47eb-94dd-bcd4a7d79ed9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:57.193170 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ee7ff2a-039a-47eb-94dd-bcd4a7d79ed9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:57.193600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ee7ff2a-039a-47eb-94dd-bcd4a7d79ed9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:57.194283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ee7ff2a-039a-47eb-94dd-bcd4a7d79ed9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:57.194739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ee7ff2a-039a-47eb-94dd-bcd4a7d79ed9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:57.195155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ee7ff2a-039a-47eb-94dd-bcd4a7d79ed9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:57.206736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ce5f699d-bfb2-4ba6-bf0f-02076480c74d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:57.208971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ce5f699d-bfb2-4ba6-bf0f-02076480c74d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:57.215359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce5f699d-bfb2-4ba6-bf0f-02076480c74d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:57.215850 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce5f699d-bfb2-4ba6-bf0f-02076480c74d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:57.216321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce5f699d-bfb2-4ba6-bf0f-02076480c74d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:57.217047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce5f699d-bfb2-4ba6-bf0f-02076480c74d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:57.217507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce5f699d-bfb2-4ba6-bf0f-02076480c74d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:57.217930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce5f699d-bfb2-4ba6-bf0f-02076480c74d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:57.249324 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ce5f699d-bfb2-4ba6-bf0f-02076480c74d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047032 Sep 01 05:21:57.249933 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 509/982] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:57 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:21:57.319383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6ec3e409-76fa-4c0f-a5bb-4b60f1c3d1fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:57.321693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6ec3e409-76fa-4c0f-a5bb-4b60f1c3d1fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:57.327952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ec3e409-76fa-4c0f-a5bb-4b60f1c3d1fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:57.328449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ec3e409-76fa-4c0f-a5bb-4b60f1c3d1fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:57.328922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ec3e409-76fa-4c0f-a5bb-4b60f1c3d1fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:57.329627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ec3e409-76fa-4c0f-a5bb-4b60f1c3d1fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:57.330082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ec3e409-76fa-4c0f-a5bb-4b60f1c3d1fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:57.330503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ec3e409-76fa-4c0f-a5bb-4b60f1c3d1fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:57.363791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6ec3e409-76fa-4c0f-a5bb-4b60f1c3d1fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048616 Sep 01 05:21:57.364390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 510/983] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:21:57.504763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ee7ff2a-039a-47eb-94dd-bcd4a7d79ed9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:57.506956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:57.513869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6ee7ff2a-039a-47eb-94dd-bcd4a7d79ed9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.333606 Sep 01 05:21:57.514427 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 474/984] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:57 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:58.261865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dd2e4850-690d-449b-9f78-7a571ecdb5c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:58.263988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dd2e4850-690d-449b-9f78-7a571ecdb5c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:58.271133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd2e4850-690d-449b-9f78-7a571ecdb5c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:58.271623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd2e4850-690d-449b-9f78-7a571ecdb5c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:58.272057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd2e4850-690d-449b-9f78-7a571ecdb5c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:58.272736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd2e4850-690d-449b-9f78-7a571ecdb5c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:58.273214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd2e4850-690d-449b-9f78-7a571ecdb5c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:58.273630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd2e4850-690d-449b-9f78-7a571ecdb5c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:58.304544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dd2e4850-690d-449b-9f78-7a571ecdb5c0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046657 Sep 01 05:21:58.305127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 511/985] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:58 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:58.376118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-06e0c143-369a-4abb-bbe9-92f419601fc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:58.378302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-06e0c143-369a-4abb-bbe9-92f419601fc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:58.384750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06e0c143-369a-4abb-bbe9-92f419601fc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:58.385263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06e0c143-369a-4abb-bbe9-92f419601fc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:58.385706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06e0c143-369a-4abb-bbe9-92f419601fc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:58.386394 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06e0c143-369a-4abb-bbe9-92f419601fc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:58.386874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06e0c143-369a-4abb-bbe9-92f419601fc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:58.387298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-06e0c143-369a-4abb-bbe9-92f419601fc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:58.416612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-06e0c143-369a-4abb-bbe9-92f419601fc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044555 Sep 01 05:21:58.417194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 475/986] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:58.535635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0ef4c822-88c7-4ee5-8f33-01d22ed76ea9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:58.536173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0ef4c822-88c7-4ee5-8f33-01d22ed76ea9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:58.542075 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ef4c822-88c7-4ee5-8f33-01d22ed76ea9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:58.542549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ef4c822-88c7-4ee5-8f33-01d22ed76ea9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:58.542971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ef4c822-88c7-4ee5-8f33-01d22ed76ea9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:58.543643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ef4c822-88c7-4ee5-8f33-01d22ed76ea9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:58.544087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ef4c822-88c7-4ee5-8f33-01d22ed76ea9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:58.544499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ef4c822-88c7-4ee5-8f33-01d22ed76ea9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:58.559298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:58.608529 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0ef4c822-88c7-4ee5-8f33-01d22ed76ea9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:58.616142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0ef4c822-88c7-4ee5-8f33-01d22ed76ea9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085183 Sep 01 05:21:58.616693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 512/987] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:58 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:59.317075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b38e3c86-1076-45fc-af60-bb669035da0a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:59.319144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b38e3c86-1076-45fc-af60-bb669035da0a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:59.325006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b38e3c86-1076-45fc-af60-bb669035da0a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:59.325483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b38e3c86-1076-45fc-af60-bb669035da0a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:59.325910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b38e3c86-1076-45fc-af60-bb669035da0a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:59.326583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b38e3c86-1076-45fc-af60-bb669035da0a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:59.327026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b38e3c86-1076-45fc-af60-bb669035da0a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:59.327447 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b38e3c86-1076-45fc-af60-bb669035da0a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:59.358248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b38e3c86-1076-45fc-af60-bb669035da0a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046098 Sep 01 05:21:59.358790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 476/988] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:21:59 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:59.429285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-891de3bd-5618-4dc2-9273-52f74b5d5d43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:59.431432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-891de3bd-5618-4dc2-9273-52f74b5d5d43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:59.438425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-891de3bd-5618-4dc2-9273-52f74b5d5d43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:59.438898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-891de3bd-5618-4dc2-9273-52f74b5d5d43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:59.439324 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-891de3bd-5618-4dc2-9273-52f74b5d5d43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:59.439993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-891de3bd-5618-4dc2-9273-52f74b5d5d43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:59.440434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-891de3bd-5618-4dc2-9273-52f74b5d5d43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:59.440874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-891de3bd-5618-4dc2-9273-52f74b5d5d43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:59.470188 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-891de3bd-5618-4dc2-9273-52f74b5d5d43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044771 Sep 01 05:21:59.470722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 513/989] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:21:59 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:59.636467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1fa125b7-60eb-4679-9a90-a8f0b6d3a52a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:59.637124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1fa125b7-60eb-4679-9a90-a8f0b6d3a52a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:59.643471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fa125b7-60eb-4679-9a90-a8f0b6d3a52a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:59.643948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fa125b7-60eb-4679-9a90-a8f0b6d3a52a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:59.644372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fa125b7-60eb-4679-9a90-a8f0b6d3a52a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:59.645075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fa125b7-60eb-4679-9a90-a8f0b6d3a52a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:59.645529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fa125b7-60eb-4679-9a90-a8f0b6d3a52a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:59.645942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1fa125b7-60eb-4679-9a90-a8f0b6d3a52a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:59.706303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1fa125b7-60eb-4679-9a90-a8f0b6d3a52a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:59.713722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1fa125b7-60eb-4679-9a90-a8f0b6d3a52a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081024 Sep 01 05:21:59.714267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 477/990] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:59 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:00.370624 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2ac210ee-13ed-412d-aca6-356c10edf085 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:00.372715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2ac210ee-13ed-412d-aca6-356c10edf085 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:00.379376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2ac210ee-13ed-412d-aca6-356c10edf085 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:00.379862 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2ac210ee-13ed-412d-aca6-356c10edf085 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:00.380298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2ac210ee-13ed-412d-aca6-356c10edf085 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:00.381043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2ac210ee-13ed-412d-aca6-356c10edf085 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:00.381496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2ac210ee-13ed-412d-aca6-356c10edf085 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:00.381920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2ac210ee-13ed-412d-aca6-356c10edf085 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:00.412060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2ac210ee-13ed-412d-aca6-356c10edf085 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 Sep 01 05:22:00.412636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 514/991] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:00.481454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bf5badbc-9e42-4032-8714-bb861efbc35c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:00.483620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bf5badbc-9e42-4032-8714-bb861efbc35c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:00.490177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf5badbc-9e42-4032-8714-bb861efbc35c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:00.490655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf5badbc-9e42-4032-8714-bb861efbc35c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:00.491091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf5badbc-9e42-4032-8714-bb861efbc35c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:00.491770 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf5badbc-9e42-4032-8714-bb861efbc35c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:00.492220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf5badbc-9e42-4032-8714-bb861efbc35c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:00.492637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf5badbc-9e42-4032-8714-bb861efbc35c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:00.522555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bf5badbc-9e42-4032-8714-bb861efbc35c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045065 Sep 01 05:22:00.523096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 478/992] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:00 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:00.735526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-35f1529b-971b-4862-a281-2aec1e725aa4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:00.736170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-35f1529b-971b-4862-a281-2aec1e725aa4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:00.743146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35f1529b-971b-4862-a281-2aec1e725aa4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:00.743626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35f1529b-971b-4862-a281-2aec1e725aa4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:00.744059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35f1529b-971b-4862-a281-2aec1e725aa4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:00.744740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35f1529b-971b-4862-a281-2aec1e725aa4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:00.745215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35f1529b-971b-4862-a281-2aec1e725aa4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:00.745635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35f1529b-971b-4862-a281-2aec1e725aa4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:00.807123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-35f1529b-971b-4862-a281-2aec1e725aa4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:00.815756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-35f1529b-971b-4862-a281-2aec1e725aa4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084226 Sep 01 05:22:00.816323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 515/993] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:00 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:01.424584 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-41a9ccca-05bb-47a7-9b80-ad8803edf691 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:01.426764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-41a9ccca-05bb-47a7-9b80-ad8803edf691 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:01.433244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41a9ccca-05bb-47a7-9b80-ad8803edf691 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:01.433722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41a9ccca-05bb-47a7-9b80-ad8803edf691 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:01.434155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41a9ccca-05bb-47a7-9b80-ad8803edf691 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:01.434832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41a9ccca-05bb-47a7-9b80-ad8803edf691 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:01.435281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41a9ccca-05bb-47a7-9b80-ad8803edf691 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:01.435700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41a9ccca-05bb-47a7-9b80-ad8803edf691 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:01.464955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-41a9ccca-05bb-47a7-9b80-ad8803edf691 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Sep 01 05:22:01.465487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 479/994] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:01 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:01.535572 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4205f56b-22c2-4fed-9f4c-56a4c45f2e64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:01.537901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4205f56b-22c2-4fed-9f4c-56a4c45f2e64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:01.543649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4205f56b-22c2-4fed-9f4c-56a4c45f2e64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:01.544121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4205f56b-22c2-4fed-9f4c-56a4c45f2e64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:01.544547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4205f56b-22c2-4fed-9f4c-56a4c45f2e64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:01.545249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4205f56b-22c2-4fed-9f4c-56a4c45f2e64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:01.545693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4205f56b-22c2-4fed-9f4c-56a4c45f2e64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:01.546107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4205f56b-22c2-4fed-9f4c-56a4c45f2e64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:01.576102 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4205f56b-22c2-4fed-9f4c-56a4c45f2e64 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045238 Sep 01 05:22:01.576642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 516/995] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:01.836814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5abb49d7-f4bd-4670-9c44-ac3478d9011a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:01.837348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5abb49d7-f4bd-4670-9c44-ac3478d9011a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:01.843228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5abb49d7-f4bd-4670-9c44-ac3478d9011a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:01.844210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5abb49d7-f4bd-4670-9c44-ac3478d9011a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:01.844649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5abb49d7-f4bd-4670-9c44-ac3478d9011a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:01.845355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5abb49d7-f4bd-4670-9c44-ac3478d9011a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:01.845804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5abb49d7-f4bd-4670-9c44-ac3478d9011a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:01.846220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5abb49d7-f4bd-4670-9c44-ac3478d9011a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:01.905828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5abb49d7-f4bd-4670-9c44-ac3478d9011a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:01.914119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5abb49d7-f4bd-4670-9c44-ac3478d9011a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081243 Sep 01 05:22:01.914694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 480/996] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:01 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:02.477756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d126adfc-3056-4ddc-bb2c-2a473aca96cf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:02.479961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d126adfc-3056-4ddc-bb2c-2a473aca96cf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:02.486521 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d126adfc-3056-4ddc-bb2c-2a473aca96cf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.487002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d126adfc-3056-4ddc-bb2c-2a473aca96cf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.487438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d126adfc-3056-4ddc-bb2c-2a473aca96cf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:02.488121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d126adfc-3056-4ddc-bb2c-2a473aca96cf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.488569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d126adfc-3056-4ddc-bb2c-2a473aca96cf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.489020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d126adfc-3056-4ddc-bb2c-2a473aca96cf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:02.518984 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d126adfc-3056-4ddc-bb2c-2a473aca96cf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Sep 01 05:22:02.519537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 517/997] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:02 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:02.589003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5d6fcad7-c11a-46a6-833a-2144226b1b9b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:02.591175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5d6fcad7-c11a-46a6-833a-2144226b1b9b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:02.597766 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d6fcad7-c11a-46a6-833a-2144226b1b9b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.598251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d6fcad7-c11a-46a6-833a-2144226b1b9b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.598685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d6fcad7-c11a-46a6-833a-2144226b1b9b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:02.599373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d6fcad7-c11a-46a6-833a-2144226b1b9b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.599833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d6fcad7-c11a-46a6-833a-2144226b1b9b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.600257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d6fcad7-c11a-46a6-833a-2144226b1b9b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:02.631143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5d6fcad7-c11a-46a6-833a-2144226b1b9b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045932 Sep 01 05:22:02.631814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 481/998] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:02.935045 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d5920cf0-ab97-4554-85d6-212cf39c5535 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:02.935652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d5920cf0-ab97-4554-85d6-212cf39c5535 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:02.942478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5920cf0-ab97-4554-85d6-212cf39c5535 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.942951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5920cf0-ab97-4554-85d6-212cf39c5535 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.943382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5920cf0-ab97-4554-85d6-212cf39c5535 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:02.944053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5920cf0-ab97-4554-85d6-212cf39c5535 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.944501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5920cf0-ab97-4554-85d6-212cf39c5535 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.944955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5920cf0-ab97-4554-85d6-212cf39c5535 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:03.006718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d5920cf0-ab97-4554-85d6-212cf39c5535 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:03.014349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d5920cf0-ab97-4554-85d6-212cf39c5535 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083243 Sep 01 05:22:03.014908 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 518/999] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:02 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:03.530774 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9f739205-a781-4d08-a075-da90b33a5c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:03.533606 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9f739205-a781-4d08-a075-da90b33a5c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:03.539536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f739205-a781-4d08-a075-da90b33a5c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:03.540026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f739205-a781-4d08-a075-da90b33a5c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:03.540459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f739205-a781-4d08-a075-da90b33a5c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:03.541178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f739205-a781-4d08-a075-da90b33a5c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:03.541695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f739205-a781-4d08-a075-da90b33a5c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:03.542050 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f739205-a781-4d08-a075-da90b33a5c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:03.571739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9f739205-a781-4d08-a075-da90b33a5c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044936 Sep 01 05:22:03.572274 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 482/1000] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:03 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:03.644206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5b83ec78-278e-4eba-b010-9af5a9ab694c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:03.646347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5b83ec78-278e-4eba-b010-9af5a9ab694c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:03.652627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5b83ec78-278e-4eba-b010-9af5a9ab694c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:03.653137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5b83ec78-278e-4eba-b010-9af5a9ab694c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:03.653566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5b83ec78-278e-4eba-b010-9af5a9ab694c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:03.654237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5b83ec78-278e-4eba-b010-9af5a9ab694c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:03.654678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5b83ec78-278e-4eba-b010-9af5a9ab694c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:03.655087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5b83ec78-278e-4eba-b010-9af5a9ab694c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:03.683936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5b83ec78-278e-4eba-b010-9af5a9ab694c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044475 Sep 01 05:22:03.684476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 519/1001] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:04.036113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-67f30edf-f2cf-42ba-ad69-81636b34c09d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:04.036722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-67f30edf-f2cf-42ba-ad69-81636b34c09d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:04.043101 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67f30edf-f2cf-42ba-ad69-81636b34c09d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:04.043575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67f30edf-f2cf-42ba-ad69-81636b34c09d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:04.044005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67f30edf-f2cf-42ba-ad69-81636b34c09d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:04.044680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67f30edf-f2cf-42ba-ad69-81636b34c09d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:04.045146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67f30edf-f2cf-42ba-ad69-81636b34c09d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:04.045560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67f30edf-f2cf-42ba-ad69-81636b34c09d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:04.107511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-67f30edf-f2cf-42ba-ad69-81636b34c09d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:04.115853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-67f30edf-f2cf-42ba-ad69-81636b34c09d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084415 Sep 01 05:22:04.116407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 483/1002] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:04 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:04.584111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6514c059-0f6e-4e4c-8cd4-1c88e171c376 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:04.586150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6514c059-0f6e-4e4c-8cd4-1c88e171c376 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:04.592474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6514c059-0f6e-4e4c-8cd4-1c88e171c376 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:04.592987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6514c059-0f6e-4e4c-8cd4-1c88e171c376 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:04.593425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6514c059-0f6e-4e4c-8cd4-1c88e171c376 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:04.594615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6514c059-0f6e-4e4c-8cd4-1c88e171c376 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:04.595073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6514c059-0f6e-4e4c-8cd4-1c88e171c376 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:04.595487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6514c059-0f6e-4e4c-8cd4-1c88e171c376 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:04.625733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6514c059-0f6e-4e4c-8cd4-1c88e171c376 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045381 Sep 01 05:22:04.626366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 520/1003] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:04.696443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5bf57514-9bdd-4b77-b4fc-e8d6684b6665 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:04.698576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5bf57514-9bdd-4b77-b4fc-e8d6684b6665 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:04.704371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5bf57514-9bdd-4b77-b4fc-e8d6684b6665 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:04.704870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5bf57514-9bdd-4b77-b4fc-e8d6684b6665 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:04.705297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5bf57514-9bdd-4b77-b4fc-e8d6684b6665 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:04.705971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5bf57514-9bdd-4b77-b4fc-e8d6684b6665 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:04.706414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5bf57514-9bdd-4b77-b4fc-e8d6684b6665 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:04.706826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5bf57514-9bdd-4b77-b4fc-e8d6684b6665 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:04.737364 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5bf57514-9bdd-4b77-b4fc-e8d6684b6665 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044955 Sep 01 05:22:04.737899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 484/1004] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:05.141846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8b976d69-a436-4348-85b8-03450843d24e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:05.142453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8b976d69-a436-4348-85b8-03450843d24e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:05.149007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b976d69-a436-4348-85b8-03450843d24e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:05.149426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b976d69-a436-4348-85b8-03450843d24e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:05.149854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b976d69-a436-4348-85b8-03450843d24e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:05.150534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b976d69-a436-4348-85b8-03450843d24e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:05.150980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b976d69-a436-4348-85b8-03450843d24e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:05.151395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8b976d69-a436-4348-85b8-03450843d24e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:05.211687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8b976d69-a436-4348-85b8-03450843d24e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:05.220030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8b976d69-a436-4348-85b8-03450843d24e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082546 Sep 01 05:22:05.220607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 521/1005] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:05 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:05.637299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a4dd6295-680b-45a8-ba11-1f7578d8f024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:05.639426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a4dd6295-680b-45a8-ba11-1f7578d8f024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:05.646540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4dd6295-680b-45a8-ba11-1f7578d8f024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:05.647016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4dd6295-680b-45a8-ba11-1f7578d8f024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:05.647443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4dd6295-680b-45a8-ba11-1f7578d8f024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:05.648114 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4dd6295-680b-45a8-ba11-1f7578d8f024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:05.648555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4dd6295-680b-45a8-ba11-1f7578d8f024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:05.648993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4dd6295-680b-45a8-ba11-1f7578d8f024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:05.678091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a4dd6295-680b-45a8-ba11-1f7578d8f024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044839 Sep 01 05:22:05.678634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 485/1006] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:05 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:05.749478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2ac47124-a6ff-4be9-a0a6-cc02eb29197b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:05.752193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2ac47124-a6ff-4be9-a0a6-cc02eb29197b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:05.758181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2ac47124-a6ff-4be9-a0a6-cc02eb29197b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:05.758664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2ac47124-a6ff-4be9-a0a6-cc02eb29197b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:05.759101 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2ac47124-a6ff-4be9-a0a6-cc02eb29197b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:05.759787 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2ac47124-a6ff-4be9-a0a6-cc02eb29197b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:05.760244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2ac47124-a6ff-4be9-a0a6-cc02eb29197b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:05.760668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2ac47124-a6ff-4be9-a0a6-cc02eb29197b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:05.789059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2ac47124-a6ff-4be9-a0a6-cc02eb29197b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043527 Sep 01 05:22:05.789600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 522/1007] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:06.240499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a4ab4471-5e64-4483-9499-6a37dabbd950 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:06.241089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a4ab4471-5e64-4483-9499-6a37dabbd950 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:06.247034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4ab4471-5e64-4483-9499-6a37dabbd950 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.247513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4ab4471-5e64-4483-9499-6a37dabbd950 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.247945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4ab4471-5e64-4483-9499-6a37dabbd950 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.248624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4ab4471-5e64-4483-9499-6a37dabbd950 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.249112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4ab4471-5e64-4483-9499-6a37dabbd950 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.249527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4ab4471-5e64-4483-9499-6a37dabbd950 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.314233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a4ab4471-5e64-4483-9499-6a37dabbd950 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:06.321834 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a4ab4471-5e64-4483-9499-6a37dabbd950 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085318 Sep 01 05:22:06.322393 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 486/1008] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:06 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:06.691673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a5cf5619-a07e-4beb-a8b3-c1c5339b4024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:06.693857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a5cf5619-a07e-4beb-a8b3-c1c5339b4024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:06.700266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5cf5619-a07e-4beb-a8b3-c1c5339b4024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.700748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5cf5619-a07e-4beb-a8b3-c1c5339b4024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.701210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5cf5619-a07e-4beb-a8b3-c1c5339b4024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.701886 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5cf5619-a07e-4beb-a8b3-c1c5339b4024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.702332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5cf5619-a07e-4beb-a8b3-c1c5339b4024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.702750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5cf5619-a07e-4beb-a8b3-c1c5339b4024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.731987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a5cf5619-a07e-4beb-a8b3-c1c5339b4024 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045655 Sep 01 05:22:06.732538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 523/1009] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:06 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:06.802082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8f3c164f-897c-4098-b834-0dbf728ef105 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:06.804207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8f3c164f-897c-4098-b834-0dbf728ef105 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:06.810043 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f3c164f-897c-4098-b834-0dbf728ef105 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.810519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f3c164f-897c-4098-b834-0dbf728ef105 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.810947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f3c164f-897c-4098-b834-0dbf728ef105 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.811881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f3c164f-897c-4098-b834-0dbf728ef105 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.812324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f3c164f-897c-4098-b834-0dbf728ef105 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.813560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f3c164f-897c-4098-b834-0dbf728ef105 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.842066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8f3c164f-897c-4098-b834-0dbf728ef105 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045114 Sep 01 05:22:06.842605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 487/1010] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:07.342676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-67f677ce-41af-4118-8abd-5762416b1df0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:07.343279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-67f677ce-41af-4118-8abd-5762416b1df0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:07.349150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67f677ce-41af-4118-8abd-5762416b1df0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:07.349628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67f677ce-41af-4118-8abd-5762416b1df0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:07.350057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67f677ce-41af-4118-8abd-5762416b1df0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:07.350736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67f677ce-41af-4118-8abd-5762416b1df0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:07.351182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67f677ce-41af-4118-8abd-5762416b1df0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:07.351597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67f677ce-41af-4118-8abd-5762416b1df0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:07.415624 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-67f677ce-41af-4118-8abd-5762416b1df0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:07.424187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-67f677ce-41af-4118-8abd-5762416b1df0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085336 Sep 01 05:22:07.424753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 524/1011] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:07 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:07.746339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-86d53bbd-2f4e-4f73-8e0a-7b8d1ca07a2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:07.748476 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-86d53bbd-2f4e-4f73-8e0a-7b8d1ca07a2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:07.754436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86d53bbd-2f4e-4f73-8e0a-7b8d1ca07a2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:07.754915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86d53bbd-2f4e-4f73-8e0a-7b8d1ca07a2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:07.755349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86d53bbd-2f4e-4f73-8e0a-7b8d1ca07a2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:07.756026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86d53bbd-2f4e-4f73-8e0a-7b8d1ca07a2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:07.756475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86d53bbd-2f4e-4f73-8e0a-7b8d1ca07a2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:07.756923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86d53bbd-2f4e-4f73-8e0a-7b8d1ca07a2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:07.786127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-86d53bbd-2f4e-4f73-8e0a-7b8d1ca07a2a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043736 Sep 01 05:22:07.786667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 488/1012] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:07 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:07.854775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1d422f6e-2778-4562-abe2-6516e218baeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:07.856922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1d422f6e-2778-4562-abe2-6516e218baeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:07.864009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d422f6e-2778-4562-abe2-6516e218baeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:07.864484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d422f6e-2778-4562-abe2-6516e218baeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:07.864938 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d422f6e-2778-4562-abe2-6516e218baeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:07.865614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d422f6e-2778-4562-abe2-6516e218baeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:07.866056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d422f6e-2778-4562-abe2-6516e218baeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:07.866476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d422f6e-2778-4562-abe2-6516e218baeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:07.895652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1d422f6e-2778-4562-abe2-6516e218baeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044806 Sep 01 05:22:07.896220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 525/1013] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:07 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:08.444959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2da3fd69-ada6-46ad-8c98-70f91bbb2253 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:08.445550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2da3fd69-ada6-46ad-8c98-70f91bbb2253 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:08.451675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2da3fd69-ada6-46ad-8c98-70f91bbb2253 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:08.452153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2da3fd69-ada6-46ad-8c98-70f91bbb2253 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:08.452580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2da3fd69-ada6-46ad-8c98-70f91bbb2253 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:08.453320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2da3fd69-ada6-46ad-8c98-70f91bbb2253 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:08.453728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2da3fd69-ada6-46ad-8c98-70f91bbb2253 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:08.454150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2da3fd69-ada6-46ad-8c98-70f91bbb2253 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:08.515987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2da3fd69-ada6-46ad-8c98-70f91bbb2253 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:08.523601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2da3fd69-ada6-46ad-8c98-70f91bbb2253 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082560 Sep 01 05:22:08.524149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 489/1014] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:08 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:08.799181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ab2e667c-509c-4a62-9497-bcbfadc2b872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:08.801285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ab2e667c-509c-4a62-9497-bcbfadc2b872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:08.807236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab2e667c-509c-4a62-9497-bcbfadc2b872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:08.807744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab2e667c-509c-4a62-9497-bcbfadc2b872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:08.808167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab2e667c-509c-4a62-9497-bcbfadc2b872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:08.808863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab2e667c-509c-4a62-9497-bcbfadc2b872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:08.809308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab2e667c-509c-4a62-9497-bcbfadc2b872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:08.809720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab2e667c-509c-4a62-9497-bcbfadc2b872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:08.839517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ab2e667c-509c-4a62-9497-bcbfadc2b872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045139 Sep 01 05:22:08.840058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 526/1015] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:08 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:08.907929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-370d9958-00f0-4b88-88ef-76bd4a9270fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:08.910107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-370d9958-00f0-4b88-88ef-76bd4a9270fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:08.916045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-370d9958-00f0-4b88-88ef-76bd4a9270fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:08.916555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-370d9958-00f0-4b88-88ef-76bd4a9270fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:08.917016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-370d9958-00f0-4b88-88ef-76bd4a9270fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:08.917710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-370d9958-00f0-4b88-88ef-76bd4a9270fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:08.918154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-370d9958-00f0-4b88-88ef-76bd4a9270fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:08.918567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-370d9958-00f0-4b88-88ef-76bd4a9270fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:08.948838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-370d9958-00f0-4b88-88ef-76bd4a9270fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045169 Sep 01 05:22:08.949382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 490/1016] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:09.545321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1ba8895b-671c-428a-bf92-4ce815a9264d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:09.545929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1ba8895b-671c-428a-bf92-4ce815a9264d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:09.552291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba8895b-671c-428a-bf92-4ce815a9264d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:09.552762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba8895b-671c-428a-bf92-4ce815a9264d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:09.553214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba8895b-671c-428a-bf92-4ce815a9264d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:09.553888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba8895b-671c-428a-bf92-4ce815a9264d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:09.554332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba8895b-671c-428a-bf92-4ce815a9264d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:09.554745 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba8895b-671c-428a-bf92-4ce815a9264d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:09.615527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1ba8895b-671c-428a-bf92-4ce815a9264d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:09.623030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1ba8895b-671c-428a-bf92-4ce815a9264d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081560 Sep 01 05:22:09.623586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 527/1017] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:09 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:09.851679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2e98aa55-67c8-436f-8573-199684010725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:09.853956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2e98aa55-67c8-436f-8573-199684010725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:09.862643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e98aa55-67c8-436f-8573-199684010725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:09.863123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e98aa55-67c8-436f-8573-199684010725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:09.863853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e98aa55-67c8-436f-8573-199684010725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:09.864559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e98aa55-67c8-436f-8573-199684010725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:09.865234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e98aa55-67c8-436f-8573-199684010725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:09.865743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e98aa55-67c8-436f-8573-199684010725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:09.879189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:09.895452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2e98aa55-67c8-436f-8573-199684010725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047682 Sep 01 05:22:09.895907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 491/1018] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:09 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:09.961122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9b8812e5-52fd-4730-b316-a8a2194e6102 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:09.963258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9b8812e5-52fd-4730-b316-a8a2194e6102 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:09.969710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b8812e5-52fd-4730-b316-a8a2194e6102 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:09.970186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b8812e5-52fd-4730-b316-a8a2194e6102 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:09.970615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b8812e5-52fd-4730-b316-a8a2194e6102 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:09.971336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b8812e5-52fd-4730-b316-a8a2194e6102 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:09.971782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b8812e5-52fd-4730-b316-a8a2194e6102 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:09.972199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b8812e5-52fd-4730-b316-a8a2194e6102 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.001047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9b8812e5-52fd-4730-b316-a8a2194e6102 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043921 Sep 01 05:22:10.001593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 528/1019] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:09 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:10.644199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7bf0ec37-b2f6-4e6f-86bf-d7332e5496df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:10.644839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7bf0ec37-b2f6-4e6f-86bf-d7332e5496df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:10.650999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7bf0ec37-b2f6-4e6f-86bf-d7332e5496df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.651518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7bf0ec37-b2f6-4e6f-86bf-d7332e5496df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.651944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7bf0ec37-b2f6-4e6f-86bf-d7332e5496df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.652616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7bf0ec37-b2f6-4e6f-86bf-d7332e5496df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.653086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7bf0ec37-b2f6-4e6f-86bf-d7332e5496df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.653500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7bf0ec37-b2f6-4e6f-86bf-d7332e5496df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.717947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7bf0ec37-b2f6-4e6f-86bf-d7332e5496df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:10.725836 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7bf0ec37-b2f6-4e6f-86bf-d7332e5496df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086269 Sep 01 05:22:10.726388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 492/1020] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:10 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:10.907545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a76af47e-995d-4899-853a-566650034c38 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:10.909697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a76af47e-995d-4899-853a-566650034c38 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:10.916657 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a76af47e-995d-4899-853a-566650034c38 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.917230 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a76af47e-995d-4899-853a-566650034c38 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.917666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a76af47e-995d-4899-853a-566650034c38 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.918352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a76af47e-995d-4899-853a-566650034c38 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.918798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a76af47e-995d-4899-853a-566650034c38 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.919247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a76af47e-995d-4899-853a-566650034c38 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.921700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:10.952602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a76af47e-995d-4899-853a-566650034c38 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048946 Sep 01 05:22:10.953180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 529/1021] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:11.013384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-88a87343-32ab-4b10-b862-b6debf477dba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:11.015611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-88a87343-32ab-4b10-b862-b6debf477dba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:11.022070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-88a87343-32ab-4b10-b862-b6debf477dba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:11.022553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-88a87343-32ab-4b10-b862-b6debf477dba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:11.022989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-88a87343-32ab-4b10-b862-b6debf477dba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:11.023676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-88a87343-32ab-4b10-b862-b6debf477dba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:11.024128 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-88a87343-32ab-4b10-b862-b6debf477dba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:11.024550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-88a87343-32ab-4b10-b862-b6debf477dba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:11.053618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-88a87343-32ab-4b10-b862-b6debf477dba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044238 Sep 01 05:22:11.054160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 493/1022] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:11.747252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ae75a191-de3b-482f-b342-8d1fe3417b08 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:11.747861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ae75a191-de3b-482f-b342-8d1fe3417b08 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:11.754478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae75a191-de3b-482f-b342-8d1fe3417b08 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:11.754956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae75a191-de3b-482f-b342-8d1fe3417b08 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:11.755388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae75a191-de3b-482f-b342-8d1fe3417b08 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:11.756067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae75a191-de3b-482f-b342-8d1fe3417b08 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:11.756511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae75a191-de3b-482f-b342-8d1fe3417b08 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:11.756962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae75a191-de3b-482f-b342-8d1fe3417b08 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:11.817447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ae75a191-de3b-482f-b342-8d1fe3417b08 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:11.825111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ae75a191-de3b-482f-b342-8d1fe3417b08 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081690 Sep 01 05:22:11.825672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 530/1023] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:11 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:11.965686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a7e48c2f-7d62-45bf-88b0-d7b5e0c4233a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:11.967804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a7e48c2f-7d62-45bf-88b0-d7b5e0c4233a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:11.973910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7e48c2f-7d62-45bf-88b0-d7b5e0c4233a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:11.974386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7e48c2f-7d62-45bf-88b0-d7b5e0c4233a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:11.974817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7e48c2f-7d62-45bf-88b0-d7b5e0c4233a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:11.975493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7e48c2f-7d62-45bf-88b0-d7b5e0c4233a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:11.975939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7e48c2f-7d62-45bf-88b0-d7b5e0c4233a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:11.976357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7e48c2f-7d62-45bf-88b0-d7b5e0c4233a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:12.006449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a7e48c2f-7d62-45bf-88b0-d7b5e0c4233a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Sep 01 05:22:12.006982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 494/1024] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:11 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:12.066930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ff91e528-2e83-4302-8b38-b42736e6240e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:12.068998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ff91e528-2e83-4302-8b38-b42736e6240e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:12.075311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff91e528-2e83-4302-8b38-b42736e6240e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:12.075784 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff91e528-2e83-4302-8b38-b42736e6240e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:12.076216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff91e528-2e83-4302-8b38-b42736e6240e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:12.076919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff91e528-2e83-4302-8b38-b42736e6240e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:12.077363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff91e528-2e83-4302-8b38-b42736e6240e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:12.077775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff91e528-2e83-4302-8b38-b42736e6240e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:12.107674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ff91e528-2e83-4302-8b38-b42736e6240e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045826 Sep 01 05:22:12.108227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 531/1025] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:12 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:12.845847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c716164a-e1cd-43b1-8f16-470396f263a0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:12.846468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c716164a-e1cd-43b1-8f16-470396f263a0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:12.852819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c716164a-e1cd-43b1-8f16-470396f263a0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:12.853304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c716164a-e1cd-43b1-8f16-470396f263a0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:12.853737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c716164a-e1cd-43b1-8f16-470396f263a0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:12.854417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c716164a-e1cd-43b1-8f16-470396f263a0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:12.854869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c716164a-e1cd-43b1-8f16-470396f263a0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:12.855289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c716164a-e1cd-43b1-8f16-470396f263a0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:12.917612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c716164a-e1cd-43b1-8f16-470396f263a0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:12.926104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c716164a-e1cd-43b1-8f16-470396f263a0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085236 Sep 01 05:22:12.926666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 495/1026] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:12 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:13.018892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7346c838-0278-41d7-abc9-56e8bacb648b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:13.021696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7346c838-0278-41d7-abc9-56e8bacb648b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:13.027611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7346c838-0278-41d7-abc9-56e8bacb648b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:13.028088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7346c838-0278-41d7-abc9-56e8bacb648b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:13.028533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7346c838-0278-41d7-abc9-56e8bacb648b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:13.029240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7346c838-0278-41d7-abc9-56e8bacb648b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:13.029685 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7346c838-0278-41d7-abc9-56e8bacb648b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:13.030111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7346c838-0278-41d7-abc9-56e8bacb648b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:13.058795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7346c838-0278-41d7-abc9-56e8bacb648b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044015 Sep 01 05:22:13.059338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 532/1027] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:13.120519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8f1983d4-1023-4cde-aed9-f3209cd74a1d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:13.122606 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8f1983d4-1023-4cde-aed9-f3209cd74a1d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:13.129308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f1983d4-1023-4cde-aed9-f3209cd74a1d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:13.129786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f1983d4-1023-4cde-aed9-f3209cd74a1d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:13.130217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f1983d4-1023-4cde-aed9-f3209cd74a1d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:13.130898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f1983d4-1023-4cde-aed9-f3209cd74a1d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:13.131345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f1983d4-1023-4cde-aed9-f3209cd74a1d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:13.131767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f1983d4-1023-4cde-aed9-f3209cd74a1d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:13.161411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8f1983d4-1023-4cde-aed9-f3209cd74a1d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044856 Sep 01 05:22:13.161960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 496/1028] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:13 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:13.947603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-51fd0556-0818-415f-be82-29b875bcacb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:13.948245 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-51fd0556-0818-415f-be82-29b875bcacb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:13.954914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-51fd0556-0818-415f-be82-29b875bcacb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:13.955398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-51fd0556-0818-415f-be82-29b875bcacb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:13.955833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-51fd0556-0818-415f-be82-29b875bcacb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:13.956515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-51fd0556-0818-415f-be82-29b875bcacb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:13.957007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-51fd0556-0818-415f-be82-29b875bcacb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:13.957432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-51fd0556-0818-415f-be82-29b875bcacb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:14.019861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-51fd0556-0818-415f-be82-29b875bcacb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:14.027995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-51fd0556-0818-415f-be82-29b875bcacb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084303 Sep 01 05:22:14.028565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 533/1029] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:13 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:14.071568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a74e3b95-a895-40a5-a3e7-b3d5f4ef11c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:14.073844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a74e3b95-a895-40a5-a3e7-b3d5f4ef11c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:14.080349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a74e3b95-a895-40a5-a3e7-b3d5f4ef11c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:14.080861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a74e3b95-a895-40a5-a3e7-b3d5f4ef11c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:14.081298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a74e3b95-a895-40a5-a3e7-b3d5f4ef11c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:14.081981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a74e3b95-a895-40a5-a3e7-b3d5f4ef11c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:14.082428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a74e3b95-a895-40a5-a3e7-b3d5f4ef11c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:14.082847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a74e3b95-a895-40a5-a3e7-b3d5f4ef11c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:14.112918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a74e3b95-a895-40a5-a3e7-b3d5f4ef11c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045244 Sep 01 05:22:14.113473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 497/1030] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:14 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:14.174410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-13671e2b-ca12-4e32-81fa-b7c60141be45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:14.176514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-13671e2b-ca12-4e32-81fa-b7c60141be45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:14.182422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13671e2b-ca12-4e32-81fa-b7c60141be45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:14.182902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13671e2b-ca12-4e32-81fa-b7c60141be45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:14.183333 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13671e2b-ca12-4e32-81fa-b7c60141be45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:14.184012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13671e2b-ca12-4e32-81fa-b7c60141be45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:14.184462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13671e2b-ca12-4e32-81fa-b7c60141be45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:14.184910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13671e2b-ca12-4e32-81fa-b7c60141be45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:14.215289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-13671e2b-ca12-4e32-81fa-b7c60141be45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045895 Sep 01 05:22:14.215832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 534/1031] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:15.049173 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-293b77d0-db3e-445f-b83c-154bd16e10c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:15.049792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-293b77d0-db3e-445f-b83c-154bd16e10c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:15.055676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-293b77d0-db3e-445f-b83c-154bd16e10c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:15.056158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-293b77d0-db3e-445f-b83c-154bd16e10c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:15.056594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-293b77d0-db3e-445f-b83c-154bd16e10c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:15.057313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-293b77d0-db3e-445f-b83c-154bd16e10c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:15.057766 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-293b77d0-db3e-445f-b83c-154bd16e10c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:15.058188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-293b77d0-db3e-445f-b83c-154bd16e10c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:15.124508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-293b77d0-db3e-445f-b83c-154bd16e10c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:15.125133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9bd11ac4-ad1b-4992-a65b-feac2e004eb1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:15.127688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9bd11ac4-ad1b-4992-a65b-feac2e004eb1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:15.131674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-293b77d0-db3e-445f-b83c-154bd16e10c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086388 Sep 01 05:22:15.132243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 498/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:15 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:15.134305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9bd11ac4-ad1b-4992-a65b-feac2e004eb1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:15.134792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9bd11ac4-ad1b-4992-a65b-feac2e004eb1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:15.135351 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9bd11ac4-ad1b-4992-a65b-feac2e004eb1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:15.136048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9bd11ac4-ad1b-4992-a65b-feac2e004eb1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:15.136514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9bd11ac4-ad1b-4992-a65b-feac2e004eb1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:15.136956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9bd11ac4-ad1b-4992-a65b-feac2e004eb1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:15.166934 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9bd11ac4-ad1b-4992-a65b-feac2e004eb1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045971 Sep 01 05:22:15.167406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 535/1033] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:15.227613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ff6185d6-ab92-4c2f-96b5-1fa16547c550 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:15.229759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ff6185d6-ab92-4c2f-96b5-1fa16547c550 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:15.235786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff6185d6-ab92-4c2f-96b5-1fa16547c550 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:15.236261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff6185d6-ab92-4c2f-96b5-1fa16547c550 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:15.236689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff6185d6-ab92-4c2f-96b5-1fa16547c550 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:15.237388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff6185d6-ab92-4c2f-96b5-1fa16547c550 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:15.237835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff6185d6-ab92-4c2f-96b5-1fa16547c550 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:15.238248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff6185d6-ab92-4c2f-96b5-1fa16547c550 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:15.268324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ff6185d6-ab92-4c2f-96b5-1fa16547c550 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044650 Sep 01 05:22:15.268883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 499/1034] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:16.153638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9e93f41a-107d-4042-82f4-baf28a8f0303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:16.154157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9e93f41a-107d-4042-82f4-baf28a8f0303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:16.161439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e93f41a-107d-4042-82f4-baf28a8f0303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:16.161916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e93f41a-107d-4042-82f4-baf28a8f0303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:16.162349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e93f41a-107d-4042-82f4-baf28a8f0303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:16.163039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e93f41a-107d-4042-82f4-baf28a8f0303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:16.163478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e93f41a-107d-4042-82f4-baf28a8f0303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:16.163889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e93f41a-107d-4042-82f4-baf28a8f0303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:16.179598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c4c487a5-051b-44bb-90ee-47e63db2c1b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:16.181949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c4c487a5-051b-44bb-90ee-47e63db2c1b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:16.184235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=82 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:16.190026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4c487a5-051b-44bb-90ee-47e63db2c1b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:16.190677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4c487a5-051b-44bb-90ee-47e63db2c1b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:16.191116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4c487a5-051b-44bb-90ee-47e63db2c1b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:16.191809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4c487a5-051b-44bb-90ee-47e63db2c1b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:16.192259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4c487a5-051b-44bb-90ee-47e63db2c1b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:16.192678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4c487a5-051b-44bb-90ee-47e63db2c1b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:16.223711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c4c487a5-051b-44bb-90ee-47e63db2c1b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048054 Sep 01 05:22:16.224277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 500/1035] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:16 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:16.230275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9e93f41a-107d-4042-82f4-baf28a8f0303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:16.238856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9e93f41a-107d-4042-82f4-baf28a8f0303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.089186 Sep 01 05:22:16.239415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 536/1036] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:16 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:16.280734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fbf4dc80-5e76-48bb-86d5-2d43d8f669c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:16.283651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fbf4dc80-5e76-48bb-86d5-2d43d8f669c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:16.290046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fbf4dc80-5e76-48bb-86d5-2d43d8f669c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:16.290565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fbf4dc80-5e76-48bb-86d5-2d43d8f669c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:16.291189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fbf4dc80-5e76-48bb-86d5-2d43d8f669c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:16.291879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fbf4dc80-5e76-48bb-86d5-2d43d8f669c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:16.292330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fbf4dc80-5e76-48bb-86d5-2d43d8f669c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:16.292750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fbf4dc80-5e76-48bb-86d5-2d43d8f669c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:16.322611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fbf4dc80-5e76-48bb-86d5-2d43d8f669c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045766 Sep 01 05:22:16.323173 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 501/1037] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:16 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:17.236221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-324ee282-e7bf-4b42-a453-d99b11ba89a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:17.238276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-324ee282-e7bf-4b42-a453-d99b11ba89a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:17.244787 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-324ee282-e7bf-4b42-a453-d99b11ba89a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:17.245277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-324ee282-e7bf-4b42-a453-d99b11ba89a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:17.245711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-324ee282-e7bf-4b42-a453-d99b11ba89a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:17.246392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-324ee282-e7bf-4b42-a453-d99b11ba89a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:17.246838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-324ee282-e7bf-4b42-a453-d99b11ba89a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:17.247255 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-324ee282-e7bf-4b42-a453-d99b11ba89a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:17.259425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-692217d5-57eb-45ce-a36f-c974345699fd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:17.260037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-692217d5-57eb-45ce-a36f-c974345699fd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:17.266325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-692217d5-57eb-45ce-a36f-c974345699fd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:17.266798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-692217d5-57eb-45ce-a36f-c974345699fd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:17.267218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-692217d5-57eb-45ce-a36f-c974345699fd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:17.267893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-692217d5-57eb-45ce-a36f-c974345699fd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:17.268335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-692217d5-57eb-45ce-a36f-c974345699fd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:17.268744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-692217d5-57eb-45ce-a36f-c974345699fd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:17.278105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-324ee282-e7bf-4b42-a453-d99b11ba89a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046419 Sep 01 05:22:17.278666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 537/1038] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:17 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:17.330381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-692217d5-57eb-45ce-a36f-c974345699fd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:17.335018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b58ffead-1311-42e2-9d59-02c28292415e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:17.337273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b58ffead-1311-42e2-9d59-02c28292415e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:17.338086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-692217d5-57eb-45ce-a36f-c974345699fd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082443 Sep 01 05:22:17.338648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 502/1039] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:17 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:17.343544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b58ffead-1311-42e2-9d59-02c28292415e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:17.344520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b58ffead-1311-42e2-9d59-02c28292415e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:17.345592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b58ffead-1311-42e2-9d59-02c28292415e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:17.346293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b58ffead-1311-42e2-9d59-02c28292415e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:17.346747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b58ffead-1311-42e2-9d59-02c28292415e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:17.347166 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b58ffead-1311-42e2-9d59-02c28292415e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:17.377451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b58ffead-1311-42e2-9d59-02c28292415e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046376 Sep 01 05:22:17.378007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 538/1040] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:17 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:18.291469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a46bb3e3-ee6e-4716-8f2a-5df7bb21d12f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:18.293576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a46bb3e3-ee6e-4716-8f2a-5df7bb21d12f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:18.300700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a46bb3e3-ee6e-4716-8f2a-5df7bb21d12f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:18.301217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a46bb3e3-ee6e-4716-8f2a-5df7bb21d12f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:18.301654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a46bb3e3-ee6e-4716-8f2a-5df7bb21d12f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:18.302342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a46bb3e3-ee6e-4716-8f2a-5df7bb21d12f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:18.302795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a46bb3e3-ee6e-4716-8f2a-5df7bb21d12f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:18.303223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a46bb3e3-ee6e-4716-8f2a-5df7bb21d12f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:18.337202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a46bb3e3-ee6e-4716-8f2a-5df7bb21d12f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049727 Sep 01 05:22:18.337758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 503/1041] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:18 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:18.359290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d9d26f04-fe10-47f8-b518-4825d9bce090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:18.360547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d9d26f04-fe10-47f8-b518-4825d9bce090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:18.367028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9d26f04-fe10-47f8-b518-4825d9bce090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:18.367507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9d26f04-fe10-47f8-b518-4825d9bce090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:18.367934 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9d26f04-fe10-47f8-b518-4825d9bce090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:18.368606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9d26f04-fe10-47f8-b518-4825d9bce090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:18.369080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9d26f04-fe10-47f8-b518-4825d9bce090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:18.369494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d9d26f04-fe10-47f8-b518-4825d9bce090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:18.389767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c9ee5ae0-f598-44ef-8c9e-239c1d3fbad9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:18.392148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c9ee5ae0-f598-44ef-8c9e-239c1d3fbad9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:18.398205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c9ee5ae0-f598-44ef-8c9e-239c1d3fbad9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:18.398685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c9ee5ae0-f598-44ef-8c9e-239c1d3fbad9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:18.399116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c9ee5ae0-f598-44ef-8c9e-239c1d3fbad9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:18.399806 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c9ee5ae0-f598-44ef-8c9e-239c1d3fbad9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:18.400256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c9ee5ae0-f598-44ef-8c9e-239c1d3fbad9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:18.400678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c9ee5ae0-f598-44ef-8c9e-239c1d3fbad9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:18.430392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d9d26f04-fe10-47f8-b518-4825d9bce090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:18.431632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c9ee5ae0-f598-44ef-8c9e-239c1d3fbad9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045810 Sep 01 05:22:18.432202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 504/1042] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:18 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:18.439176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d9d26f04-fe10-47f8-b518-4825d9bce090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083561 Sep 01 05:22:18.439734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 539/1043] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:18 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:19.349354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bb9c49ec-5d9d-47ac-b46a-831c2bd5d5c5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:19.351493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bb9c49ec-5d9d-47ac-b46a-831c2bd5d5c5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:19.358047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bb9c49ec-5d9d-47ac-b46a-831c2bd5d5c5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:19.358623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bb9c49ec-5d9d-47ac-b46a-831c2bd5d5c5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:19.359032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bb9c49ec-5d9d-47ac-b46a-831c2bd5d5c5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:19.359764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bb9c49ec-5d9d-47ac-b46a-831c2bd5d5c5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:19.360212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bb9c49ec-5d9d-47ac-b46a-831c2bd5d5c5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:19.360633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bb9c49ec-5d9d-47ac-b46a-831c2bd5d5c5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:19.388995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bb9c49ec-5d9d-47ac-b46a-831c2bd5d5c5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043658 Sep 01 05:22:19.389535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 505/1044] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:19 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:19.444155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1ba3bc74-3a68-47d8-a520-d73c30ac6783 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:19.446277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1ba3bc74-3a68-47d8-a520-d73c30ac6783 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:19.452622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba3bc74-3a68-47d8-a520-d73c30ac6783 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:19.453133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba3bc74-3a68-47d8-a520-d73c30ac6783 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:19.454196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba3bc74-3a68-47d8-a520-d73c30ac6783 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:19.454889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba3bc74-3a68-47d8-a520-d73c30ac6783 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:19.455363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba3bc74-3a68-47d8-a520-d73c30ac6783 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:19.455779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba3bc74-3a68-47d8-a520-d73c30ac6783 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:19.459864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f3852fad-e35f-43ac-a9dc-67bb65901b0c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:19.460488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f3852fad-e35f-43ac-a9dc-67bb65901b0c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:19.466465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3852fad-e35f-43ac-a9dc-67bb65901b0c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:19.466944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3852fad-e35f-43ac-a9dc-67bb65901b0c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:19.467377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3852fad-e35f-43ac-a9dc-67bb65901b0c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:19.468096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3852fad-e35f-43ac-a9dc-67bb65901b0c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:19.468546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3852fad-e35f-43ac-a9dc-67bb65901b0c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:19.468999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3852fad-e35f-43ac-a9dc-67bb65901b0c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:19.485534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1ba3bc74-3a68-47d8-a520-d73c30ac6783 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045351 Sep 01 05:22:19.486105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 540/1045] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:19 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:19.530374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f3852fad-e35f-43ac-a9dc-67bb65901b0c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:19.538779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f3852fad-e35f-43ac-a9dc-67bb65901b0c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082807 Sep 01 05:22:19.539341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 506/1046] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:19 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:20.401230 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9cbe36d0-9b34-42c3-a964-ca567aa3e3cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:20.403356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9cbe36d0-9b34-42c3-a964-ca567aa3e3cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:20.405254 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=86 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:20.411271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9cbe36d0-9b34-42c3-a964-ca567aa3e3cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:20.411780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9cbe36d0-9b34-42c3-a964-ca567aa3e3cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:20.412216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9cbe36d0-9b34-42c3-a964-ca567aa3e3cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:20.412934 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9cbe36d0-9b34-42c3-a964-ca567aa3e3cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:20.413387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9cbe36d0-9b34-42c3-a964-ca567aa3e3cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:20.413807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9cbe36d0-9b34-42c3-a964-ca567aa3e3cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:20.443322 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9cbe36d0-9b34-42c3-a964-ca567aa3e3cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046090 Sep 01 05:22:20.443873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 541/1047] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:20 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:20.498225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-85330c36-b999-481f-9839-214bed869aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:20.500365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-85330c36-b999-481f-9839-214bed869aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:20.506886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85330c36-b999-481f-9839-214bed869aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:20.507358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85330c36-b999-481f-9839-214bed869aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:20.507779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85330c36-b999-481f-9839-214bed869aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:20.508451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85330c36-b999-481f-9839-214bed869aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:20.508924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85330c36-b999-481f-9839-214bed869aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:20.509339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-85330c36-b999-481f-9839-214bed869aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:20.539155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-85330c36-b999-481f-9839-214bed869aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045260 Sep 01 05:22:20.539696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 507/1048] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:20.559272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2f327a7a-8190-48af-818d-db9342582b00 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:20.559876 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2f327a7a-8190-48af-818d-db9342582b00 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:20.566577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2f327a7a-8190-48af-818d-db9342582b00 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:20.567049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2f327a7a-8190-48af-818d-db9342582b00 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:20.567475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2f327a7a-8190-48af-818d-db9342582b00 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:20.568148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2f327a7a-8190-48af-818d-db9342582b00 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:20.568591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2f327a7a-8190-48af-818d-db9342582b00 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:20.569034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2f327a7a-8190-48af-818d-db9342582b00 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:20.629594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2f327a7a-8190-48af-818d-db9342582b00 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:20.637064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2f327a7a-8190-48af-818d-db9342582b00 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081579 Sep 01 05:22:20.637618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 542/1049] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:20 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:21.455641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e45c9101-1200-4c21-a3d9-3e6916953a04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:21.457712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e45c9101-1200-4c21-a3d9-3e6916953a04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:21.463590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e45c9101-1200-4c21-a3d9-3e6916953a04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:21.464122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e45c9101-1200-4c21-a3d9-3e6916953a04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:21.464551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e45c9101-1200-4c21-a3d9-3e6916953a04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:21.465246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e45c9101-1200-4c21-a3d9-3e6916953a04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:21.465693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e45c9101-1200-4c21-a3d9-3e6916953a04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:21.466107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e45c9101-1200-4c21-a3d9-3e6916953a04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:21.470201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:21.496487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e45c9101-1200-4c21-a3d9-3e6916953a04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044952 Sep 01 05:22:21.497050 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 508/1050] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:21 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:21.551450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e0f3d1a1-81e3-445e-83b6-f6e41a4f70b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:21.553596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e0f3d1a1-81e3-445e-83b6-f6e41a4f70b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:21.559511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0f3d1a1-81e3-445e-83b6-f6e41a4f70b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:21.560055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0f3d1a1-81e3-445e-83b6-f6e41a4f70b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:21.560402 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0f3d1a1-81e3-445e-83b6-f6e41a4f70b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:21.561107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0f3d1a1-81e3-445e-83b6-f6e41a4f70b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:21.561554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0f3d1a1-81e3-445e-83b6-f6e41a4f70b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:21.561971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0f3d1a1-81e3-445e-83b6-f6e41a4f70b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:21.592035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e0f3d1a1-81e3-445e-83b6-f6e41a4f70b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044628 Sep 01 05:22:21.592575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 543/1051] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:21 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:21.658460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-44b5b563-b7e6-47a5-9af0-46a98ad86e4c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:21.659062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-44b5b563-b7e6-47a5-9af0-46a98ad86e4c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:21.665432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44b5b563-b7e6-47a5-9af0-46a98ad86e4c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:21.665907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44b5b563-b7e6-47a5-9af0-46a98ad86e4c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:21.666333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44b5b563-b7e6-47a5-9af0-46a98ad86e4c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:21.667004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44b5b563-b7e6-47a5-9af0-46a98ad86e4c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:21.667448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44b5b563-b7e6-47a5-9af0-46a98ad86e4c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:21.667862 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44b5b563-b7e6-47a5-9af0-46a98ad86e4c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:21.730467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-44b5b563-b7e6-47a5-9af0-46a98ad86e4c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:21.738826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-44b5b563-b7e6-47a5-9af0-46a98ad86e4c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084789 Sep 01 05:22:21.739383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 509/1052] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:21 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:22.509008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d701e869-517d-4d37-aa2e-711f02036504 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:22.511221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d701e869-517d-4d37-aa2e-711f02036504 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:22.517702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d701e869-517d-4d37-aa2e-711f02036504 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:22.518177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d701e869-517d-4d37-aa2e-711f02036504 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:22.518608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d701e869-517d-4d37-aa2e-711f02036504 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:22.519284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d701e869-517d-4d37-aa2e-711f02036504 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:22.519728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d701e869-517d-4d37-aa2e-711f02036504 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:22.520146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d701e869-517d-4d37-aa2e-711f02036504 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:22.550073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d701e869-517d-4d37-aa2e-711f02036504 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Sep 01 05:22:22.550538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 544/1053] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:22 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:22.605132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d5d126a0-4716-4552-ad86-7047c6f7cf7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:22.607300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d5d126a0-4716-4552-ad86-7047c6f7cf7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:22.613478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5d126a0-4716-4552-ad86-7047c6f7cf7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:22.613956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5d126a0-4716-4552-ad86-7047c6f7cf7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:22.614389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5d126a0-4716-4552-ad86-7047c6f7cf7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:22.615068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5d126a0-4716-4552-ad86-7047c6f7cf7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:22.615513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5d126a0-4716-4552-ad86-7047c6f7cf7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:22.615948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5d126a0-4716-4552-ad86-7047c6f7cf7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:22.645795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d5d126a0-4716-4552-ad86-7047c6f7cf7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044602 Sep 01 05:22:22.646532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 510/1054] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:22.759337 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-93ef01cd-f77c-435f-8528-ee8e202170e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:22.759943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-93ef01cd-f77c-435f-8528-ee8e202170e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:22.766952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93ef01cd-f77c-435f-8528-ee8e202170e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:22.767425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93ef01cd-f77c-435f-8528-ee8e202170e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:22.767848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93ef01cd-f77c-435f-8528-ee8e202170e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:22.768518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93ef01cd-f77c-435f-8528-ee8e202170e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:22.768990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93ef01cd-f77c-435f-8528-ee8e202170e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:22.769405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93ef01cd-f77c-435f-8528-ee8e202170e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:22.831062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-93ef01cd-f77c-435f-8528-ee8e202170e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:22.833266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:22.840140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-93ef01cd-f77c-435f-8528-ee8e202170e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084614 Sep 01 05:22:22.840703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 545/1055] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:22 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:23.562429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7e2aef2e-c1df-4f0d-a70f-76bbe108608c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:23.564762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7e2aef2e-c1df-4f0d-a70f-76bbe108608c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:23.571170 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e2aef2e-c1df-4f0d-a70f-76bbe108608c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:23.571651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e2aef2e-c1df-4f0d-a70f-76bbe108608c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:23.572087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e2aef2e-c1df-4f0d-a70f-76bbe108608c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:23.572768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e2aef2e-c1df-4f0d-a70f-76bbe108608c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:23.573247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e2aef2e-c1df-4f0d-a70f-76bbe108608c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:23.573668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e2aef2e-c1df-4f0d-a70f-76bbe108608c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:23.602630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7e2aef2e-c1df-4f0d-a70f-76bbe108608c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Sep 01 05:22:23.603171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 511/1056] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:23 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:23.658560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-19affa61-e7d6-4f73-b4be-9e9f687b0d99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:23.660688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-19affa61-e7d6-4f73-b4be-9e9f687b0d99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:23.666813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19affa61-e7d6-4f73-b4be-9e9f687b0d99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:23.667295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19affa61-e7d6-4f73-b4be-9e9f687b0d99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:23.667734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19affa61-e7d6-4f73-b4be-9e9f687b0d99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:23.668421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19affa61-e7d6-4f73-b4be-9e9f687b0d99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:23.668908 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19affa61-e7d6-4f73-b4be-9e9f687b0d99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:23.669333 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19affa61-e7d6-4f73-b4be-9e9f687b0d99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:23.699949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-19affa61-e7d6-4f73-b4be-9e9f687b0d99 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045921 Sep 01 05:22:23.700497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 546/1057] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:23.861261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8058abb4-478c-40ce-931c-991d24fdce63 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:23.861878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8058abb4-478c-40ce-931c-991d24fdce63 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:23.867993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8058abb4-478c-40ce-931c-991d24fdce63 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:23.868507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8058abb4-478c-40ce-931c-991d24fdce63 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:23.869055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8058abb4-478c-40ce-931c-991d24fdce63 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:23.869777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8058abb4-478c-40ce-931c-991d24fdce63 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:23.870231 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8058abb4-478c-40ce-931c-991d24fdce63 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:23.870651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8058abb4-478c-40ce-931c-991d24fdce63 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:23.934752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8058abb4-478c-40ce-931c-991d24fdce63 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:23.943262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8058abb4-478c-40ce-931c-991d24fdce63 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086247 Sep 01 05:22:23.943823 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 512/1058] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:23 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:24.614954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c806c3e8-5bcd-44ab-9193-2b6dbb15b0a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:24.617000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c806c3e8-5bcd-44ab-9193-2b6dbb15b0a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:24.623301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c806c3e8-5bcd-44ab-9193-2b6dbb15b0a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:24.623773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c806c3e8-5bcd-44ab-9193-2b6dbb15b0a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:24.624203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c806c3e8-5bcd-44ab-9193-2b6dbb15b0a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:24.624898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c806c3e8-5bcd-44ab-9193-2b6dbb15b0a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:24.625350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c806c3e8-5bcd-44ab-9193-2b6dbb15b0a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:24.625830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c806c3e8-5bcd-44ab-9193-2b6dbb15b0a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:24.654900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c806c3e8-5bcd-44ab-9193-2b6dbb15b0a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Sep 01 05:22:24.655447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 547/1059] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:24 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:24.712072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7e89d178-d74d-4676-86e0-bbe2dde81431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:24.714216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7e89d178-d74d-4676-86e0-bbe2dde81431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:24.721417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e89d178-d74d-4676-86e0-bbe2dde81431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:24.721891 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e89d178-d74d-4676-86e0-bbe2dde81431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:24.722321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e89d178-d74d-4676-86e0-bbe2dde81431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:24.722995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e89d178-d74d-4676-86e0-bbe2dde81431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:24.723436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e89d178-d74d-4676-86e0-bbe2dde81431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:24.723850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e89d178-d74d-4676-86e0-bbe2dde81431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:24.755169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7e89d178-d74d-4676-86e0-bbe2dde81431 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046958 Sep 01 05:22:24.755717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 513/1060] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:24.964205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c6113266-00e8-41f3-8eec-d5baba163f96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:24.964830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c6113266-00e8-41f3-8eec-d5baba163f96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:24.972033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6113266-00e8-41f3-8eec-d5baba163f96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:24.972546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6113266-00e8-41f3-8eec-d5baba163f96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:24.973064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6113266-00e8-41f3-8eec-d5baba163f96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:24.973744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6113266-00e8-41f3-8eec-d5baba163f96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:24.974186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6113266-00e8-41f3-8eec-d5baba163f96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:24.974601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6113266-00e8-41f3-8eec-d5baba163f96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:25.037586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c6113266-00e8-41f3-8eec-d5baba163f96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:25.045175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c6113266-00e8-41f3-8eec-d5baba163f96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084923 Sep 01 05:22:25.045729 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 548/1061] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:24 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:25.667740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0b5075a6-0656-414e-8751-8e4b654f04a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:25.669925 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0b5075a6-0656-414e-8751-8e4b654f04a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:25.676756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b5075a6-0656-414e-8751-8e4b654f04a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:25.677258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b5075a6-0656-414e-8751-8e4b654f04a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:25.677690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b5075a6-0656-414e-8751-8e4b654f04a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:25.678409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b5075a6-0656-414e-8751-8e4b654f04a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:25.678856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b5075a6-0656-414e-8751-8e4b654f04a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:25.679278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b5075a6-0656-414e-8751-8e4b654f04a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:25.708420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0b5075a6-0656-414e-8751-8e4b654f04a7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Sep 01 05:22:25.708995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 514/1062] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:25 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:25.768249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-44d7b8ae-08ed-447d-923f-bb96c28b0e12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:25.770408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-44d7b8ae-08ed-447d-923f-bb96c28b0e12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:25.776880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44d7b8ae-08ed-447d-923f-bb96c28b0e12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:25.777353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44d7b8ae-08ed-447d-923f-bb96c28b0e12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:25.777781 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44d7b8ae-08ed-447d-923f-bb96c28b0e12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:25.778450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44d7b8ae-08ed-447d-923f-bb96c28b0e12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:25.778889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44d7b8ae-08ed-447d-923f-bb96c28b0e12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:25.779324 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44d7b8ae-08ed-447d-923f-bb96c28b0e12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:25.809518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-44d7b8ae-08ed-447d-923f-bb96c28b0e12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045866 Sep 01 05:22:25.809998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 549/1063] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:26.066217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6f52da60-1553-4b5e-95b9-4d8ae8c97ede tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:26.066779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6f52da60-1553-4b5e-95b9-4d8ae8c97ede tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:26.073307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f52da60-1553-4b5e-95b9-4d8ae8c97ede tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:26.073799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f52da60-1553-4b5e-95b9-4d8ae8c97ede tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:26.074233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f52da60-1553-4b5e-95b9-4d8ae8c97ede tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:26.074920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f52da60-1553-4b5e-95b9-4d8ae8c97ede tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:26.075374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f52da60-1553-4b5e-95b9-4d8ae8c97ede tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:26.075794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f52da60-1553-4b5e-95b9-4d8ae8c97ede tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:26.140305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6f52da60-1553-4b5e-95b9-4d8ae8c97ede tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:26.148205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6f52da60-1553-4b5e-95b9-4d8ae8c97ede tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085992 Sep 01 05:22:26.148792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 515/1064] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:26 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:26.720934 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-961bef7e-0bd0-4028-8b24-72f4e03e6bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:26.723041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-961bef7e-0bd0-4028-8b24-72f4e03e6bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:26.728961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-961bef7e-0bd0-4028-8b24-72f4e03e6bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:26.729440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-961bef7e-0bd0-4028-8b24-72f4e03e6bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:26.729880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-961bef7e-0bd0-4028-8b24-72f4e03e6bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:26.730553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-961bef7e-0bd0-4028-8b24-72f4e03e6bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:26.731024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-961bef7e-0bd0-4028-8b24-72f4e03e6bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:26.731438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-961bef7e-0bd0-4028-8b24-72f4e03e6bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:26.760757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-961bef7e-0bd0-4028-8b24-72f4e03e6bdf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044067 Sep 01 05:22:26.761316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 550/1065] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:26 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:26.822134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e6ea05f1-0c02-43d9-821b-0529456c226c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:26.824272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e6ea05f1-0c02-43d9-821b-0529456c226c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:26.830444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6ea05f1-0c02-43d9-821b-0529456c226c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:26.830922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6ea05f1-0c02-43d9-821b-0529456c226c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:26.831356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6ea05f1-0c02-43d9-821b-0529456c226c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:26.832034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6ea05f1-0c02-43d9-821b-0529456c226c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:26.832482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6ea05f1-0c02-43d9-821b-0529456c226c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:26.832930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6ea05f1-0c02-43d9-821b-0529456c226c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:26.862749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e6ea05f1-0c02-43d9-821b-0529456c226c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044687 Sep 01 05:22:26.863287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 516/1066] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:27.168732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bdb2502f-afc2-4f18-b1d4-26a750547932 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:27.169377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bdb2502f-afc2-4f18-b1d4-26a750547932 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:27.176443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bdb2502f-afc2-4f18-b1d4-26a750547932 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:27.176963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bdb2502f-afc2-4f18-b1d4-26a750547932 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:27.177398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bdb2502f-afc2-4f18-b1d4-26a750547932 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:27.178082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bdb2502f-afc2-4f18-b1d4-26a750547932 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:27.178532 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bdb2502f-afc2-4f18-b1d4-26a750547932 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:27.178954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bdb2502f-afc2-4f18-b1d4-26a750547932 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:27.240142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bdb2502f-afc2-4f18-b1d4-26a750547932 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:27.247758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bdb2502f-afc2-4f18-b1d4-26a750547932 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082911 Sep 01 05:22:27.248320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 551/1067] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:27 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:27.773397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-167f4641-3056-4491-aaa9-c848606793e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:27.775565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-167f4641-3056-4491-aaa9-c848606793e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:27.781918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-167f4641-3056-4491-aaa9-c848606793e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:27.782386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-167f4641-3056-4491-aaa9-c848606793e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:27.782812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-167f4641-3056-4491-aaa9-c848606793e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:27.785713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-167f4641-3056-4491-aaa9-c848606793e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:27.786172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-167f4641-3056-4491-aaa9-c848606793e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:27.786592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-167f4641-3056-4491-aaa9-c848606793e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:27.815588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-167f4641-3056-4491-aaa9-c848606793e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046056 Sep 01 05:22:27.816059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 517/1068] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:27 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:27.874656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d8339f83-baec-4a62-a925-07249e3dd223 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:27.877342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d8339f83-baec-4a62-a925-07249e3dd223 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:27.883466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8339f83-baec-4a62-a925-07249e3dd223 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:27.883941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8339f83-baec-4a62-a925-07249e3dd223 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:27.884372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8339f83-baec-4a62-a925-07249e3dd223 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:27.885078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8339f83-baec-4a62-a925-07249e3dd223 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:27.885527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8339f83-baec-4a62-a925-07249e3dd223 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:27.885944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8339f83-baec-4a62-a925-07249e3dd223 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:27.916165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d8339f83-baec-4a62-a925-07249e3dd223 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045429 Sep 01 05:22:27.916725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 552/1069] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:27 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:28.267465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0e55744d-ac38-41e3-9a39-7a28639c5ea6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:28.268164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0e55744d-ac38-41e3-9a39-7a28639c5ea6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:28.274040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0e55744d-ac38-41e3-9a39-7a28639c5ea6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:28.274505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0e55744d-ac38-41e3-9a39-7a28639c5ea6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:28.274955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0e55744d-ac38-41e3-9a39-7a28639c5ea6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:28.275623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0e55744d-ac38-41e3-9a39-7a28639c5ea6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:28.276063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0e55744d-ac38-41e3-9a39-7a28639c5ea6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:28.276474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0e55744d-ac38-41e3-9a39-7a28639c5ea6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:28.337719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0e55744d-ac38-41e3-9a39-7a28639c5ea6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:28.345391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0e55744d-ac38-41e3-9a39-7a28639c5ea6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081887 Sep 01 05:22:28.346465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 518/1070] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:28 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:28.827554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-26f1ad27-64ec-4c08-9da2-eb0be969e45b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:28.830409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-26f1ad27-64ec-4c08-9da2-eb0be969e45b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:28.837178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26f1ad27-64ec-4c08-9da2-eb0be969e45b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:28.837651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26f1ad27-64ec-4c08-9da2-eb0be969e45b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:28.838078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26f1ad27-64ec-4c08-9da2-eb0be969e45b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:28.838748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26f1ad27-64ec-4c08-9da2-eb0be969e45b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:28.839222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26f1ad27-64ec-4c08-9da2-eb0be969e45b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:28.839637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26f1ad27-64ec-4c08-9da2-eb0be969e45b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:28.870465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-26f1ad27-64ec-4c08-9da2-eb0be969e45b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046841 Sep 01 05:22:28.871022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 553/1071] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:28 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:28.929137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6afb1d34-02bf-4740-a0cd-7fcdceb4847c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:28.931293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6afb1d34-02bf-4740-a0cd-7fcdceb4847c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:28.937205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6afb1d34-02bf-4740-a0cd-7fcdceb4847c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:28.937971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6afb1d34-02bf-4740-a0cd-7fcdceb4847c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:28.938403 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6afb1d34-02bf-4740-a0cd-7fcdceb4847c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:28.939084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6afb1d34-02bf-4740-a0cd-7fcdceb4847c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:28.939533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6afb1d34-02bf-4740-a0cd-7fcdceb4847c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:28.940042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6afb1d34-02bf-4740-a0cd-7fcdceb4847c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:28.969773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6afb1d34-02bf-4740-a0cd-7fcdceb4847c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045867 Sep 01 05:22:28.970316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 519/1072] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:28 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:29.367297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-75d54e54-3e7f-481b-826d-62bc939bf51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:29.367923 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-75d54e54-3e7f-481b-826d-62bc939bf51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:29.374012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-75d54e54-3e7f-481b-826d-62bc939bf51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:29.374489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-75d54e54-3e7f-481b-826d-62bc939bf51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:29.374936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-75d54e54-3e7f-481b-826d-62bc939bf51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:29.375616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-75d54e54-3e7f-481b-826d-62bc939bf51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:29.376065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-75d54e54-3e7f-481b-826d-62bc939bf51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:29.376505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-75d54e54-3e7f-481b-826d-62bc939bf51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:29.437315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-75d54e54-3e7f-481b-826d-62bc939bf51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:29.445900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-75d54e54-3e7f-481b-826d-62bc939bf51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082510 Sep 01 05:22:29.446462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 554/1073] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:29 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:29.884035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-410bd385-e635-4b9e-83ff-8e37e152dd99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:29.886190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-410bd385-e635-4b9e-83ff-8e37e152dd99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:29.892096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-410bd385-e635-4b9e-83ff-8e37e152dd99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:29.892929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-410bd385-e635-4b9e-83ff-8e37e152dd99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:29.893375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-410bd385-e635-4b9e-83ff-8e37e152dd99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:29.894069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-410bd385-e635-4b9e-83ff-8e37e152dd99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:29.894518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-410bd385-e635-4b9e-83ff-8e37e152dd99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:29.894945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-410bd385-e635-4b9e-83ff-8e37e152dd99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:29.925296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-410bd385-e635-4b9e-83ff-8e37e152dd99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044900 Sep 01 05:22:29.925855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 520/1074] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:29 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:29.982481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ebc5424a-2e5b-4f9b-af1a-6857bdb7065b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:29.984605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ebc5424a-2e5b-4f9b-af1a-6857bdb7065b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:29.991561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebc5424a-2e5b-4f9b-af1a-6857bdb7065b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:29.992039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebc5424a-2e5b-4f9b-af1a-6857bdb7065b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:29.992660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebc5424a-2e5b-4f9b-af1a-6857bdb7065b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:29.993378 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebc5424a-2e5b-4f9b-af1a-6857bdb7065b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:29.993828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebc5424a-2e5b-4f9b-af1a-6857bdb7065b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:29.994251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebc5424a-2e5b-4f9b-af1a-6857bdb7065b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:30.026814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ebc5424a-2e5b-4f9b-af1a-6857bdb7065b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048155 Sep 01 05:22:30.027491 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 555/1075] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:29 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:30.468088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d261a3fb-629e-4225-b61d-5daef025dbbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:30.468641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d261a3fb-629e-4225-b61d-5daef025dbbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:30.476634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d261a3fb-629e-4225-b61d-5daef025dbbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:30.477202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d261a3fb-629e-4225-b61d-5daef025dbbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:30.477818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d261a3fb-629e-4225-b61d-5daef025dbbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:30.478640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d261a3fb-629e-4225-b61d-5daef025dbbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:30.479196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d261a3fb-629e-4225-b61d-5daef025dbbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:30.479719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d261a3fb-629e-4225-b61d-5daef025dbbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:30.541550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d261a3fb-629e-4225-b61d-5daef025dbbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:30.549500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d261a3fb-629e-4225-b61d-5daef025dbbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085076 Sep 01 05:22:30.550055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 521/1076] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:30 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:30.937326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-86f7050f-40f0-42d9-a2cd-26fab2b5e877 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:30.939716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-86f7050f-40f0-42d9-a2cd-26fab2b5e877 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:30.945717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86f7050f-40f0-42d9-a2cd-26fab2b5e877 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:30.946202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86f7050f-40f0-42d9-a2cd-26fab2b5e877 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:30.946635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86f7050f-40f0-42d9-a2cd-26fab2b5e877 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:30.947315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86f7050f-40f0-42d9-a2cd-26fab2b5e877 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:30.947763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86f7050f-40f0-42d9-a2cd-26fab2b5e877 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:30.948184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86f7050f-40f0-42d9-a2cd-26fab2b5e877 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:30.978291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-86f7050f-40f0-42d9-a2cd-26fab2b5e877 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045381 Sep 01 05:22:30.978834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 556/1077] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:30 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:31.039612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d8e3f4e8-a427-488f-b7b8-e2a8f2f16046 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:31.041764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d8e3f4e8-a427-488f-b7b8-e2a8f2f16046 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:31.047640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8e3f4e8-a427-488f-b7b8-e2a8f2f16046 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:31.048114 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8e3f4e8-a427-488f-b7b8-e2a8f2f16046 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:31.048542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8e3f4e8-a427-488f-b7b8-e2a8f2f16046 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:31.049889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8e3f4e8-a427-488f-b7b8-e2a8f2f16046 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:31.050327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8e3f4e8-a427-488f-b7b8-e2a8f2f16046 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:31.050744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8e3f4e8-a427-488f-b7b8-e2a8f2f16046 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:31.079471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d8e3f4e8-a427-488f-b7b8-e2a8f2f16046 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043820 Sep 01 05:22:31.080719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 522/1078] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:31.571190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-de899327-e5c7-4480-9778-dc026c06d4df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:31.571822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-de899327-e5c7-4480-9778-dc026c06d4df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:31.578205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de899327-e5c7-4480-9778-dc026c06d4df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:31.578683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de899327-e5c7-4480-9778-dc026c06d4df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:31.579115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de899327-e5c7-4480-9778-dc026c06d4df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:31.579796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de899327-e5c7-4480-9778-dc026c06d4df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:31.581312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de899327-e5c7-4480-9778-dc026c06d4df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:31.581739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de899327-e5c7-4480-9778-dc026c06d4df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:31.644190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-de899327-e5c7-4480-9778-dc026c06d4df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:31.651841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-de899327-e5c7-4480-9778-dc026c06d4df tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084563 Sep 01 05:22:31.652393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 557/1079] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:31 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:31.990574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f732f2e3-4713-40cf-892b-559e82db7a18 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:31.992735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f732f2e3-4713-40cf-892b-559e82db7a18 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:31.999098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f732f2e3-4713-40cf-892b-559e82db7a18 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:31.999569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f732f2e3-4713-40cf-892b-559e82db7a18 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:32.000000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f732f2e3-4713-40cf-892b-559e82db7a18 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:32.000672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f732f2e3-4713-40cf-892b-559e82db7a18 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:32.001142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f732f2e3-4713-40cf-892b-559e82db7a18 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:32.001561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f732f2e3-4713-40cf-892b-559e82db7a18 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:32.030329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f732f2e3-4713-40cf-892b-559e82db7a18 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Sep 01 05:22:32.030876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 523/1080] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:31 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:32.092840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-379a3fd2-5864-42ea-9d83-a97585b27bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:32.094962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-379a3fd2-5864-42ea-9d83-a97585b27bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:32.101607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-379a3fd2-5864-42ea-9d83-a97585b27bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:32.102088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-379a3fd2-5864-42ea-9d83-a97585b27bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:32.102524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-379a3fd2-5864-42ea-9d83-a97585b27bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:32.103203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-379a3fd2-5864-42ea-9d83-a97585b27bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:32.103651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-379a3fd2-5864-42ea-9d83-a97585b27bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:32.104073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-379a3fd2-5864-42ea-9d83-a97585b27bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:32.132537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-379a3fd2-5864-42ea-9d83-a97585b27bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043753 Sep 01 05:22:32.133129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 558/1081] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:32.673148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-34d61c45-c255-43ff-84fe-6785710f9577 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:32.673900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-34d61c45-c255-43ff-84fe-6785710f9577 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:32.679723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34d61c45-c255-43ff-84fe-6785710f9577 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:32.680195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34d61c45-c255-43ff-84fe-6785710f9577 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:32.680622 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34d61c45-c255-43ff-84fe-6785710f9577 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:32.681327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34d61c45-c255-43ff-84fe-6785710f9577 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:32.681774 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34d61c45-c255-43ff-84fe-6785710f9577 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:32.682188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-34d61c45-c255-43ff-84fe-6785710f9577 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:32.746374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-34d61c45-c255-43ff-84fe-6785710f9577 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:32.748508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:32.756086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-34d61c45-c255-43ff-84fe-6785710f9577 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086853 Sep 01 05:22:32.756658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 524/1082] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:32 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:33.042550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5d2b8275-fcc2-4033-9243-6860e18be880 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:33.044667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5d2b8275-fcc2-4033-9243-6860e18be880 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:33.051976 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d2b8275-fcc2-4033-9243-6860e18be880 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:33.052451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d2b8275-fcc2-4033-9243-6860e18be880 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:33.052927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d2b8275-fcc2-4033-9243-6860e18be880 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:33.053607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d2b8275-fcc2-4033-9243-6860e18be880 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:33.054055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d2b8275-fcc2-4033-9243-6860e18be880 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:33.054473 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d2b8275-fcc2-4033-9243-6860e18be880 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:33.084609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5d2b8275-fcc2-4033-9243-6860e18be880 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Sep 01 05:22:33.085198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 559/1083] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:33.146295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-026f0845-3c11-4642-b1f5-93207e19d7c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:33.148406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-026f0845-3c11-4642-b1f5-93207e19d7c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:33.154969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-026f0845-3c11-4642-b1f5-93207e19d7c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:33.155453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-026f0845-3c11-4642-b1f5-93207e19d7c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:33.155898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-026f0845-3c11-4642-b1f5-93207e19d7c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:33.156581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-026f0845-3c11-4642-b1f5-93207e19d7c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:33.157065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-026f0845-3c11-4642-b1f5-93207e19d7c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:33.157519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-026f0845-3c11-4642-b1f5-93207e19d7c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:33.187355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-026f0845-3c11-4642-b1f5-93207e19d7c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045167 Sep 01 05:22:33.188164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 525/1084] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:33.776034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4edbcfe0-01d6-49cc-970e-482069f32ed1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:33.776642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4edbcfe0-01d6-49cc-970e-482069f32ed1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:33.782541 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4edbcfe0-01d6-49cc-970e-482069f32ed1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:33.783028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4edbcfe0-01d6-49cc-970e-482069f32ed1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:33.783625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4edbcfe0-01d6-49cc-970e-482069f32ed1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:33.784289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4edbcfe0-01d6-49cc-970e-482069f32ed1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:33.784733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4edbcfe0-01d6-49cc-970e-482069f32ed1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:33.785177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4edbcfe0-01d6-49cc-970e-482069f32ed1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:33.847871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4edbcfe0-01d6-49cc-970e-482069f32ed1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:33.855989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4edbcfe0-01d6-49cc-970e-482069f32ed1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083720 Sep 01 05:22:33.856554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 560/1085] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:33 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:34.097078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-60dd6b4d-d772-4967-80dd-bae5aa0adbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:34.099161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-60dd6b4d-d772-4967-80dd-bae5aa0adbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:34.105267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60dd6b4d-d772-4967-80dd-bae5aa0adbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:34.105755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60dd6b4d-d772-4967-80dd-bae5aa0adbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:34.106193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60dd6b4d-d772-4967-80dd-bae5aa0adbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:34.106882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60dd6b4d-d772-4967-80dd-bae5aa0adbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:34.107338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60dd6b4d-d772-4967-80dd-bae5aa0adbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:34.107769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60dd6b4d-d772-4967-80dd-bae5aa0adbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:34.137201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-60dd6b4d-d772-4967-80dd-bae5aa0adbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Sep 01 05:22:34.137751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 526/1086] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:34.199806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-96116bc3-32ab-4393-b974-da843fec775d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:34.201995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-96116bc3-32ab-4393-b974-da843fec775d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:34.209103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96116bc3-32ab-4393-b974-da843fec775d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:34.209586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96116bc3-32ab-4393-b974-da843fec775d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:34.210020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96116bc3-32ab-4393-b974-da843fec775d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:34.210706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96116bc3-32ab-4393-b974-da843fec775d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:34.211154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96116bc3-32ab-4393-b974-da843fec775d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:34.211611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96116bc3-32ab-4393-b974-da843fec775d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:34.242290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-96116bc3-32ab-4393-b974-da843fec775d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046394 Sep 01 05:22:34.242884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 561/1087] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:34.878133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c4a0d192-d18f-4e4e-93f6-fbb68bafbe51 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:34.878781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c4a0d192-d18f-4e4e-93f6-fbb68bafbe51 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:34.885330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4a0d192-d18f-4e4e-93f6-fbb68bafbe51 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:34.885814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4a0d192-d18f-4e4e-93f6-fbb68bafbe51 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:34.886249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4a0d192-d18f-4e4e-93f6-fbb68bafbe51 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:34.886936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4a0d192-d18f-4e4e-93f6-fbb68bafbe51 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:34.887383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4a0d192-d18f-4e4e-93f6-fbb68bafbe51 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:34.887805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4a0d192-d18f-4e4e-93f6-fbb68bafbe51 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:34.951240 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c4a0d192-d18f-4e4e-93f6-fbb68bafbe51 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:34.959537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c4a0d192-d18f-4e4e-93f6-fbb68bafbe51 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085964 Sep 01 05:22:34.960105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 527/1088] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:34 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:35.149467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e7a78131-902e-4ffb-bebb-390365efb710 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:35.151538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e7a78131-902e-4ffb-bebb-390365efb710 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:35.157575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e7a78131-902e-4ffb-bebb-390365efb710 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:35.158169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e7a78131-902e-4ffb-bebb-390365efb710 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:35.159350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e7a78131-902e-4ffb-bebb-390365efb710 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:35.160194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e7a78131-902e-4ffb-bebb-390365efb710 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:35.160727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e7a78131-902e-4ffb-bebb-390365efb710 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:35.161306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e7a78131-902e-4ffb-bebb-390365efb710 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:35.174820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:35.191017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e7a78131-902e-4ffb-bebb-390365efb710 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045637 Sep 01 05:22:35.191562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 562/1089] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:35 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:35.254676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cb23d992-9ff1-4df5-b7cc-5b93d2b1f379 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:35.256855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cb23d992-9ff1-4df5-b7cc-5b93d2b1f379 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:35.262743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb23d992-9ff1-4df5-b7cc-5b93d2b1f379 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:35.263227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb23d992-9ff1-4df5-b7cc-5b93d2b1f379 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:35.263663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb23d992-9ff1-4df5-b7cc-5b93d2b1f379 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:35.264346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb23d992-9ff1-4df5-b7cc-5b93d2b1f379 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:35.264816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb23d992-9ff1-4df5-b7cc-5b93d2b1f379 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:35.265522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb23d992-9ff1-4df5-b7cc-5b93d2b1f379 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:35.296252 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cb23d992-9ff1-4df5-b7cc-5b93d2b1f379 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045563 Sep 01 05:22:35.296854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 528/1090] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:35.984088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a14969a3-ed7d-446a-b4fa-06c6e001767d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:35.984800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a14969a3-ed7d-446a-b4fa-06c6e001767d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:35.992197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a14969a3-ed7d-446a-b4fa-06c6e001767d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:35.992672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a14969a3-ed7d-446a-b4fa-06c6e001767d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:35.993135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a14969a3-ed7d-446a-b4fa-06c6e001767d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:35.993819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a14969a3-ed7d-446a-b4fa-06c6e001767d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:35.994265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a14969a3-ed7d-446a-b4fa-06c6e001767d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:35.994683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a14969a3-ed7d-446a-b4fa-06c6e001767d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:36.055366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a14969a3-ed7d-446a-b4fa-06c6e001767d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:36.063247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a14969a3-ed7d-446a-b4fa-06c6e001767d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082800 Sep 01 05:22:36.063812 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 563/1091] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:35 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:36.203896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e0961a8f-673d-428e-8a3d-a224657f4496 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:36.206118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e0961a8f-673d-428e-8a3d-a224657f4496 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:36.212735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0961a8f-673d-428e-8a3d-a224657f4496 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:36.213242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0961a8f-673d-428e-8a3d-a224657f4496 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:36.213669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0961a8f-673d-428e-8a3d-a224657f4496 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:36.214344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0961a8f-673d-428e-8a3d-a224657f4496 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:36.214785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0961a8f-673d-428e-8a3d-a224657f4496 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:36.215199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0961a8f-673d-428e-8a3d-a224657f4496 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:36.246100 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e0961a8f-673d-428e-8a3d-a224657f4496 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046636 Sep 01 05:22:36.246909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 529/1092] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:36 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:36.308169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5e7af3bf-1993-474b-bdba-3e0b22acbff8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:36.310318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5e7af3bf-1993-474b-bdba-3e0b22acbff8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:36.316638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5e7af3bf-1993-474b-bdba-3e0b22acbff8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:36.317149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5e7af3bf-1993-474b-bdba-3e0b22acbff8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:36.317585 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5e7af3bf-1993-474b-bdba-3e0b22acbff8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:36.318266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5e7af3bf-1993-474b-bdba-3e0b22acbff8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:36.318714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5e7af3bf-1993-474b-bdba-3e0b22acbff8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:36.319134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5e7af3bf-1993-474b-bdba-3e0b22acbff8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:36.348289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5e7af3bf-1993-474b-bdba-3e0b22acbff8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044107 Sep 01 05:22:36.348860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 564/1093] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:37.085106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-50ddb431-d109-498b-b901-48008d1101d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:37.085710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-50ddb431-d109-498b-b901-48008d1101d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:37.091744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-50ddb431-d109-498b-b901-48008d1101d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:37.092214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-50ddb431-d109-498b-b901-48008d1101d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:37.092639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-50ddb431-d109-498b-b901-48008d1101d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:37.093344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-50ddb431-d109-498b-b901-48008d1101d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:37.093784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-50ddb431-d109-498b-b901-48008d1101d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:37.094198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-50ddb431-d109-498b-b901-48008d1101d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:37.154300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-50ddb431-d109-498b-b901-48008d1101d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:37.161957 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-50ddb431-d109-498b-b901-48008d1101d1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.080777 Sep 01 05:22:37.162505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 530/1094] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:37 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:37.259231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d0fc2805-23ca-415d-8df8-577452e181f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:37.261413 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d0fc2805-23ca-415d-8df8-577452e181f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:37.268515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0fc2805-23ca-415d-8df8-577452e181f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:37.269047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0fc2805-23ca-415d-8df8-577452e181f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:37.269485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0fc2805-23ca-415d-8df8-577452e181f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:37.270166 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0fc2805-23ca-415d-8df8-577452e181f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:37.270617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0fc2805-23ca-415d-8df8-577452e181f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:37.271038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0fc2805-23ca-415d-8df8-577452e181f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:37.300841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d0fc2805-23ca-415d-8df8-577452e181f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045624 Sep 01 05:22:37.301395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 565/1095] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:37 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:37.360402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9a83d495-1c7f-4753-92e6-8adbedaa57a9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:37.362587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9a83d495-1c7f-4753-92e6-8adbedaa57a9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:37.368971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a83d495-1c7f-4753-92e6-8adbedaa57a9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:37.369449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a83d495-1c7f-4753-92e6-8adbedaa57a9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:37.369875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a83d495-1c7f-4753-92e6-8adbedaa57a9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:37.370546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a83d495-1c7f-4753-92e6-8adbedaa57a9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:37.370997 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a83d495-1c7f-4753-92e6-8adbedaa57a9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:37.371408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a83d495-1c7f-4753-92e6-8adbedaa57a9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:37.400442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9a83d495-1c7f-4753-92e6-8adbedaa57a9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043932 Sep 01 05:22:37.401014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 531/1096] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:37 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:38.181486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e1c79fa2-ec0e-46ca-8d7f-cc358b7972ad tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:38.182008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e1c79fa2-ec0e-46ca-8d7f-cc358b7972ad tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:38.188173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e1c79fa2-ec0e-46ca-8d7f-cc358b7972ad tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:38.188648 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e1c79fa2-ec0e-46ca-8d7f-cc358b7972ad tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:38.189103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e1c79fa2-ec0e-46ca-8d7f-cc358b7972ad tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:38.190566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e1c79fa2-ec0e-46ca-8d7f-cc358b7972ad tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:38.191041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e1c79fa2-ec0e-46ca-8d7f-cc358b7972ad tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:38.191460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e1c79fa2-ec0e-46ca-8d7f-cc358b7972ad tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:38.252663 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e1c79fa2-ec0e-46ca-8d7f-cc358b7972ad tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:38.260900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e1c79fa2-ec0e-46ca-8d7f-cc358b7972ad tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083265 Sep 01 05:22:38.261585 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 566/1097] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:38 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:38.313840 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8238d0af-933f-4018-825b-96d0fcb943a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:38.316033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8238d0af-933f-4018-825b-96d0fcb943a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:38.322002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8238d0af-933f-4018-825b-96d0fcb943a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:38.322483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8238d0af-933f-4018-825b-96d0fcb943a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:38.322912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8238d0af-933f-4018-825b-96d0fcb943a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:38.323621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8238d0af-933f-4018-825b-96d0fcb943a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:38.324076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8238d0af-933f-4018-825b-96d0fcb943a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:38.324496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8238d0af-933f-4018-825b-96d0fcb943a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:38.354697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8238d0af-933f-4018-825b-96d0fcb943a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Sep 01 05:22:38.355238 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 532/1098] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:38 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:38.412999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0e6ebe22-9b86-4368-9d03-323e15113343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:38.415153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0e6ebe22-9b86-4368-9d03-323e15113343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:38.421556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e6ebe22-9b86-4368-9d03-323e15113343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:38.422037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e6ebe22-9b86-4368-9d03-323e15113343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:38.422473 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e6ebe22-9b86-4368-9d03-323e15113343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:38.423155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e6ebe22-9b86-4368-9d03-323e15113343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:38.423605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e6ebe22-9b86-4368-9d03-323e15113343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:38.424033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e6ebe22-9b86-4368-9d03-323e15113343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:38.454500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0e6ebe22-9b86-4368-9d03-323e15113343 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045480 Sep 01 05:22:38.455619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 567/1099] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:38 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:39.282450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5dcf701f-711d-47f7-b1f7-e22cc50dbb09 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:39.283010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5dcf701f-711d-47f7-b1f7-e22cc50dbb09 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:39.289930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5dcf701f-711d-47f7-b1f7-e22cc50dbb09 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:39.290453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5dcf701f-711d-47f7-b1f7-e22cc50dbb09 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:39.290980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5dcf701f-711d-47f7-b1f7-e22cc50dbb09 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:39.291716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5dcf701f-711d-47f7-b1f7-e22cc50dbb09 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:39.292167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5dcf701f-711d-47f7-b1f7-e22cc50dbb09 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:39.292590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5dcf701f-711d-47f7-b1f7-e22cc50dbb09 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:39.354611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5dcf701f-711d-47f7-b1f7-e22cc50dbb09 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:39.363063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5dcf701f-711d-47f7-b1f7-e22cc50dbb09 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084606 Sep 01 05:22:39.363616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 533/1100] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:39 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:39.367042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-21b58aa4-4411-4705-9ec6-87359352c013 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:39.369216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-21b58aa4-4411-4705-9ec6-87359352c013 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:39.374978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21b58aa4-4411-4705-9ec6-87359352c013 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:39.375453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21b58aa4-4411-4705-9ec6-87359352c013 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:39.375879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21b58aa4-4411-4705-9ec6-87359352c013 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:39.376549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21b58aa4-4411-4705-9ec6-87359352c013 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:39.377148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21b58aa4-4411-4705-9ec6-87359352c013 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:39.377615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21b58aa4-4411-4705-9ec6-87359352c013 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:39.467799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c20f572a-39e2-48e0-a855-7e81da95ffab tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:39.469982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c20f572a-39e2-48e0-a855-7e81da95ffab tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:39.477698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c20f572a-39e2-48e0-a855-7e81da95ffab tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:39.478196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c20f572a-39e2-48e0-a855-7e81da95ffab tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:39.478626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c20f572a-39e2-48e0-a855-7e81da95ffab tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:39.479363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c20f572a-39e2-48e0-a855-7e81da95ffab tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:39.479815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c20f572a-39e2-48e0-a855-7e81da95ffab tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:39.480236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c20f572a-39e2-48e0-a855-7e81da95ffab tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:39.514730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c20f572a-39e2-48e0-a855-7e81da95ffab tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050945 Sep 01 05:22:39.515310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 534/1101] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:39 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:39.554528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-21b58aa4-4411-4705-9ec6-87359352c013 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191344 Sep 01 05:22:39.554989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 568/1102] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:40.384125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5ca7fe47-7128-467e-8ebf-39657c48047b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:40.384739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5ca7fe47-7128-467e-8ebf-39657c48047b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:40.391217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ca7fe47-7128-467e-8ebf-39657c48047b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:40.391698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ca7fe47-7128-467e-8ebf-39657c48047b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:40.392138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ca7fe47-7128-467e-8ebf-39657c48047b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:40.393409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ca7fe47-7128-467e-8ebf-39657c48047b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:40.393929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ca7fe47-7128-467e-8ebf-39657c48047b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:40.394357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ca7fe47-7128-467e-8ebf-39657c48047b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:40.457912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5ca7fe47-7128-467e-8ebf-39657c48047b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:40.465558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5ca7fe47-7128-467e-8ebf-39657c48047b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085505 Sep 01 05:22:40.466122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 535/1103] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:40 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:40.526796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dd93e3fd-3744-449e-89e2-6080ba8344d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:40.528954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dd93e3fd-3744-449e-89e2-6080ba8344d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:40.535910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd93e3fd-3744-449e-89e2-6080ba8344d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:40.536390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd93e3fd-3744-449e-89e2-6080ba8344d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:40.536857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd93e3fd-3744-449e-89e2-6080ba8344d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:40.537548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd93e3fd-3744-449e-89e2-6080ba8344d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:40.537997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd93e3fd-3744-449e-89e2-6080ba8344d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:40.538416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd93e3fd-3744-449e-89e2-6080ba8344d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:40.567378 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-018527c2-e221-407b-a51a-ddecad78cd46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:40.569463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dd93e3fd-3744-449e-89e2-6080ba8344d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046591 Sep 01 05:22:40.569596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-018527c2-e221-407b-a51a-ddecad78cd46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:40.570019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 569/1104] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:40.575536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-018527c2-e221-407b-a51a-ddecad78cd46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:40.576020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-018527c2-e221-407b-a51a-ddecad78cd46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:40.576455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-018527c2-e221-407b-a51a-ddecad78cd46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:40.577175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-018527c2-e221-407b-a51a-ddecad78cd46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:40.577626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-018527c2-e221-407b-a51a-ddecad78cd46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:40.578047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-018527c2-e221-407b-a51a-ddecad78cd46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:40.609652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-018527c2-e221-407b-a51a-ddecad78cd46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046943 Sep 01 05:22:40.610199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 536/1105] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:40 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:41.487256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5cb98098-7769-4258-8ce7-52d256f5b60d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:41.488070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5cb98098-7769-4258-8ce7-52d256f5b60d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:41.494025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cb98098-7769-4258-8ce7-52d256f5b60d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:41.494506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cb98098-7769-4258-8ce7-52d256f5b60d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:41.494952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cb98098-7769-4258-8ce7-52d256f5b60d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:41.495615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cb98098-7769-4258-8ce7-52d256f5b60d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:41.496060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cb98098-7769-4258-8ce7-52d256f5b60d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:41.496479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5cb98098-7769-4258-8ce7-52d256f5b60d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:41.559435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5cb98098-7769-4258-8ce7-52d256f5b60d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:41.567788 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5cb98098-7769-4258-8ce7-52d256f5b60d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085171 Sep 01 05:22:41.568347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 570/1106] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:41 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:41.581294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d759e17a-1a41-4bf5-aea3-f8efb87b664b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:41.583422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d759e17a-1a41-4bf5-aea3-f8efb87b664b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:41.589866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d759e17a-1a41-4bf5-aea3-f8efb87b664b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:41.590342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d759e17a-1a41-4bf5-aea3-f8efb87b664b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:41.590774 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d759e17a-1a41-4bf5-aea3-f8efb87b664b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:41.591458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d759e17a-1a41-4bf5-aea3-f8efb87b664b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:41.591902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d759e17a-1a41-4bf5-aea3-f8efb87b664b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:41.592319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d759e17a-1a41-4bf5-aea3-f8efb87b664b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:41.622323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9a826773-003f-41d2-9b21-05c8e3049e99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:41.622558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d759e17a-1a41-4bf5-aea3-f8efb87b664b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045192 Sep 01 05:22:41.622921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 537/1107] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:41.624573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9a826773-003f-41d2-9b21-05c8e3049e99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:41.630855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a826773-003f-41d2-9b21-05c8e3049e99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:41.631353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a826773-003f-41d2-9b21-05c8e3049e99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:41.631793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a826773-003f-41d2-9b21-05c8e3049e99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:41.632511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a826773-003f-41d2-9b21-05c8e3049e99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:41.632992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a826773-003f-41d2-9b21-05c8e3049e99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:41.633417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a826773-003f-41d2-9b21-05c8e3049e99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:41.663883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9a826773-003f-41d2-9b21-05c8e3049e99 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Sep 01 05:22:41.664425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 571/1108] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:42.589042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0bcbde08-cf2e-47eb-a517-5a949d69d496 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:42.589650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0bcbde08-cf2e-47eb-a517-5a949d69d496 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:42.596581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0bcbde08-cf2e-47eb-a517-5a949d69d496 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:42.597191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0bcbde08-cf2e-47eb-a517-5a949d69d496 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:42.597620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0bcbde08-cf2e-47eb-a517-5a949d69d496 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:42.598298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0bcbde08-cf2e-47eb-a517-5a949d69d496 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:42.598736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0bcbde08-cf2e-47eb-a517-5a949d69d496 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:42.599777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0bcbde08-cf2e-47eb-a517-5a949d69d496 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:42.634731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ac71c066-5562-4ace-8f24-16a147ee145b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:42.636883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ac71c066-5562-4ace-8f24-16a147ee145b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:42.644201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ac71c066-5562-4ace-8f24-16a147ee145b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:42.644691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ac71c066-5562-4ace-8f24-16a147ee145b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:42.645152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ac71c066-5562-4ace-8f24-16a147ee145b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:42.645844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ac71c066-5562-4ace-8f24-16a147ee145b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:42.646291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ac71c066-5562-4ace-8f24-16a147ee145b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:42.646707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ac71c066-5562-4ace-8f24-16a147ee145b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:42.662069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0bcbde08-cf2e-47eb-a517-5a949d69d496 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:42.669669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0bcbde08-cf2e-47eb-a517-5a949d69d496 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084558 Sep 01 05:22:42.678769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 538/1109] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:42 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:42.678769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a3b04aa3-556f-4f78-9f56-c9dd07b9ace9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:42.679041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ac71c066-5562-4ace-8f24-16a147ee145b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047259 Sep 01 05:22:42.679147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a3b04aa3-556f-4f78-9f56-c9dd07b9ace9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:42.679241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 572/1110] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:42.684039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3b04aa3-556f-4f78-9f56-c9dd07b9ace9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:42.684510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3b04aa3-556f-4f78-9f56-c9dd07b9ace9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:42.684982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3b04aa3-556f-4f78-9f56-c9dd07b9ace9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:42.685667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3b04aa3-556f-4f78-9f56-c9dd07b9ace9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:42.686110 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3b04aa3-556f-4f78-9f56-c9dd07b9ace9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:42.686524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3b04aa3-556f-4f78-9f56-c9dd07b9ace9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:42.716356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a3b04aa3-556f-4f78-9f56-c9dd07b9ace9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Sep 01 05:22:42.716931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 539/1111] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:42 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:43.690812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a3db341b-6ba3-4229-b86c-ddf2f893c195 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:43.691432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3cf54182-1c42-4015-884d-780589078525 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:43.691811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a3db341b-6ba3-4229-b86c-ddf2f893c195 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:43.692970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3cf54182-1c42-4015-884d-780589078525 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:43.697876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3db341b-6ba3-4229-b86c-ddf2f893c195 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:43.698358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3db341b-6ba3-4229-b86c-ddf2f893c195 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:43.698783 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3db341b-6ba3-4229-b86c-ddf2f893c195 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:43.699280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3cf54182-1c42-4015-884d-780589078525 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:43.699457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3db341b-6ba3-4229-b86c-ddf2f893c195 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:43.699758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3cf54182-1c42-4015-884d-780589078525 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:43.699900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3db341b-6ba3-4229-b86c-ddf2f893c195 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:43.700191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3cf54182-1c42-4015-884d-780589078525 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:43.700308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3db341b-6ba3-4229-b86c-ddf2f893c195 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:43.700901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3cf54182-1c42-4015-884d-780589078525 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:43.701348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3cf54182-1c42-4015-884d-780589078525 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:43.701767 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3cf54182-1c42-4015-884d-780589078525 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:43.731890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3cf54182-1c42-4015-884d-780589078525 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045684 Sep 01 05:22:43.732455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 573/1112] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:43.738148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-086f5933-a4c1-4a0e-a339-fbfe6ee33711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:43.740266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-086f5933-a4c1-4a0e-a339-fbfe6ee33711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:43.746113 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-086f5933-a4c1-4a0e-a339-fbfe6ee33711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:43.746591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-086f5933-a4c1-4a0e-a339-fbfe6ee33711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:43.747021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-086f5933-a4c1-4a0e-a339-fbfe6ee33711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:43.747708 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-086f5933-a4c1-4a0e-a339-fbfe6ee33711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:43.748155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-086f5933-a4c1-4a0e-a339-fbfe6ee33711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:43.748571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-086f5933-a4c1-4a0e-a339-fbfe6ee33711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:43.762555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a3db341b-6ba3-4229-b86c-ddf2f893c195 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:43.770805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a3db341b-6ba3-4229-b86c-ddf2f893c195 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084060 Sep 01 05:22:43.771377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 540/1113] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:43 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:43.781333 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-086f5933-a4c1-4a0e-a339-fbfe6ee33711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047843 Sep 01 05:22:43.782126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 574/1114] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:43 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:44.745030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c338a0b4-9f82-49c6-a138-713877d05bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:44.747155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c338a0b4-9f82-49c6-a138-713877d05bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:44.753929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c338a0b4-9f82-49c6-a138-713877d05bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:44.754398 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c338a0b4-9f82-49c6-a138-713877d05bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:44.754826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c338a0b4-9f82-49c6-a138-713877d05bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:44.755496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c338a0b4-9f82-49c6-a138-713877d05bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:44.755936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c338a0b4-9f82-49c6-a138-713877d05bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:44.756348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c338a0b4-9f82-49c6-a138-713877d05bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:44.770218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:44.787181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c338a0b4-9f82-49c6-a138-713877d05bf9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046185 Sep 01 05:22:44.787955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 541/1115] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:44.791350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c3115da6-8a6c-47e9-8ac2-f88ce189fedf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:44.791965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c3115da6-8a6c-47e9-8ac2-f88ce189fedf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:44.793661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4c0be57c-b9bd-4808-a0fd-828792daedba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:44.795878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4c0be57c-b9bd-4808-a0fd-828792daedba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:44.798499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3115da6-8a6c-47e9-8ac2-f88ce189fedf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:44.799481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3115da6-8a6c-47e9-8ac2-f88ce189fedf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:44.799912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3115da6-8a6c-47e9-8ac2-f88ce189fedf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:44.800592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3115da6-8a6c-47e9-8ac2-f88ce189fedf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:44.801063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3115da6-8a6c-47e9-8ac2-f88ce189fedf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:44.801478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3115da6-8a6c-47e9-8ac2-f88ce189fedf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:44.802374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4c0be57c-b9bd-4808-a0fd-828792daedba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:44.802857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4c0be57c-b9bd-4808-a0fd-828792daedba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:44.803295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4c0be57c-b9bd-4808-a0fd-828792daedba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:44.803984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4c0be57c-b9bd-4808-a0fd-828792daedba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:44.804437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4c0be57c-b9bd-4808-a0fd-828792daedba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:44.804881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4c0be57c-b9bd-4808-a0fd-828792daedba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:44.834288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4c0be57c-b9bd-4808-a0fd-828792daedba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044529 Sep 01 05:22:44.834859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 542/1116] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:44 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:44.863223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c3115da6-8a6c-47e9-8ac2-f88ce189fedf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:44.870855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c3115da6-8a6c-47e9-8ac2-f88ce189fedf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083371 Sep 01 05:22:44.871416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 575/1117] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:44 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:45.798781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-88cbbf57-5d35-4a9e-9ea8-46515b490a42 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:45.801460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-88cbbf57-5d35-4a9e-9ea8-46515b490a42 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:45.808378 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-88cbbf57-5d35-4a9e-9ea8-46515b490a42 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:45.808876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-88cbbf57-5d35-4a9e-9ea8-46515b490a42 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:45.809309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-88cbbf57-5d35-4a9e-9ea8-46515b490a42 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:45.810013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-88cbbf57-5d35-4a9e-9ea8-46515b490a42 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:45.810454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-88cbbf57-5d35-4a9e-9ea8-46515b490a42 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:45.810865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-88cbbf57-5d35-4a9e-9ea8-46515b490a42 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:45.840408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-88cbbf57-5d35-4a9e-9ea8-46515b490a42 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045585 Sep 01 05:22:45.840907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 543/1118] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:45 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:45.847210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-533a350e-c153-4363-b42e-cda175a52f1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:45.849940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-533a350e-c153-4363-b42e-cda175a52f1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:45.856344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-533a350e-c153-4363-b42e-cda175a52f1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:45.856851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-533a350e-c153-4363-b42e-cda175a52f1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:45.857290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-533a350e-c153-4363-b42e-cda175a52f1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:45.857975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-533a350e-c153-4363-b42e-cda175a52f1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:45.858423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-533a350e-c153-4363-b42e-cda175a52f1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:45.858843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-533a350e-c153-4363-b42e-cda175a52f1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:45.887938 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-533a350e-c153-4363-b42e-cda175a52f1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Sep 01 05:22:45.888485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 576/1119] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:45.891397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8e777919-9dcc-4839-a618-65398fee4dee tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:45.891982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8e777919-9dcc-4839-a618-65398fee4dee tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:45.899537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e777919-9dcc-4839-a618-65398fee4dee tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:45.900019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e777919-9dcc-4839-a618-65398fee4dee tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:45.900456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e777919-9dcc-4839-a618-65398fee4dee tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:45.901180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e777919-9dcc-4839-a618-65398fee4dee tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:45.901638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e777919-9dcc-4839-a618-65398fee4dee tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:45.902059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e777919-9dcc-4839-a618-65398fee4dee tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:45.965096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8e777919-9dcc-4839-a618-65398fee4dee tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:45.972734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8e777919-9dcc-4839-a618-65398fee4dee tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085187 Sep 01 05:22:45.973318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 544/1120] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:45 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:46.853068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-deef6e1e-6db2-4a12-9c66-bcc695f0a194 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:46.855157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-deef6e1e-6db2-4a12-9c66-bcc695f0a194 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:46.862414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-deef6e1e-6db2-4a12-9c66-bcc695f0a194 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:46.863041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-deef6e1e-6db2-4a12-9c66-bcc695f0a194 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:46.863472 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-deef6e1e-6db2-4a12-9c66-bcc695f0a194 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:46.864147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-deef6e1e-6db2-4a12-9c66-bcc695f0a194 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:46.864591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-deef6e1e-6db2-4a12-9c66-bcc695f0a194 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:46.865033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-deef6e1e-6db2-4a12-9c66-bcc695f0a194 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:46.893503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-deef6e1e-6db2-4a12-9c66-bcc695f0a194 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044374 Sep 01 05:22:46.894059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 577/1121] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:46.899681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-42f94ff5-9859-46c5-a4d2-1273d199d9fb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:46.901860 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-42f94ff5-9859-46c5-a4d2-1273d199d9fb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:46.904203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=90 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:46.910083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42f94ff5-9859-46c5-a4d2-1273d199d9fb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:46.910559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42f94ff5-9859-46c5-a4d2-1273d199d9fb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:46.910992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42f94ff5-9859-46c5-a4d2-1273d199d9fb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:46.911673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42f94ff5-9859-46c5-a4d2-1273d199d9fb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:46.912121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42f94ff5-9859-46c5-a4d2-1273d199d9fb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:46.912540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42f94ff5-9859-46c5-a4d2-1273d199d9fb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:46.942593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-42f94ff5-9859-46c5-a4d2-1273d199d9fb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046880 Sep 01 05:22:46.943143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 545/1122] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:46 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:46.993178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2941b140-f7a6-46a6-a13d-b8f692abf2eb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:46.993792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2941b140-f7a6-46a6-a13d-b8f692abf2eb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:46.999700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2941b140-f7a6-46a6-a13d-b8f692abf2eb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:47.000183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2941b140-f7a6-46a6-a13d-b8f692abf2eb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:47.000619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2941b140-f7a6-46a6-a13d-b8f692abf2eb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:47.001348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2941b140-f7a6-46a6-a13d-b8f692abf2eb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:47.001797 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2941b140-f7a6-46a6-a13d-b8f692abf2eb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:47.002241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2941b140-f7a6-46a6-a13d-b8f692abf2eb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:47.062854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2941b140-f7a6-46a6-a13d-b8f692abf2eb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:47.070996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2941b140-f7a6-46a6-a13d-b8f692abf2eb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081654 Sep 01 05:22:47.071554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 578/1123] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:46 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:47.905786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0ff27439-87b5-4815-b0d7-a6550a5b6f79 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:47.907899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0ff27439-87b5-4815-b0d7-a6550a5b6f79 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:47.914411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ff27439-87b5-4815-b0d7-a6550a5b6f79 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:47.914888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ff27439-87b5-4815-b0d7-a6550a5b6f79 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:47.915317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ff27439-87b5-4815-b0d7-a6550a5b6f79 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:47.915992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ff27439-87b5-4815-b0d7-a6550a5b6f79 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:47.916435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ff27439-87b5-4815-b0d7-a6550a5b6f79 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:47.916873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ff27439-87b5-4815-b0d7-a6550a5b6f79 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:47.947058 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0ff27439-87b5-4815-b0d7-a6550a5b6f79 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045260 Sep 01 05:22:47.947600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 546/1124] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:47 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:47.955368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d31feea5-4adc-474a-99ba-df10728e01e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:47.957701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d31feea5-4adc-474a-99ba-df10728e01e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:47.959716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:22:47.959859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:22:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments (ip 10.222.0.49) !!! Sep 01 05:22:47.971165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d31feea5-4adc-474a-99ba-df10728e01e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:47.971638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d31feea5-4adc-474a-99ba-df10728e01e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:47.972087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d31feea5-4adc-474a-99ba-df10728e01e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:47.972862 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d31feea5-4adc-474a-99ba-df10728e01e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:47.973309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d31feea5-4adc-474a-99ba-df10728e01e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:47.973725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d31feea5-4adc-474a-99ba-df10728e01e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:47.976118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:48.004515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d31feea5-4adc-474a-99ba-df10728e01e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053463 Sep 01 05:22:48.005090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 579/1125] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:48.091937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-830cb00d-2af0-40d5-87d0-9941797b2177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:48.092584 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-830cb00d-2af0-40d5-87d0-9941797b2177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:48.099697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-830cb00d-2af0-40d5-87d0-9941797b2177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:48.100176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-830cb00d-2af0-40d5-87d0-9941797b2177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:48.100604 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-830cb00d-2af0-40d5-87d0-9941797b2177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:48.101330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-830cb00d-2af0-40d5-87d0-9941797b2177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:48.101775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-830cb00d-2af0-40d5-87d0-9941797b2177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:48.102190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-830cb00d-2af0-40d5-87d0-9941797b2177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:48.165485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-830cb00d-2af0-40d5-87d0-9941797b2177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:48.173043 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-830cb00d-2af0-40d5-87d0-9941797b2177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084936 Sep 01 05:22:48.173600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 547/1126] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:48 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:48.959821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-52592ee6-d58c-473f-b17f-d0c2070a8a37 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:48.962122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-52592ee6-d58c-473f-b17f-d0c2070a8a37 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:48.968488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-52592ee6-d58c-473f-b17f-d0c2070a8a37 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:48.969011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-52592ee6-d58c-473f-b17f-d0c2070a8a37 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:48.969451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-52592ee6-d58c-473f-b17f-d0c2070a8a37 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:48.970326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-52592ee6-d58c-473f-b17f-d0c2070a8a37 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:48.970592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-52592ee6-d58c-473f-b17f-d0c2070a8a37 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:48.971559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-52592ee6-d58c-473f-b17f-d0c2070a8a37 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:49.001066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-52592ee6-d58c-473f-b17f-d0c2070a8a37 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045635 Sep 01 05:22:49.001614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 580/1127] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:49.016651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b30fcb68-9688-40e0-94c6-28623a8568ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:49.019045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b30fcb68-9688-40e0-94c6-28623a8568ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:49.025709 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b30fcb68-9688-40e0-94c6-28623a8568ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:49.026189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b30fcb68-9688-40e0-94c6-28623a8568ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:49.026621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b30fcb68-9688-40e0-94c6-28623a8568ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:49.027341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b30fcb68-9688-40e0-94c6-28623a8568ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:49.027790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b30fcb68-9688-40e0-94c6-28623a8568ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:49.028210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b30fcb68-9688-40e0-94c6-28623a8568ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:49.058030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b30fcb68-9688-40e0-94c6-28623a8568ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045357 Sep 01 05:22:49.058576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 548/1128] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:49 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:49.195217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0dd63be6-8c17-456e-bba0-0deb17fc2d1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:49.195826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0dd63be6-8c17-456e-bba0-0deb17fc2d1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:49.201931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0dd63be6-8c17-456e-bba0-0deb17fc2d1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:49.202405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0dd63be6-8c17-456e-bba0-0deb17fc2d1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:49.202832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0dd63be6-8c17-456e-bba0-0deb17fc2d1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:49.203509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0dd63be6-8c17-456e-bba0-0deb17fc2d1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:49.203953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0dd63be6-8c17-456e-bba0-0deb17fc2d1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:49.204369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0dd63be6-8c17-456e-bba0-0deb17fc2d1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:49.265709 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0dd63be6-8c17-456e-bba0-0deb17fc2d1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:49.273771 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0dd63be6-8c17-456e-bba0-0deb17fc2d1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082534 Sep 01 05:22:49.274330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 581/1129] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:49 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:50.013224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b8f7ff03-ad62-4a72-9683-099db2009a54 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:50.015376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b8f7ff03-ad62-4a72-9683-099db2009a54 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:50.021391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8f7ff03-ad62-4a72-9683-099db2009a54 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:50.021943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8f7ff03-ad62-4a72-9683-099db2009a54 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:50.022290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8f7ff03-ad62-4a72-9683-099db2009a54 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:50.022971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8f7ff03-ad62-4a72-9683-099db2009a54 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:50.023420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8f7ff03-ad62-4a72-9683-099db2009a54 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:50.023836 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8f7ff03-ad62-4a72-9683-099db2009a54 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:50.053156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b8f7ff03-ad62-4a72-9683-099db2009a54 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043997 Sep 01 05:22:50.053704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 549/1130] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:50.070458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1c9d7e1d-d247-4fae-871a-8a476e9a5399 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:50.072569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1c9d7e1d-d247-4fae-871a-8a476e9a5399 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:50.078913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c9d7e1d-d247-4fae-871a-8a476e9a5399 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:50.079384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c9d7e1d-d247-4fae-871a-8a476e9a5399 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:50.079813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c9d7e1d-d247-4fae-871a-8a476e9a5399 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:50.080636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c9d7e1d-d247-4fae-871a-8a476e9a5399 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:50.081115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c9d7e1d-d247-4fae-871a-8a476e9a5399 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:50.081525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c9d7e1d-d247-4fae-871a-8a476e9a5399 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:50.110063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1c9d7e1d-d247-4fae-871a-8a476e9a5399 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043737 Sep 01 05:22:50.110599 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 582/1131] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:50 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:50.295171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-04c24375-77f4-4432-9c80-2259256b5ef1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:50.295811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-04c24375-77f4-4432-9c80-2259256b5ef1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:50.304416 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04c24375-77f4-4432-9c80-2259256b5ef1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:50.304935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04c24375-77f4-4432-9c80-2259256b5ef1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:50.305376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04c24375-77f4-4432-9c80-2259256b5ef1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:50.306068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04c24375-77f4-4432-9c80-2259256b5ef1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:50.306521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04c24375-77f4-4432-9c80-2259256b5ef1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:50.306945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04c24375-77f4-4432-9c80-2259256b5ef1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:50.367832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-04c24375-77f4-4432-9c80-2259256b5ef1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:50.375468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-04c24375-77f4-4432-9c80-2259256b5ef1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084333 Sep 01 05:22:50.376021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 550/1132] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:50 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:51.066472 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a23d249a-58aa-4a70-906e-17ab2bc026da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:51.068521 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a23d249a-58aa-4a70-906e-17ab2bc026da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:51.070401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=84 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:51.076328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a23d249a-58aa-4a70-906e-17ab2bc026da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:51.076947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a23d249a-58aa-4a70-906e-17ab2bc026da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:51.077272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a23d249a-58aa-4a70-906e-17ab2bc026da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:51.077964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a23d249a-58aa-4a70-906e-17ab2bc026da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:51.078415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a23d249a-58aa-4a70-906e-17ab2bc026da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:51.078841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a23d249a-58aa-4a70-906e-17ab2bc026da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:51.108332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a23d249a-58aa-4a70-906e-17ab2bc026da tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046834 Sep 01 05:22:51.108912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 583/1133] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:51 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:51.122819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-329864a2-a66e-4bfc-b65b-4438ac173f3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:51.125029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-329864a2-a66e-4bfc-b65b-4438ac173f3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:51.131492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-329864a2-a66e-4bfc-b65b-4438ac173f3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:51.131974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-329864a2-a66e-4bfc-b65b-4438ac173f3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:51.132405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-329864a2-a66e-4bfc-b65b-4438ac173f3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:51.133123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-329864a2-a66e-4bfc-b65b-4438ac173f3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:51.133569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-329864a2-a66e-4bfc-b65b-4438ac173f3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:51.133985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-329864a2-a66e-4bfc-b65b-4438ac173f3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:51.163685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-329864a2-a66e-4bfc-b65b-4438ac173f3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Sep 01 05:22:51.164244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 551/1134] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:51.397203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f8c3ccb4-38cb-4b8d-9cf1-3dd2bd4ac990 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:51.397821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f8c3ccb4-38cb-4b8d-9cf1-3dd2bd4ac990 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:51.403935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8c3ccb4-38cb-4b8d-9cf1-3dd2bd4ac990 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:51.404475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8c3ccb4-38cb-4b8d-9cf1-3dd2bd4ac990 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:51.404945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8c3ccb4-38cb-4b8d-9cf1-3dd2bd4ac990 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:51.405629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8c3ccb4-38cb-4b8d-9cf1-3dd2bd4ac990 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:51.406079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8c3ccb4-38cb-4b8d-9cf1-3dd2bd4ac990 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:51.406499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8c3ccb4-38cb-4b8d-9cf1-3dd2bd4ac990 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:51.471622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f8c3ccb4-38cb-4b8d-9cf1-3dd2bd4ac990 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:51.479312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f8c3ccb4-38cb-4b8d-9cf1-3dd2bd4ac990 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086538 Sep 01 05:22:51.479873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 584/1135] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:51 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:52.121176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f4fe1d43-4780-40d1-a4ba-1feaebf2b068 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:52.123292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f4fe1d43-4780-40d1-a4ba-1feaebf2b068 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:52.130460 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4fe1d43-4780-40d1-a4ba-1feaebf2b068 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:52.130934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4fe1d43-4780-40d1-a4ba-1feaebf2b068 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:52.131371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4fe1d43-4780-40d1-a4ba-1feaebf2b068 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:52.132087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4fe1d43-4780-40d1-a4ba-1feaebf2b068 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:52.132527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4fe1d43-4780-40d1-a4ba-1feaebf2b068 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:52.132976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4fe1d43-4780-40d1-a4ba-1feaebf2b068 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:52.163603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f4fe1d43-4780-40d1-a4ba-1feaebf2b068 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046390 Sep 01 05:22:52.164091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 552/1136] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:52.176153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ec1e1189-b18c-46ee-a00c-0a40bad02faa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:52.178281 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ec1e1189-b18c-46ee-a00c-0a40bad02faa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:52.184601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec1e1189-b18c-46ee-a00c-0a40bad02faa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:52.185172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec1e1189-b18c-46ee-a00c-0a40bad02faa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:52.185608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec1e1189-b18c-46ee-a00c-0a40bad02faa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:52.186271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec1e1189-b18c-46ee-a00c-0a40bad02faa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:52.186713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec1e1189-b18c-46ee-a00c-0a40bad02faa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:52.187127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec1e1189-b18c-46ee-a00c-0a40bad02faa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:52.216183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ec1e1189-b18c-46ee-a00c-0a40bad02faa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Sep 01 05:22:52.216724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 585/1137] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:52.500401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-956b63e3-bbee-4afc-abac-eceabdf99f95 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:52.500962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-956b63e3-bbee-4afc-abac-eceabdf99f95 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:52.506923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-956b63e3-bbee-4afc-abac-eceabdf99f95 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:52.507391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-956b63e3-bbee-4afc-abac-eceabdf99f95 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:52.507820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-956b63e3-bbee-4afc-abac-eceabdf99f95 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:52.508487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-956b63e3-bbee-4afc-abac-eceabdf99f95 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:52.508956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-956b63e3-bbee-4afc-abac-eceabdf99f95 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:52.509375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-956b63e3-bbee-4afc-abac-eceabdf99f95 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:52.570710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-956b63e3-bbee-4afc-abac-eceabdf99f95 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:52.578535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-956b63e3-bbee-4afc-abac-eceabdf99f95 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082157 Sep 01 05:22:52.579091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 553/1138] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:52 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:53.176281 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1e404bc0-9bf1-4709-a6fc-e7f17feb431d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:53.178355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1e404bc0-9bf1-4709-a6fc-e7f17feb431d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:53.184444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1e404bc0-9bf1-4709-a6fc-e7f17feb431d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:53.185095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1e404bc0-9bf1-4709-a6fc-e7f17feb431d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:53.185540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1e404bc0-9bf1-4709-a6fc-e7f17feb431d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:53.186234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1e404bc0-9bf1-4709-a6fc-e7f17feb431d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:53.186681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1e404bc0-9bf1-4709-a6fc-e7f17feb431d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:53.187100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1e404bc0-9bf1-4709-a6fc-e7f17feb431d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:53.216603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1e404bc0-9bf1-4709-a6fc-e7f17feb431d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044590 Sep 01 05:22:53.217189 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 586/1139] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:53.228178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fe3d1b9d-e45a-45d2-ab40-6105002fec8a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:53.230397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fe3d1b9d-e45a-45d2-ab40-6105002fec8a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:53.237575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe3d1b9d-e45a-45d2-ab40-6105002fec8a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:53.238134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe3d1b9d-e45a-45d2-ab40-6105002fec8a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:53.238565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe3d1b9d-e45a-45d2-ab40-6105002fec8a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:53.239243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe3d1b9d-e45a-45d2-ab40-6105002fec8a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:53.239684 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe3d1b9d-e45a-45d2-ab40-6105002fec8a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:53.240095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe3d1b9d-e45a-45d2-ab40-6105002fec8a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:53.269267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fe3d1b9d-e45a-45d2-ab40-6105002fec8a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045028 Sep 01 05:22:53.269801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 554/1140] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:53.599977 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6c7236f3-f22d-4f4b-8dd3-616588af483a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:53.600588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6c7236f3-f22d-4f4b-8dd3-616588af483a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:53.606481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c7236f3-f22d-4f4b-8dd3-616588af483a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:53.606969 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c7236f3-f22d-4f4b-8dd3-616588af483a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:53.607388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c7236f3-f22d-4f4b-8dd3-616588af483a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:53.608065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c7236f3-f22d-4f4b-8dd3-616588af483a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:53.608513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c7236f3-f22d-4f4b-8dd3-616588af483a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:53.608968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6c7236f3-f22d-4f4b-8dd3-616588af483a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:53.668142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6c7236f3-f22d-4f4b-8dd3-616588af483a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:53.676358 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6c7236f3-f22d-4f4b-8dd3-616588af483a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.080796 Sep 01 05:22:53.676975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 587/1141] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:53 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:54.231097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-70ca1f82-f1c6-421f-a827-86a3c14a497c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:54.233254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-70ca1f82-f1c6-421f-a827-86a3c14a497c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:54.240290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-70ca1f82-f1c6-421f-a827-86a3c14a497c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:54.240765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-70ca1f82-f1c6-421f-a827-86a3c14a497c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:54.241223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-70ca1f82-f1c6-421f-a827-86a3c14a497c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:54.241908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-70ca1f82-f1c6-421f-a827-86a3c14a497c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:54.242354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-70ca1f82-f1c6-421f-a827-86a3c14a497c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:54.242773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-70ca1f82-f1c6-421f-a827-86a3c14a497c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:54.280122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-70ca1f82-f1c6-421f-a827-86a3c14a497c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054234 Sep 01 05:22:54.280682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 555/1142] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:54.280853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-44a1e98a-9eb1-4f8f-8659-ff43c1035651 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:54.283053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-44a1e98a-9eb1-4f8f-8659-ff43c1035651 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:54.290150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44a1e98a-9eb1-4f8f-8659-ff43c1035651 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:54.290931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44a1e98a-9eb1-4f8f-8659-ff43c1035651 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:54.291683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44a1e98a-9eb1-4f8f-8659-ff43c1035651 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:54.293016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44a1e98a-9eb1-4f8f-8659-ff43c1035651 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:54.293470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44a1e98a-9eb1-4f8f-8659-ff43c1035651 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:54.293887 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44a1e98a-9eb1-4f8f-8659-ff43c1035651 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:54.326786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-44a1e98a-9eb1-4f8f-8659-ff43c1035651 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049974 Sep 01 05:22:54.327339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 588/1143] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:54.697497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cd03482a-aa06-410f-bae7-bd2298762a88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:54.698111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cd03482a-aa06-410f-bae7-bd2298762a88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:54.704490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd03482a-aa06-410f-bae7-bd2298762a88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:54.705197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd03482a-aa06-410f-bae7-bd2298762a88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:54.706536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd03482a-aa06-410f-bae7-bd2298762a88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:54.707241 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd03482a-aa06-410f-bae7-bd2298762a88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:54.707689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd03482a-aa06-410f-bae7-bd2298762a88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:54.708164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd03482a-aa06-410f-bae7-bd2298762a88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:54.782033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cd03482a-aa06-410f-bae7-bd2298762a88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:54.790758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cd03482a-aa06-410f-bae7-bd2298762a88 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.097065 Sep 01 05:22:54.792275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 556/1144] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:54 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:55.294961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1cb4e582-d40e-45bf-a30f-42a533de4f0e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:55.297143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1cb4e582-d40e-45bf-a30f-42a533de4f0e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:55.304194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1cb4e582-d40e-45bf-a30f-42a533de4f0e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:55.304675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1cb4e582-d40e-45bf-a30f-42a533de4f0e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:55.305135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1cb4e582-d40e-45bf-a30f-42a533de4f0e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:55.305868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1cb4e582-d40e-45bf-a30f-42a533de4f0e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:55.306261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1cb4e582-d40e-45bf-a30f-42a533de4f0e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:55.306672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1cb4e582-d40e-45bf-a30f-42a533de4f0e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:55.338442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1cb4e582-d40e-45bf-a30f-42a533de4f0e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048895 Sep 01 05:22:55.339365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 589/1145] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:55.341431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-31c1ba2c-5ac8-4835-9b85-ece7bb3bb85f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:55.343744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-31c1ba2c-5ac8-4835-9b85-ece7bb3bb85f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:55.351242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-31c1ba2c-5ac8-4835-9b85-ece7bb3bb85f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:55.351723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-31c1ba2c-5ac8-4835-9b85-ece7bb3bb85f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:55.352150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-31c1ba2c-5ac8-4835-9b85-ece7bb3bb85f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:55.352863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-31c1ba2c-5ac8-4835-9b85-ece7bb3bb85f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:55.353334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-31c1ba2c-5ac8-4835-9b85-ece7bb3bb85f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:55.353748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-31c1ba2c-5ac8-4835-9b85-ece7bb3bb85f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:55.384109 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-31c1ba2c-5ac8-4835-9b85-ece7bb3bb85f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048450 Sep 01 05:22:55.385422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 557/1146] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:55 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:55.815400 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5a5bf10a-e756-472a-8bdd-3a9d7de710bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:55.816158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5a5bf10a-e756-472a-8bdd-3a9d7de710bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:55.822068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5a5bf10a-e756-472a-8bdd-3a9d7de710bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:55.822554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5a5bf10a-e756-472a-8bdd-3a9d7de710bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:55.822992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5a5bf10a-e756-472a-8bdd-3a9d7de710bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:55.823678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5a5bf10a-e756-472a-8bdd-3a9d7de710bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:55.824130 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5a5bf10a-e756-472a-8bdd-3a9d7de710bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:55.824555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5a5bf10a-e756-472a-8bdd-3a9d7de710bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:55.884287 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5a5bf10a-e756-472a-8bdd-3a9d7de710bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:55.891942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5a5bf10a-e756-472a-8bdd-3a9d7de710bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081256 Sep 01 05:22:55.892500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 590/1147] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:55 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:56.351507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-db6c9711-7b89-4e45-9131-7af823a52221 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:56.353639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-db6c9711-7b89-4e45-9131-7af823a52221 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:56.360451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db6c9711-7b89-4e45-9131-7af823a52221 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:56.360961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db6c9711-7b89-4e45-9131-7af823a52221 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:56.361399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db6c9711-7b89-4e45-9131-7af823a52221 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:56.362719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db6c9711-7b89-4e45-9131-7af823a52221 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:56.363163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db6c9711-7b89-4e45-9131-7af823a52221 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:56.363582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db6c9711-7b89-4e45-9131-7af823a52221 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:56.367277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:56.393237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-db6c9711-7b89-4e45-9131-7af823a52221 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045555 Sep 01 05:22:56.393895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 558/1148] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:56.396087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ae749cfa-5565-47a7-837a-7050924766bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:56.398419 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ae749cfa-5565-47a7-837a-7050924766bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:56.404942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae749cfa-5565-47a7-837a-7050924766bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:56.405606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae749cfa-5565-47a7-837a-7050924766bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:56.406201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae749cfa-5565-47a7-837a-7050924766bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:56.407234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae749cfa-5565-47a7-837a-7050924766bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:56.407863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae749cfa-5565-47a7-837a-7050924766bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:56.408392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae749cfa-5565-47a7-837a-7050924766bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:56.440331 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ae749cfa-5565-47a7-837a-7050924766bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047897 Sep 01 05:22:56.440965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 591/1149] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:56.913061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6d9cb3c3-f60f-4369-bfc1-1fba82e02217 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:56.914129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6d9cb3c3-f60f-4369-bfc1-1fba82e02217 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:56.920530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d9cb3c3-f60f-4369-bfc1-1fba82e02217 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:56.921034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d9cb3c3-f60f-4369-bfc1-1fba82e02217 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:56.921467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d9cb3c3-f60f-4369-bfc1-1fba82e02217 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:56.922180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d9cb3c3-f60f-4369-bfc1-1fba82e02217 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:56.922626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d9cb3c3-f60f-4369-bfc1-1fba82e02217 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:56.923045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d9cb3c3-f60f-4369-bfc1-1fba82e02217 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:56.990609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6d9cb3c3-f60f-4369-bfc1-1fba82e02217 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:56.998297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6d9cb3c3-f60f-4369-bfc1-1fba82e02217 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.089145 Sep 01 05:22:56.998856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 559/1150] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:56 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:57.405753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-546910d5-9083-4949-8816-e9e1513dd78d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:57.407953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-546910d5-9083-4949-8816-e9e1513dd78d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:57.414582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-546910d5-9083-4949-8816-e9e1513dd78d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:57.415065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-546910d5-9083-4949-8816-e9e1513dd78d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:57.415499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-546910d5-9083-4949-8816-e9e1513dd78d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:57.416185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-546910d5-9083-4949-8816-e9e1513dd78d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:57.416639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-546910d5-9083-4949-8816-e9e1513dd78d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:57.417115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-546910d5-9083-4949-8816-e9e1513dd78d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:57.446677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-546910d5-9083-4949-8816-e9e1513dd78d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044888 Sep 01 05:22:57.448958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 592/1151] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:57.452543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bdf5a6c9-289b-4773-a0e6-f5e4fb87a8c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:57.454730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bdf5a6c9-289b-4773-a0e6-f5e4fb87a8c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:57.461731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdf5a6c9-289b-4773-a0e6-f5e4fb87a8c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:57.462204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdf5a6c9-289b-4773-a0e6-f5e4fb87a8c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:57.462629 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdf5a6c9-289b-4773-a0e6-f5e4fb87a8c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:57.463298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdf5a6c9-289b-4773-a0e6-f5e4fb87a8c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:57.463738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdf5a6c9-289b-4773-a0e6-f5e4fb87a8c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:57.464152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdf5a6c9-289b-4773-a0e6-f5e4fb87a8c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:57.493190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bdf5a6c9-289b-4773-a0e6-f5e4fb87a8c2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044589 Sep 01 05:22:57.493732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 560/1152] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:57 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:58.019317 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4e9a45c7-f982-4924-8d9f-be7a60a58507 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:58.019927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4e9a45c7-f982-4924-8d9f-be7a60a58507 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:58.025871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e9a45c7-f982-4924-8d9f-be7a60a58507 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:58.026350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e9a45c7-f982-4924-8d9f-be7a60a58507 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:58.026785 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e9a45c7-f982-4924-8d9f-be7a60a58507 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:58.027463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e9a45c7-f982-4924-8d9f-be7a60a58507 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:58.027914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e9a45c7-f982-4924-8d9f-be7a60a58507 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:58.028336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e9a45c7-f982-4924-8d9f-be7a60a58507 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:58.089685 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4e9a45c7-f982-4924-8d9f-be7a60a58507 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:58.097776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4e9a45c7-f982-4924-8d9f-be7a60a58507 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082615 Sep 01 05:22:58.098328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 593/1153] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:58 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:58.459501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-40796b5a-7d37-4059-977d-a8547bdcf669 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:58.461693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-40796b5a-7d37-4059-977d-a8547bdcf669 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:58.468108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40796b5a-7d37-4059-977d-a8547bdcf669 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:58.468579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40796b5a-7d37-4059-977d-a8547bdcf669 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:58.469048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40796b5a-7d37-4059-977d-a8547bdcf669 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:58.469724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40796b5a-7d37-4059-977d-a8547bdcf669 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:58.470165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40796b5a-7d37-4059-977d-a8547bdcf669 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:58.470578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40796b5a-7d37-4059-977d-a8547bdcf669 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:58.500798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-40796b5a-7d37-4059-977d-a8547bdcf669 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045835 Sep 01 05:22:58.501349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 561/1154] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:58.502128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:22:58.502638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:22:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments (ip 10.222.0.49) !!! Sep 01 05:22:58.507897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7524e407-a28b-492f-ba36-813f9f284e2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:58.510060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7524e407-a28b-492f-ba36-813f9f284e2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:58.516580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7524e407-a28b-492f-ba36-813f9f284e2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:58.517087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7524e407-a28b-492f-ba36-813f9f284e2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:58.517526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7524e407-a28b-492f-ba36-813f9f284e2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:58.518225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7524e407-a28b-492f-ba36-813f9f284e2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:58.518747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7524e407-a28b-492f-ba36-813f9f284e2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:58.519061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7524e407-a28b-492f-ba36-813f9f284e2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:58.548201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7524e407-a28b-492f-ba36-813f9f284e2c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046878 Sep 01 05:22:58.548750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 594/1155] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:58 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:59.117933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5e87e117-0b88-4cb4-9230-1db6baab0a03 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:59.118554 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5e87e117-0b88-4cb4-9230-1db6baab0a03 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:59.124419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5e87e117-0b88-4cb4-9230-1db6baab0a03 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:59.124937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5e87e117-0b88-4cb4-9230-1db6baab0a03 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:59.125374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5e87e117-0b88-4cb4-9230-1db6baab0a03 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:59.126057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5e87e117-0b88-4cb4-9230-1db6baab0a03 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:59.126509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5e87e117-0b88-4cb4-9230-1db6baab0a03 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:59.126931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5e87e117-0b88-4cb4-9230-1db6baab0a03 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:59.187850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5e87e117-0b88-4cb4-9230-1db6baab0a03 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:59.196115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5e87e117-0b88-4cb4-9230-1db6baab0a03 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082055 Sep 01 05:22:59.196674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 562/1156] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:59 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:59.513874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-575ed01a-e538-4944-ad9a-2b2290178df7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:59.516003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-575ed01a-e538-4944-ad9a-2b2290178df7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:59.523137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-575ed01a-e538-4944-ad9a-2b2290178df7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:59.523610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-575ed01a-e538-4944-ad9a-2b2290178df7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:59.524041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-575ed01a-e538-4944-ad9a-2b2290178df7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:59.524716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-575ed01a-e538-4944-ad9a-2b2290178df7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:59.525189 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-575ed01a-e538-4944-ad9a-2b2290178df7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:59.525617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-575ed01a-e538-4944-ad9a-2b2290178df7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:59.550752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:59.555947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-575ed01a-e538-4944-ad9a-2b2290178df7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046216 Sep 01 05:22:59.556494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 595/1157] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:22:59 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:59.561002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0c15f65b-0e94-4e20-982c-41035fdff7e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:59.563153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0c15f65b-0e94-4e20-982c-41035fdff7e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:59.570592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c15f65b-0e94-4e20-982c-41035fdff7e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:59.571222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c15f65b-0e94-4e20-982c-41035fdff7e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:59.571504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c15f65b-0e94-4e20-982c-41035fdff7e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:59.572180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c15f65b-0e94-4e20-982c-41035fdff7e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:59.572623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c15f65b-0e94-4e20-982c-41035fdff7e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:59.573082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c15f65b-0e94-4e20-982c-41035fdff7e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:59.602910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0c15f65b-0e94-4e20-982c-41035fdff7e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Sep 01 05:22:59.603453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 563/1158] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:22:59 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:00.218360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6e793d96-b248-4559-aac2-fc5879c6914b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:00.218883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6e793d96-b248-4559-aac2-fc5879c6914b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:00.224852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e793d96-b248-4559-aac2-fc5879c6914b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:00.225329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e793d96-b248-4559-aac2-fc5879c6914b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:00.225755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e793d96-b248-4559-aac2-fc5879c6914b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:00.226433 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e793d96-b248-4559-aac2-fc5879c6914b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:00.226875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e793d96-b248-4559-aac2-fc5879c6914b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:00.227293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e793d96-b248-4559-aac2-fc5879c6914b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:00.291959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6e793d96-b248-4559-aac2-fc5879c6914b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:00.300463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6e793d96-b248-4559-aac2-fc5879c6914b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086313 Sep 01 05:23:00.301182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 596/1159] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:00 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:00.568597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-409b0544-9bc9-4451-8316-f0553b462f36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:00.570686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-409b0544-9bc9-4451-8316-f0553b462f36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:00.577100 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-409b0544-9bc9-4451-8316-f0553b462f36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:00.577569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-409b0544-9bc9-4451-8316-f0553b462f36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:00.577994 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-409b0544-9bc9-4451-8316-f0553b462f36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:00.578662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-409b0544-9bc9-4451-8316-f0553b462f36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:00.579107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-409b0544-9bc9-4451-8316-f0553b462f36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:00.579519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-409b0544-9bc9-4451-8316-f0553b462f36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:00.609066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-409b0544-9bc9-4451-8316-f0553b462f36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044639 Sep 01 05:23:00.609608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 564/1160] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:00 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:00.615089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fd36f0a0-9ba3-4e9f-8b4f-2495d406ae34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:00.617257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fd36f0a0-9ba3-4e9f-8b4f-2495d406ae34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:00.623636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd36f0a0-9ba3-4e9f-8b4f-2495d406ae34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:00.624120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd36f0a0-9ba3-4e9f-8b4f-2495d406ae34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:00.624563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd36f0a0-9ba3-4e9f-8b4f-2495d406ae34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:00.625273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd36f0a0-9ba3-4e9f-8b4f-2495d406ae34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:00.625731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd36f0a0-9ba3-4e9f-8b4f-2495d406ae34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:00.626162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd36f0a0-9ba3-4e9f-8b4f-2495d406ae34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:00.655341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fd36f0a0-9ba3-4e9f-8b4f-2495d406ae34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044218 Sep 01 05:23:00.655889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 597/1161] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:01.321665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-de50f8d4-0a10-4e99-95d7-91662e757de1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:01.322197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-de50f8d4-0a10-4e99-95d7-91662e757de1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:01.328116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de50f8d4-0a10-4e99-95d7-91662e757de1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:01.328593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de50f8d4-0a10-4e99-95d7-91662e757de1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:01.329058 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de50f8d4-0a10-4e99-95d7-91662e757de1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:01.329731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de50f8d4-0a10-4e99-95d7-91662e757de1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:01.330176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de50f8d4-0a10-4e99-95d7-91662e757de1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:01.330600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de50f8d4-0a10-4e99-95d7-91662e757de1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:01.391277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-de50f8d4-0a10-4e99-95d7-91662e757de1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:01.399099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-de50f8d4-0a10-4e99-95d7-91662e757de1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081354 Sep 01 05:23:01.399660 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 565/1162] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:01 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:01.621536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-534a6bc3-a952-4835-a598-8cda16756671 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:01.623675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-534a6bc3-a952-4835-a598-8cda16756671 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:01.630139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-534a6bc3-a952-4835-a598-8cda16756671 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:01.630611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-534a6bc3-a952-4835-a598-8cda16756671 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:01.631040 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-534a6bc3-a952-4835-a598-8cda16756671 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:01.631708 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-534a6bc3-a952-4835-a598-8cda16756671 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:01.632153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-534a6bc3-a952-4835-a598-8cda16756671 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:01.632567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-534a6bc3-a952-4835-a598-8cda16756671 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:01.662444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-534a6bc3-a952-4835-a598-8cda16756671 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044845 Sep 01 05:23:01.662992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 598/1163] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:01.667649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3a6f9c73-34c1-40ba-bbb8-5eb563e0bf8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:01.669804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3a6f9c73-34c1-40ba-bbb8-5eb563e0bf8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:01.676711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a6f9c73-34c1-40ba-bbb8-5eb563e0bf8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:01.677211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a6f9c73-34c1-40ba-bbb8-5eb563e0bf8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:01.677640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a6f9c73-34c1-40ba-bbb8-5eb563e0bf8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:01.678314 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a6f9c73-34c1-40ba-bbb8-5eb563e0bf8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:01.678758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a6f9c73-34c1-40ba-bbb8-5eb563e0bf8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:01.679169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3a6f9c73-34c1-40ba-bbb8-5eb563e0bf8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:01.707839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3a6f9c73-34c1-40ba-bbb8-5eb563e0bf8f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Sep 01 05:23:01.708376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 566/1164] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:01 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:02.420258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6244047c-04e4-45f6-ba69-913dece35cc4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:02.420884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6244047c-04e4-45f6-ba69-913dece35cc4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:02.426765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6244047c-04e4-45f6-ba69-913dece35cc4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:02.427237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6244047c-04e4-45f6-ba69-913dece35cc4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:02.427670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6244047c-04e4-45f6-ba69-913dece35cc4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:02.428336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6244047c-04e4-45f6-ba69-913dece35cc4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:02.428800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6244047c-04e4-45f6-ba69-913dece35cc4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:02.429288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6244047c-04e4-45f6-ba69-913dece35cc4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:02.489483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6244047c-04e4-45f6-ba69-913dece35cc4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:02.497204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6244047c-04e4-45f6-ba69-913dece35cc4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.080827 Sep 01 05:23:02.497767 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 599/1165] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:02 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:02.675202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8d540250-5567-4942-9333-601a1acb00df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:02.677152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8d540250-5567-4942-9333-601a1acb00df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:02.683496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d540250-5567-4942-9333-601a1acb00df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:02.683967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d540250-5567-4942-9333-601a1acb00df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:02.684394 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d540250-5567-4942-9333-601a1acb00df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:02.685097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d540250-5567-4942-9333-601a1acb00df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:02.685541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d540250-5567-4942-9333-601a1acb00df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:02.685956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d540250-5567-4942-9333-601a1acb00df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:02.715742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8d540250-5567-4942-9333-601a1acb00df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045347 Sep 01 05:23:02.716299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 567/1166] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:02.719613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-320fdc9d-dbb4-4faa-bb64-96297d44127d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:02.722880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-320fdc9d-dbb4-4faa-bb64-96297d44127d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:02.729185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-320fdc9d-dbb4-4faa-bb64-96297d44127d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:02.729660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-320fdc9d-dbb4-4faa-bb64-96297d44127d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:02.730087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-320fdc9d-dbb4-4faa-bb64-96297d44127d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:02.730765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-320fdc9d-dbb4-4faa-bb64-96297d44127d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:02.731205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-320fdc9d-dbb4-4faa-bb64-96297d44127d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:02.731620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-320fdc9d-dbb4-4faa-bb64-96297d44127d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:02.761378 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-320fdc9d-dbb4-4faa-bb64-96297d44127d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045795 Sep 01 05:23:02.761946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 600/1167] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:02 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:03.519350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bf831fb5-1dd2-427e-8f95-9dd6e7ab6cbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:03.519989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bf831fb5-1dd2-427e-8f95-9dd6e7ab6cbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:03.526152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf831fb5-1dd2-427e-8f95-9dd6e7ab6cbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:03.526626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf831fb5-1dd2-427e-8f95-9dd6e7ab6cbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:03.527053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf831fb5-1dd2-427e-8f95-9dd6e7ab6cbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:03.527779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf831fb5-1dd2-427e-8f95-9dd6e7ab6cbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:03.528222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf831fb5-1dd2-427e-8f95-9dd6e7ab6cbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:03.528637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf831fb5-1dd2-427e-8f95-9dd6e7ab6cbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:03.593393 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bf831fb5-1dd2-427e-8f95-9dd6e7ab6cbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:03.601721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bf831fb5-1dd2-427e-8f95-9dd6e7ab6cbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086965 Sep 01 05:23:03.602280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 568/1168] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:03 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:03.728679 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-10c446ad-599a-442b-bee0-3b9b8778dc5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:03.730834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-10c446ad-599a-442b-bee0-3b9b8778dc5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:03.737959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-10c446ad-599a-442b-bee0-3b9b8778dc5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:03.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-10c446ad-599a-442b-bee0-3b9b8778dc5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:03.738879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-10c446ad-599a-442b-bee0-3b9b8778dc5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:03.739559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-10c446ad-599a-442b-bee0-3b9b8778dc5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:03.740006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-10c446ad-599a-442b-bee0-3b9b8778dc5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:03.740428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-10c446ad-599a-442b-bee0-3b9b8778dc5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:03.770639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-10c446ad-599a-442b-bee0-3b9b8778dc5d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045855 Sep 01 05:23:03.771117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 601/1169] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:03.773938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2dc0a859-8f36-4f74-bef2-0bd95012500b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:03.776116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2dc0a859-8f36-4f74-bef2-0bd95012500b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:03.782540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2dc0a859-8f36-4f74-bef2-0bd95012500b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:03.783022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2dc0a859-8f36-4f74-bef2-0bd95012500b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:03.783455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2dc0a859-8f36-4f74-bef2-0bd95012500b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:03.784303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2dc0a859-8f36-4f74-bef2-0bd95012500b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:03.785258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2dc0a859-8f36-4f74-bef2-0bd95012500b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:03.785693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2dc0a859-8f36-4f74-bef2-0bd95012500b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:03.815888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2dc0a859-8f36-4f74-bef2-0bd95012500b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Sep 01 05:23:03.816447 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 569/1170] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:03 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:04.622474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7e13b32a-765c-4f01-9edb-0792e8986186 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:04.622995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7e13b32a-765c-4f01-9edb-0792e8986186 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:04.629558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e13b32a-765c-4f01-9edb-0792e8986186 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:04.630043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e13b32a-765c-4f01-9edb-0792e8986186 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:04.630474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e13b32a-765c-4f01-9edb-0792e8986186 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:04.631155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e13b32a-765c-4f01-9edb-0792e8986186 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:04.631605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e13b32a-765c-4f01-9edb-0792e8986186 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:04.632028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e13b32a-765c-4f01-9edb-0792e8986186 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:04.692993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7e13b32a-765c-4f01-9edb-0792e8986186 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:04.700604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7e13b32a-765c-4f01-9edb-0792e8986186 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082155 Sep 01 05:23:04.701201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 602/1171] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:04 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:04.782768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-edbf1cd0-87c0-4e62-a0bf-a1d6a9d95bc7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:04.785120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-edbf1cd0-87c0-4e62-a0bf-a1d6a9d95bc7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:04.791395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edbf1cd0-87c0-4e62-a0bf-a1d6a9d95bc7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:04.791898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edbf1cd0-87c0-4e62-a0bf-a1d6a9d95bc7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:04.792347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edbf1cd0-87c0-4e62-a0bf-a1d6a9d95bc7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:04.793044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edbf1cd0-87c0-4e62-a0bf-a1d6a9d95bc7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:04.793515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edbf1cd0-87c0-4e62-a0bf-a1d6a9d95bc7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:04.793931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-edbf1cd0-87c0-4e62-a0bf-a1d6a9d95bc7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:04.822969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-edbf1cd0-87c0-4e62-a0bf-a1d6a9d95bc7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044178 Sep 01 05:23:04.823526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 570/1172] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:04.827789 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cfdc35fd-1183-43ec-b2eb-d433ac4cbd9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:04.830208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cfdc35fd-1183-43ec-b2eb-d433ac4cbd9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:04.837650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cfdc35fd-1183-43ec-b2eb-d433ac4cbd9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:04.838134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cfdc35fd-1183-43ec-b2eb-d433ac4cbd9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:04.838566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cfdc35fd-1183-43ec-b2eb-d433ac4cbd9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:04.839263 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cfdc35fd-1183-43ec-b2eb-d433ac4cbd9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:04.839713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cfdc35fd-1183-43ec-b2eb-d433ac4cbd9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:04.840134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cfdc35fd-1183-43ec-b2eb-d433ac4cbd9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:04.870057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cfdc35fd-1183-43ec-b2eb-d433ac4cbd9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046244 Sep 01 05:23:04.870627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 603/1173] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:05.722776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f38b5003-8be7-4557-9a73-299d0e3925dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:05.723405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f38b5003-8be7-4557-9a73-299d0e3925dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:05.729328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f38b5003-8be7-4557-9a73-299d0e3925dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:05.729803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f38b5003-8be7-4557-9a73-299d0e3925dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:05.730230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f38b5003-8be7-4557-9a73-299d0e3925dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:05.730902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f38b5003-8be7-4557-9a73-299d0e3925dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:05.731345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f38b5003-8be7-4557-9a73-299d0e3925dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:05.731756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f38b5003-8be7-4557-9a73-299d0e3925dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:05.794610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f38b5003-8be7-4557-9a73-299d0e3925dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:05.802928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f38b5003-8be7-4557-9a73-299d0e3925dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084770 Sep 01 05:23:05.803486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 571/1174] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:05 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:05.835174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1a22f96a-bc90-4dbc-b381-2879233cf69f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:05.837253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1a22f96a-bc90-4dbc-b381-2879233cf69f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:05.843634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a22f96a-bc90-4dbc-b381-2879233cf69f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:05.844110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a22f96a-bc90-4dbc-b381-2879233cf69f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:05.844542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a22f96a-bc90-4dbc-b381-2879233cf69f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:05.845260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a22f96a-bc90-4dbc-b381-2879233cf69f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:05.845710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a22f96a-bc90-4dbc-b381-2879233cf69f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:05.846131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a22f96a-bc90-4dbc-b381-2879233cf69f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:05.876478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1a22f96a-bc90-4dbc-b381-2879233cf69f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045916 Sep 01 05:23:05.877247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 604/1175] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:05.883698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-32d411b4-416f-4f3d-86c3-d9fbe339ef9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:05.885869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-32d411b4-416f-4f3d-86c3-d9fbe339ef9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:05.891788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32d411b4-416f-4f3d-86c3-d9fbe339ef9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:05.892268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32d411b4-416f-4f3d-86c3-d9fbe339ef9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:05.892699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32d411b4-416f-4f3d-86c3-d9fbe339ef9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:05.893936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32d411b4-416f-4f3d-86c3-d9fbe339ef9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:05.894407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32d411b4-416f-4f3d-86c3-d9fbe339ef9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:05.894831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32d411b4-416f-4f3d-86c3-d9fbe339ef9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:05.925045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-32d411b4-416f-4f3d-86c3-d9fbe339ef9b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Sep 01 05:23:05.926121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 572/1176] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:05 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:06.824248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2b8e6865-f8db-4b1c-b87e-c0e97ed52953 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:06.824876 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2b8e6865-f8db-4b1c-b87e-c0e97ed52953 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:06.831424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b8e6865-f8db-4b1c-b87e-c0e97ed52953 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:06.831912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b8e6865-f8db-4b1c-b87e-c0e97ed52953 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:06.832334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b8e6865-f8db-4b1c-b87e-c0e97ed52953 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:06.833040 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b8e6865-f8db-4b1c-b87e-c0e97ed52953 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:06.833485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b8e6865-f8db-4b1c-b87e-c0e97ed52953 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:06.833901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b8e6865-f8db-4b1c-b87e-c0e97ed52953 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:06.894466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-51aa5ea4-f9b2-4440-912a-e6c45ad253ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:06.895039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2b8e6865-f8db-4b1c-b87e-c0e97ed52953 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:06.896716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-51aa5ea4-f9b2-4440-912a-e6c45ad253ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:06.902771 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2b8e6865-f8db-4b1c-b87e-c0e97ed52953 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082453 Sep 01 05:23:06.903086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51aa5ea4-f9b2-4440-912a-e6c45ad253ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:06.903331 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 605/1177] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:06 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:06.903565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51aa5ea4-f9b2-4440-912a-e6c45ad253ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:06.904004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51aa5ea4-f9b2-4440-912a-e6c45ad253ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:06.904731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51aa5ea4-f9b2-4440-912a-e6c45ad253ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:06.905318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51aa5ea4-f9b2-4440-912a-e6c45ad253ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:06.905740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51aa5ea4-f9b2-4440-912a-e6c45ad253ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:06.935590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-51aa5ea4-f9b2-4440-912a-e6c45ad253ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050260 Sep 01 05:23:06.936144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 573/1178] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:23:06.937731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-de42a546-7488-4a29-b234-1bb1337f8597 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:06.940673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-de42a546-7488-4a29-b234-1bb1337f8597 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:06.946644 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de42a546-7488-4a29-b234-1bb1337f8597 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:06.947119 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de42a546-7488-4a29-b234-1bb1337f8597 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:06.947542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de42a546-7488-4a29-b234-1bb1337f8597 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:06.948218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de42a546-7488-4a29-b234-1bb1337f8597 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:06.948659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de42a546-7488-4a29-b234-1bb1337f8597 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:06.949099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-de42a546-7488-4a29-b234-1bb1337f8597 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:06.979110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-de42a546-7488-4a29-b234-1bb1337f8597 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045291 Sep 01 05:23:06.979656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 606/1179] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:06 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:07.923347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c0b8bb9f-5d3f-421f-a142-6debfcd3134d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:07.923959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c0b8bb9f-5d3f-421f-a142-6debfcd3134d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:07.931146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c0b8bb9f-5d3f-421f-a142-6debfcd3134d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:07.931618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c0b8bb9f-5d3f-421f-a142-6debfcd3134d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:07.932047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c0b8bb9f-5d3f-421f-a142-6debfcd3134d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:07.932717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c0b8bb9f-5d3f-421f-a142-6debfcd3134d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:07.933190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c0b8bb9f-5d3f-421f-a142-6debfcd3134d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:07.933603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c0b8bb9f-5d3f-421f-a142-6debfcd3134d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:07.948486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f050cea9-cd47-4a0a-a8e3-0a22c7fd8d6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:07.950641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f050cea9-cd47-4a0a-a8e3-0a22c7fd8d6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:07.957973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f050cea9-cd47-4a0a-a8e3-0a22c7fd8d6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:07.958460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f050cea9-cd47-4a0a-a8e3-0a22c7fd8d6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:07.958893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f050cea9-cd47-4a0a-a8e3-0a22c7fd8d6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:07.959582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f050cea9-cd47-4a0a-a8e3-0a22c7fd8d6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:07.960030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f050cea9-cd47-4a0a-a8e3-0a22c7fd8d6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:07.960452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f050cea9-cd47-4a0a-a8e3-0a22c7fd8d6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:07.991684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f050cea9-cd47-4a0a-a8e3-0a22c7fd8d6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047112 Sep 01 05:23:07.992253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 607/1180] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:07 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:23:07.996576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c0b8bb9f-5d3f-421f-a142-6debfcd3134d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:07.996958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-806f3884-a393-47f1-8c85-6bbec8f80da6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:07.998746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:07.999062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-806f3884-a393-47f1-8c85-6bbec8f80da6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:08.005236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806f3884-a393-47f1-8c85-6bbec8f80da6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:08.005722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806f3884-a393-47f1-8c85-6bbec8f80da6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:08.006098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c0b8bb9f-5d3f-421f-a142-6debfcd3134d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086519 Sep 01 05:23:08.006210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806f3884-a393-47f1-8c85-6bbec8f80da6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:08.006705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 574/1181] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:07 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:08.006827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806f3884-a393-47f1-8c85-6bbec8f80da6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:08.007272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806f3884-a393-47f1-8c85-6bbec8f80da6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:08.007696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806f3884-a393-47f1-8c85-6bbec8f80da6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:08.038485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-806f3884-a393-47f1-8c85-6bbec8f80da6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045249 Sep 01 05:23:08.039033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 608/1182] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:07 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:09.004757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-62b2eb19-b017-4571-aff2-52d39a823d5c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:09.006940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-62b2eb19-b017-4571-aff2-52d39a823d5c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:09.013507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62b2eb19-b017-4571-aff2-52d39a823d5c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:09.013988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62b2eb19-b017-4571-aff2-52d39a823d5c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:09.014426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62b2eb19-b017-4571-aff2-52d39a823d5c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:09.015110 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62b2eb19-b017-4571-aff2-52d39a823d5c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:09.015562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62b2eb19-b017-4571-aff2-52d39a823d5c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:09.015986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62b2eb19-b017-4571-aff2-52d39a823d5c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:09.026416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b27f1c27-b670-46bd-8d07-980501581a05 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:09.027023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b27f1c27-b670-46bd-8d07-980501581a05 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:09.033543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b27f1c27-b670-46bd-8d07-980501581a05 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:09.034043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b27f1c27-b670-46bd-8d07-980501581a05 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:09.034469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b27f1c27-b670-46bd-8d07-980501581a05 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:09.035147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b27f1c27-b670-46bd-8d07-980501581a05 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:09.035591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b27f1c27-b670-46bd-8d07-980501581a05 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:09.036008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b27f1c27-b670-46bd-8d07-980501581a05 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:09.046604 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-62b2eb19-b017-4571-aff2-52d39a823d5c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046740 Sep 01 05:23:09.047176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 575/1183] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:09.055454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7808498f-1dca-4c64-847b-b6b9d0d137bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:09.057610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7808498f-1dca-4c64-847b-b6b9d0d137bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:09.063349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7808498f-1dca-4c64-847b-b6b9d0d137bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:09.063833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7808498f-1dca-4c64-847b-b6b9d0d137bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:09.064533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7808498f-1dca-4c64-847b-b6b9d0d137bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:09.065840 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7808498f-1dca-4c64-847b-b6b9d0d137bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:09.066302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7808498f-1dca-4c64-847b-b6b9d0d137bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:09.066728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7808498f-1dca-4c64-847b-b6b9d0d137bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:09.098906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7808498f-1dca-4c64-847b-b6b9d0d137bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050661 Sep 01 05:23:09.099737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 576/1184] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:09 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:09.102670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b27f1c27-b670-46bd-8d07-980501581a05 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:09.110318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b27f1c27-b670-46bd-8d07-980501581a05 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087723 Sep 01 05:23:09.110865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 609/1185] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:09 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:10.059731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9ae1b141-ffbc-43e3-8456-b9a048dcb8ad tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:10.061917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9ae1b141-ffbc-43e3-8456-b9a048dcb8ad tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:10.068660 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ae1b141-ffbc-43e3-8456-b9a048dcb8ad tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:10.069171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ae1b141-ffbc-43e3-8456-b9a048dcb8ad tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:10.069611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ae1b141-ffbc-43e3-8456-b9a048dcb8ad tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:10.070297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ae1b141-ffbc-43e3-8456-b9a048dcb8ad tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:10.070748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ae1b141-ffbc-43e3-8456-b9a048dcb8ad tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:10.071175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ae1b141-ffbc-43e3-8456-b9a048dcb8ad tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:10.100938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9ae1b141-ffbc-43e3-8456-b9a048dcb8ad tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045243 Sep 01 05:23:10.101495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 577/1186] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:10 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:10.111113 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b66077dc-7c57-4708-a1c2-c486f8649254 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:10.113873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b66077dc-7c57-4708-a1c2-c486f8649254 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:10.120179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b66077dc-7c57-4708-a1c2-c486f8649254 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:10.120654 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b66077dc-7c57-4708-a1c2-c486f8649254 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:10.121119 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b66077dc-7c57-4708-a1c2-c486f8649254 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:10.121797 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b66077dc-7c57-4708-a1c2-c486f8649254 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:10.122242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b66077dc-7c57-4708-a1c2-c486f8649254 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:10.122655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b66077dc-7c57-4708-a1c2-c486f8649254 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:10.131235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-295481bc-2cb2-4feb-9083-d8abd599edd7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:10.131844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-295481bc-2cb2-4feb-9083-d8abd599edd7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:10.137715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-295481bc-2cb2-4feb-9083-d8abd599edd7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:10.138190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-295481bc-2cb2-4feb-9083-d8abd599edd7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:10.138619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-295481bc-2cb2-4feb-9083-d8abd599edd7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:10.139296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-295481bc-2cb2-4feb-9083-d8abd599edd7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:10.139737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-295481bc-2cb2-4feb-9083-d8abd599edd7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:10.140149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-295481bc-2cb2-4feb-9083-d8abd599edd7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:10.151874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b66077dc-7c57-4708-a1c2-c486f8649254 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Sep 01 05:23:10.152445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 610/1187] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:10.202190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-295481bc-2cb2-4feb-9083-d8abd599edd7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:10.211112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-295481bc-2cb2-4feb-9083-d8abd599edd7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083672 Sep 01 05:23:10.211682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 578/1188] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:10 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:11.114228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f84d7868-b2d1-492c-a3d0-dd02b9ea9e72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:11.116285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f84d7868-b2d1-492c-a3d0-dd02b9ea9e72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:11.122710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f84d7868-b2d1-492c-a3d0-dd02b9ea9e72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.123190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f84d7868-b2d1-492c-a3d0-dd02b9ea9e72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.123630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f84d7868-b2d1-492c-a3d0-dd02b9ea9e72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.124311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f84d7868-b2d1-492c-a3d0-dd02b9ea9e72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.124762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f84d7868-b2d1-492c-a3d0-dd02b9ea9e72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.125199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f84d7868-b2d1-492c-a3d0-dd02b9ea9e72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.155353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f84d7868-b2d1-492c-a3d0-dd02b9ea9e72 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046009 Sep 01 05:23:11.155901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 611/1189] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:11.163531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4a8ad838-4103-4e97-a1a1-137c23675499 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:11.165812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4a8ad838-4103-4e97-a1a1-137c23675499 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:11.172183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a8ad838-4103-4e97-a1a1-137c23675499 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.172660 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a8ad838-4103-4e97-a1a1-137c23675499 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.173126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a8ad838-4103-4e97-a1a1-137c23675499 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.173811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a8ad838-4103-4e97-a1a1-137c23675499 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.174263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a8ad838-4103-4e97-a1a1-137c23675499 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.175196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a8ad838-4103-4e97-a1a1-137c23675499 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.205434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4a8ad838-4103-4e97-a1a1-137c23675499 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045776 Sep 01 05:23:11.206115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 579/1190] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:11 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:11.232910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-aeb0c5a0-9997-444f-af97-9afa356e6cc9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:11.233513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-aeb0c5a0-9997-444f-af97-9afa356e6cc9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:11.240222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aeb0c5a0-9997-444f-af97-9afa356e6cc9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.240703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aeb0c5a0-9997-444f-af97-9afa356e6cc9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.241159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aeb0c5a0-9997-444f-af97-9afa356e6cc9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.241841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aeb0c5a0-9997-444f-af97-9afa356e6cc9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.242288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aeb0c5a0-9997-444f-af97-9afa356e6cc9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.242706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aeb0c5a0-9997-444f-af97-9afa356e6cc9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.258201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:11.304168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-aeb0c5a0-9997-444f-af97-9afa356e6cc9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:11.311865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-aeb0c5a0-9997-444f-af97-9afa356e6cc9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082878 Sep 01 05:23:11.312429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 612/1191] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:11 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:12.168094 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-625cda4e-3171-433d-9ef1-e199062a843b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:12.170154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-625cda4e-3171-433d-9ef1-e199062a843b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:12.177386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-625cda4e-3171-433d-9ef1-e199062a843b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:12.177955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-625cda4e-3171-433d-9ef1-e199062a843b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:12.178389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-625cda4e-3171-433d-9ef1-e199062a843b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:12.179062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-625cda4e-3171-433d-9ef1-e199062a843b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:12.179504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-625cda4e-3171-433d-9ef1-e199062a843b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:12.179921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-625cda4e-3171-433d-9ef1-e199062a843b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:12.209742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-625cda4e-3171-433d-9ef1-e199062a843b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045668 Sep 01 05:23:12.210294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 580/1192] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:12 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:12.217656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3b607281-4c36-42ff-b903-42810ce753de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:12.219777 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3b607281-4c36-42ff-b903-42810ce753de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:12.226987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3b607281-4c36-42ff-b903-42810ce753de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:12.227461 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3b607281-4c36-42ff-b903-42810ce753de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:12.227892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3b607281-4c36-42ff-b903-42810ce753de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:12.228568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3b607281-4c36-42ff-b903-42810ce753de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:12.229168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3b607281-4c36-42ff-b903-42810ce753de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:12.229753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3b607281-4c36-42ff-b903-42810ce753de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:12.259144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3b607281-4c36-42ff-b903-42810ce753de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045344 Sep 01 05:23:12.259693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 613/1193] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:12 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:12.333899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-32d12722-5243-45be-8a1b-6866431c143d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:12.334509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-32d12722-5243-45be-8a1b-6866431c143d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:12.340371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32d12722-5243-45be-8a1b-6866431c143d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:12.340872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32d12722-5243-45be-8a1b-6866431c143d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:12.341303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32d12722-5243-45be-8a1b-6866431c143d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:12.341979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32d12722-5243-45be-8a1b-6866431c143d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:12.342421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32d12722-5243-45be-8a1b-6866431c143d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:12.342833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32d12722-5243-45be-8a1b-6866431c143d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:12.405281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-32d12722-5243-45be-8a1b-6866431c143d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:12.413609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-32d12722-5243-45be-8a1b-6866431c143d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083721 Sep 01 05:23:12.414168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 581/1194] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:12 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:13.222883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dfc7cec0-a5dc-4ea2-b49d-7d80a4a36e33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:13.224963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dfc7cec0-a5dc-4ea2-b49d-7d80a4a36e33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:13.230925 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dfc7cec0-a5dc-4ea2-b49d-7d80a4a36e33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:13.231401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dfc7cec0-a5dc-4ea2-b49d-7d80a4a36e33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:13.231831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dfc7cec0-a5dc-4ea2-b49d-7d80a4a36e33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:13.232513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dfc7cec0-a5dc-4ea2-b49d-7d80a4a36e33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:13.233005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dfc7cec0-a5dc-4ea2-b49d-7d80a4a36e33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:13.233433 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dfc7cec0-a5dc-4ea2-b49d-7d80a4a36e33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:13.263487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dfc7cec0-a5dc-4ea2-b49d-7d80a4a36e33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045178 Sep 01 05:23:13.264030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 614/1195] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:13 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:13.271697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-67ce7b94-c0bb-45d7-aef6-9f8353347aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:13.273848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-67ce7b94-c0bb-45d7-aef6-9f8353347aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:13.280598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67ce7b94-c0bb-45d7-aef6-9f8353347aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:13.281118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67ce7b94-c0bb-45d7-aef6-9f8353347aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:13.281549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67ce7b94-c0bb-45d7-aef6-9f8353347aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:13.282229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67ce7b94-c0bb-45d7-aef6-9f8353347aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:13.282672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67ce7b94-c0bb-45d7-aef6-9f8353347aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:13.283088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67ce7b94-c0bb-45d7-aef6-9f8353347aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:13.312649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-67ce7b94-c0bb-45d7-aef6-9f8353347aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Sep 01 05:23:13.313225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 582/1196] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:13.435423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dbdde058-fa5a-4dd5-bf31-a3b3955ab6d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:13.436063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dbdde058-fa5a-4dd5-bf31-a3b3955ab6d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:13.442952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbdde058-fa5a-4dd5-bf31-a3b3955ab6d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:13.443460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbdde058-fa5a-4dd5-bf31-a3b3955ab6d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:13.443916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbdde058-fa5a-4dd5-bf31-a3b3955ab6d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:13.444603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbdde058-fa5a-4dd5-bf31-a3b3955ab6d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:13.445085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbdde058-fa5a-4dd5-bf31-a3b3955ab6d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:13.445507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbdde058-fa5a-4dd5-bf31-a3b3955ab6d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:13.506840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dbdde058-fa5a-4dd5-bf31-a3b3955ab6d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:13.514508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dbdde058-fa5a-4dd5-bf31-a3b3955ab6d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082926 Sep 01 05:23:13.515093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 615/1197] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:13 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:14.276125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-adef2032-6d78-4135-be72-28ec1981630d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:14.278214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-adef2032-6d78-4135-be72-28ec1981630d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:14.285520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-adef2032-6d78-4135-be72-28ec1981630d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:14.285999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-adef2032-6d78-4135-be72-28ec1981630d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:14.286435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-adef2032-6d78-4135-be72-28ec1981630d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:14.287127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-adef2032-6d78-4135-be72-28ec1981630d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:14.287574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-adef2032-6d78-4135-be72-28ec1981630d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:14.287995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-adef2032-6d78-4135-be72-28ec1981630d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:14.320098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-adef2032-6d78-4135-be72-28ec1981630d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048365 Sep 01 05:23:14.320664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 583/1198] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:14.326205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2707d215-b627-486d-bbf4-7ea20f73cbe7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:14.328377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2707d215-b627-486d-bbf4-7ea20f73cbe7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:14.335374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2707d215-b627-486d-bbf4-7ea20f73cbe7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:14.335856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2707d215-b627-486d-bbf4-7ea20f73cbe7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:14.336325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2707d215-b627-486d-bbf4-7ea20f73cbe7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:14.337135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2707d215-b627-486d-bbf4-7ea20f73cbe7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:14.337592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2707d215-b627-486d-bbf4-7ea20f73cbe7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:14.338089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2707d215-b627-486d-bbf4-7ea20f73cbe7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:14.368092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2707d215-b627-486d-bbf4-7ea20f73cbe7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045847 Sep 01 05:23:14.368639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 616/1199] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:14 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:14.536253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8d045077-5925-45b6-a789-9f70981acadd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:14.537069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8d045077-5925-45b6-a789-9f70981acadd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:14.542973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d045077-5925-45b6-a789-9f70981acadd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:14.543446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d045077-5925-45b6-a789-9f70981acadd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:14.543872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d045077-5925-45b6-a789-9f70981acadd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:14.544544 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d045077-5925-45b6-a789-9f70981acadd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:14.545234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d045077-5925-45b6-a789-9f70981acadd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:14.545657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d045077-5925-45b6-a789-9f70981acadd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:14.608909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8d045077-5925-45b6-a789-9f70981acadd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:14.617123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8d045077-5925-45b6-a789-9f70981acadd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085457 Sep 01 05:23:14.617773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 584/1200] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:14 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:15.332892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3a71dc48-e032-4c56-810c-2febdb2182e1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:15.335019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3a71dc48-e032-4c56-810c-2febdb2182e1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:15.341847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a71dc48-e032-4c56-810c-2febdb2182e1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:15.342328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a71dc48-e032-4c56-810c-2febdb2182e1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:15.342833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a71dc48-e032-4c56-810c-2febdb2182e1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:15.343519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a71dc48-e032-4c56-810c-2febdb2182e1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:15.343967 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a71dc48-e032-4c56-810c-2febdb2182e1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:15.344387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a71dc48-e032-4c56-810c-2febdb2182e1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:15.376646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3a71dc48-e032-4c56-810c-2febdb2182e1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048291 Sep 01 05:23:15.377261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 617/1201] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:15.380712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-494074e9-e0c6-4ceb-a8cb-e2562d61872e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:15.382898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-494074e9-e0c6-4ceb-a8cb-e2562d61872e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:15.389217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-494074e9-e0c6-4ceb-a8cb-e2562d61872e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:15.389686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-494074e9-e0c6-4ceb-a8cb-e2562d61872e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:15.390108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-494074e9-e0c6-4ceb-a8cb-e2562d61872e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:15.390812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-494074e9-e0c6-4ceb-a8cb-e2562d61872e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:15.391253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-494074e9-e0c6-4ceb-a8cb-e2562d61872e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:15.391664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-494074e9-e0c6-4ceb-a8cb-e2562d61872e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:15.420899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-494074e9-e0c6-4ceb-a8cb-e2562d61872e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044380 Sep 01 05:23:15.421446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 585/1202] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:15.724120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c0ae45a5-5351-4472-a70b-1644417d9f35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:15.724735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c0ae45a5-5351-4472-a70b-1644417d9f35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:15.730638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0ae45a5-5351-4472-a70b-1644417d9f35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:15.731115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0ae45a5-5351-4472-a70b-1644417d9f35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:15.731546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0ae45a5-5351-4472-a70b-1644417d9f35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:15.732226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0ae45a5-5351-4472-a70b-1644417d9f35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:15.732673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0ae45a5-5351-4472-a70b-1644417d9f35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:15.733116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0ae45a5-5351-4472-a70b-1644417d9f35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:15.793381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c0ae45a5-5351-4472-a70b-1644417d9f35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:15.801458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c0ae45a5-5351-4472-a70b-1644417d9f35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.167111 Sep 01 05:23:15.802013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 618/1203] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:15 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:16.388513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a80901ea-b903-4410-be3e-0bd48808d059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:16.390735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a80901ea-b903-4410-be3e-0bd48808d059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:16.397432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a80901ea-b903-4410-be3e-0bd48808d059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:16.397906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a80901ea-b903-4410-be3e-0bd48808d059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:16.398338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a80901ea-b903-4410-be3e-0bd48808d059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:16.399017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a80901ea-b903-4410-be3e-0bd48808d059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:16.399470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a80901ea-b903-4410-be3e-0bd48808d059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:16.399890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a80901ea-b903-4410-be3e-0bd48808d059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:16.429262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a80901ea-b903-4410-be3e-0bd48808d059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044679 Sep 01 05:23:16.429817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 586/1204] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:16 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:16.434195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6acae243-6ff1-4b1e-ad32-c26d6008f374 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:16.436404 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6acae243-6ff1-4b1e-ad32-c26d6008f374 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:16.443722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6acae243-6ff1-4b1e-ad32-c26d6008f374 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:16.444196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6acae243-6ff1-4b1e-ad32-c26d6008f374 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:16.444620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6acae243-6ff1-4b1e-ad32-c26d6008f374 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:16.445316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6acae243-6ff1-4b1e-ad32-c26d6008f374 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:16.445757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6acae243-6ff1-4b1e-ad32-c26d6008f374 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:16.446168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6acae243-6ff1-4b1e-ad32-c26d6008f374 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:16.474501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6acae243-6ff1-4b1e-ad32-c26d6008f374 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Sep 01 05:23:16.475043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 619/1205] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:16 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:16.822476 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-da22767c-73ce-490b-a84c-451b5e5363db tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:16.823001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-da22767c-73ce-490b-a84c-451b5e5363db tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:16.828946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-da22767c-73ce-490b-a84c-451b5e5363db tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:16.829425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-da22767c-73ce-490b-a84c-451b5e5363db tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:16.829855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-da22767c-73ce-490b-a84c-451b5e5363db tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:16.830529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-da22767c-73ce-490b-a84c-451b5e5363db tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:16.831011 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-da22767c-73ce-490b-a84c-451b5e5363db tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:16.831511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-da22767c-73ce-490b-a84c-451b5e5363db tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:16.891777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-da22767c-73ce-490b-a84c-451b5e5363db tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:16.899632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-da22767c-73ce-490b-a84c-451b5e5363db tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081103 Sep 01 05:23:16.900189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 587/1206] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:16 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:17.442294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4947b876-4d4a-4736-b8d4-2abe6bb09295 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:17.444414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4947b876-4d4a-4736-b8d4-2abe6bb09295 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:17.450766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4947b876-4d4a-4736-b8d4-2abe6bb09295 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:17.451238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4947b876-4d4a-4736-b8d4-2abe6bb09295 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:17.451663 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4947b876-4d4a-4736-b8d4-2abe6bb09295 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:17.452332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4947b876-4d4a-4736-b8d4-2abe6bb09295 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:17.452801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4947b876-4d4a-4736-b8d4-2abe6bb09295 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:17.453218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4947b876-4d4a-4736-b8d4-2abe6bb09295 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:17.481876 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4947b876-4d4a-4736-b8d4-2abe6bb09295 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043891 Sep 01 05:23:17.482418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 620/1207] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:17 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:17.486907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-58bc2bc2-aabd-49c4-94b4-4947f1c19077 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:17.489744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-58bc2bc2-aabd-49c4-94b4-4947f1c19077 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:17.492343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=86 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:17.497883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58bc2bc2-aabd-49c4-94b4-4947f1c19077 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:17.498372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58bc2bc2-aabd-49c4-94b4-4947f1c19077 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:17.498845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58bc2bc2-aabd-49c4-94b4-4947f1c19077 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:17.499537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58bc2bc2-aabd-49c4-94b4-4947f1c19077 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:17.500013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58bc2bc2-aabd-49c4-94b4-4947f1c19077 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:17.500440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58bc2bc2-aabd-49c4-94b4-4947f1c19077 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:17.529470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-58bc2bc2-aabd-49c4-94b4-4947f1c19077 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 Sep 01 05:23:17.530031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 588/1208] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:17 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:17.920828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ed8e0985-ff79-4058-80f3-4d6687e9bf1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:17.921439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ed8e0985-ff79-4058-80f3-4d6687e9bf1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:17.927841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed8e0985-ff79-4058-80f3-4d6687e9bf1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:17.928320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed8e0985-ff79-4058-80f3-4d6687e9bf1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:17.928752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed8e0985-ff79-4058-80f3-4d6687e9bf1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:17.929462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed8e0985-ff79-4058-80f3-4d6687e9bf1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:17.929912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed8e0985-ff79-4058-80f3-4d6687e9bf1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:17.930329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed8e0985-ff79-4058-80f3-4d6687e9bf1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:17.994590 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ed8e0985-ff79-4058-80f3-4d6687e9bf1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:18.002221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ed8e0985-ff79-4058-80f3-4d6687e9bf1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085327 Sep 01 05:23:18.002785 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 621/1209] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:17 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:18.494631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-780d0b96-a080-4fcd-a7e6-3b5e42768cb4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:18.496797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-780d0b96-a080-4fcd-a7e6-3b5e42768cb4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:18.503734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-780d0b96-a080-4fcd-a7e6-3b5e42768cb4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.504243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-780d0b96-a080-4fcd-a7e6-3b5e42768cb4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.504713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-780d0b96-a080-4fcd-a7e6-3b5e42768cb4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.505422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-780d0b96-a080-4fcd-a7e6-3b5e42768cb4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.505870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-780d0b96-a080-4fcd-a7e6-3b5e42768cb4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.506287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-780d0b96-a080-4fcd-a7e6-3b5e42768cb4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.534652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-780d0b96-a080-4fcd-a7e6-3b5e42768cb4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044058 Sep 01 05:23:18.535196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 589/1210] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:18 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:23:18.541158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9fcae900-bd5c-43b9-b769-0c0cabde69c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:18.543313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9fcae900-bd5c-43b9-b769-0c0cabde69c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:18.549572 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9fcae900-bd5c-43b9-b769-0c0cabde69c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.550729 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9fcae900-bd5c-43b9-b769-0c0cabde69c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.551263 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9fcae900-bd5c-43b9-b769-0c0cabde69c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.551945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9fcae900-bd5c-43b9-b769-0c0cabde69c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.552392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9fcae900-bd5c-43b9-b769-0c0cabde69c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.552900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9fcae900-bd5c-43b9-b769-0c0cabde69c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.583088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9fcae900-bd5c-43b9-b769-0c0cabde69c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 Sep 01 05:23:18.583635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 622/1211] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:18 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:19.023139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-54101602-0eeb-4531-9fb1-51e2766f2ae2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:19.023770 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-54101602-0eeb-4531-9fb1-51e2766f2ae2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:19.029970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54101602-0eeb-4531-9fb1-51e2766f2ae2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:19.030442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54101602-0eeb-4531-9fb1-51e2766f2ae2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:19.030868 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54101602-0eeb-4531-9fb1-51e2766f2ae2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:19.031541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54101602-0eeb-4531-9fb1-51e2766f2ae2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:19.032007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54101602-0eeb-4531-9fb1-51e2766f2ae2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:19.032395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54101602-0eeb-4531-9fb1-51e2766f2ae2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:19.094191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-54101602-0eeb-4531-9fb1-51e2766f2ae2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:19.102764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-54101602-0eeb-4531-9fb1-51e2766f2ae2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083527 Sep 01 05:23:19.103333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 590/1212] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:19 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:19.547288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-324a0521-ae00-47ac-a0cb-188ab287cd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:19.549450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-324a0521-ae00-47ac-a0cb-188ab287cd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:19.555761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-324a0521-ae00-47ac-a0cb-188ab287cd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:19.556238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-324a0521-ae00-47ac-a0cb-188ab287cd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:19.556668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-324a0521-ae00-47ac-a0cb-188ab287cd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:19.557369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-324a0521-ae00-47ac-a0cb-188ab287cd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:19.557818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-324a0521-ae00-47ac-a0cb-188ab287cd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:19.558235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-324a0521-ae00-47ac-a0cb-188ab287cd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:19.588972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-324a0521-ae00-47ac-a0cb-188ab287cd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045672 Sep 01 05:23:19.589549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 623/1213] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:19 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:19.595265 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-773b68de-4c15-4298-8b51-d739680bd049 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:19.597426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-773b68de-4c15-4298-8b51-d739680bd049 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:19.603721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-773b68de-4c15-4298-8b51-d739680bd049 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:19.604199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-773b68de-4c15-4298-8b51-d739680bd049 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:19.604635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-773b68de-4c15-4298-8b51-d739680bd049 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:19.605359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-773b68de-4c15-4298-8b51-d739680bd049 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:19.605811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-773b68de-4c15-4298-8b51-d739680bd049 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:19.606235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-773b68de-4c15-4298-8b51-d739680bd049 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:19.619910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:19.637826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-773b68de-4c15-4298-8b51-d739680bd049 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046579 Sep 01 05:23:19.638372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 591/1214] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:19 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:20.124213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bebcc727-0bdc-44f4-8bb5-1df74195d1c4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:20.124845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bebcc727-0bdc-44f4-8bb5-1df74195d1c4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:20.131492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bebcc727-0bdc-44f4-8bb5-1df74195d1c4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:20.131964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bebcc727-0bdc-44f4-8bb5-1df74195d1c4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:20.132389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bebcc727-0bdc-44f4-8bb5-1df74195d1c4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:20.133470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bebcc727-0bdc-44f4-8bb5-1df74195d1c4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:20.133916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bebcc727-0bdc-44f4-8bb5-1df74195d1c4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:20.134330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bebcc727-0bdc-44f4-8bb5-1df74195d1c4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:20.194957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bebcc727-0bdc-44f4-8bb5-1df74195d1c4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:20.202782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bebcc727-0bdc-44f4-8bb5-1df74195d1c4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082446 Sep 01 05:23:20.203339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 624/1215] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:20 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:20.602233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d98f84eb-1c5c-46da-a1d2-2e04d0d15dd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:20.604533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d98f84eb-1c5c-46da-a1d2-2e04d0d15dd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:20.611018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d98f84eb-1c5c-46da-a1d2-2e04d0d15dd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:20.611498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d98f84eb-1c5c-46da-a1d2-2e04d0d15dd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:20.611933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d98f84eb-1c5c-46da-a1d2-2e04d0d15dd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:20.613306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d98f84eb-1c5c-46da-a1d2-2e04d0d15dd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:20.613758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d98f84eb-1c5c-46da-a1d2-2e04d0d15dd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:20.614182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d98f84eb-1c5c-46da-a1d2-2e04d0d15dd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:20.642771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d98f84eb-1c5c-46da-a1d2-2e04d0d15dd3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044572 Sep 01 05:23:20.643346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 592/1216] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:20.650009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5998abbb-b862-4efa-b67f-0eaefbbdf08c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:20.652132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5998abbb-b862-4efa-b67f-0eaefbbdf08c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:20.658437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5998abbb-b862-4efa-b67f-0eaefbbdf08c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:20.658919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5998abbb-b862-4efa-b67f-0eaefbbdf08c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:20.660082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5998abbb-b862-4efa-b67f-0eaefbbdf08c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:20.660765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5998abbb-b862-4efa-b67f-0eaefbbdf08c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:20.661232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5998abbb-b862-4efa-b67f-0eaefbbdf08c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:20.661650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5998abbb-b862-4efa-b67f-0eaefbbdf08c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:20.692377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5998abbb-b862-4efa-b67f-0eaefbbdf08c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046281 Sep 01 05:23:20.692951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 625/1217] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:20 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:21.223981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bbfcf746-fc6a-44ee-87d9-833290c3bfc8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:21.224623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bbfcf746-fc6a-44ee-87d9-833290c3bfc8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:21.230509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bbfcf746-fc6a-44ee-87d9-833290c3bfc8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:21.231212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bbfcf746-fc6a-44ee-87d9-833290c3bfc8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:21.231643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bbfcf746-fc6a-44ee-87d9-833290c3bfc8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:21.232320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bbfcf746-fc6a-44ee-87d9-833290c3bfc8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:21.232764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bbfcf746-fc6a-44ee-87d9-833290c3bfc8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:21.233208 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bbfcf746-fc6a-44ee-87d9-833290c3bfc8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:21.294087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bbfcf746-fc6a-44ee-87d9-833290c3bfc8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:21.302466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bbfcf746-fc6a-44ee-87d9-833290c3bfc8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082880 Sep 01 05:23:21.303006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 593/1218] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:21 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:21.655571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9443397e-5151-44df-8bce-239c4a5db0c8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:21.657857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9443397e-5151-44df-8bce-239c4a5db0c8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:21.660720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=86 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:21.666062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9443397e-5151-44df-8bce-239c4a5db0c8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:21.666569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9443397e-5151-44df-8bce-239c4a5db0c8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:21.667002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9443397e-5151-44df-8bce-239c4a5db0c8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:21.667696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9443397e-5151-44df-8bce-239c4a5db0c8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:21.668142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9443397e-5151-44df-8bce-239c4a5db0c8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:21.668562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9443397e-5151-44df-8bce-239c4a5db0c8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:21.699131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9443397e-5151-44df-8bce-239c4a5db0c8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047562 Sep 01 05:23:21.699863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 626/1219] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:21 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:21.705023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c6f8a6c6-5a66-432e-b3e5-726e056c01b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:21.707277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c6f8a6c6-5a66-432e-b3e5-726e056c01b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:21.713538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6f8a6c6-5a66-432e-b3e5-726e056c01b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:21.714014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6f8a6c6-5a66-432e-b3e5-726e056c01b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:21.714448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6f8a6c6-5a66-432e-b3e5-726e056c01b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:21.715127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6f8a6c6-5a66-432e-b3e5-726e056c01b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:21.715573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6f8a6c6-5a66-432e-b3e5-726e056c01b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:21.715994 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6f8a6c6-5a66-432e-b3e5-726e056c01b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:21.745678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c6f8a6c6-5a66-432e-b3e5-726e056c01b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044544 Sep 01 05:23:21.746231 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 594/1220] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:21 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:22.323365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9bee9732-b795-4d75-982a-9c5201d4dbd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:22.323969 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9bee9732-b795-4d75-982a-9c5201d4dbd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:22.329840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9bee9732-b795-4d75-982a-9c5201d4dbd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:22.330313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9bee9732-b795-4d75-982a-9c5201d4dbd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:22.330740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9bee9732-b795-4d75-982a-9c5201d4dbd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:22.331541 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9bee9732-b795-4d75-982a-9c5201d4dbd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:22.332171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9bee9732-b795-4d75-982a-9c5201d4dbd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:22.332591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9bee9732-b795-4d75-982a-9c5201d4dbd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:22.400925 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9bee9732-b795-4d75-982a-9c5201d4dbd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:22.408650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9bee9732-b795-4d75-982a-9c5201d4dbd2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.089201 Sep 01 05:23:22.409288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 627/1221] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:22 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:22.711859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7f41d2e7-1241-42b8-9d22-29552a91e880 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:22.714082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7f41d2e7-1241-42b8-9d22-29552a91e880 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:22.720502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f41d2e7-1241-42b8-9d22-29552a91e880 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:22.721016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f41d2e7-1241-42b8-9d22-29552a91e880 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:22.721450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f41d2e7-1241-42b8-9d22-29552a91e880 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:22.722824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f41d2e7-1241-42b8-9d22-29552a91e880 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:22.723275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f41d2e7-1241-42b8-9d22-29552a91e880 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:22.723697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f41d2e7-1241-42b8-9d22-29552a91e880 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:22.753503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7f41d2e7-1241-42b8-9d22-29552a91e880 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045598 Sep 01 05:23:22.754069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 595/1222] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:22.757827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bd4a8a46-45a4-47fa-99a2-3d3a7529f2fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:22.759950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bd4a8a46-45a4-47fa-99a2-3d3a7529f2fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:22.765852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bd4a8a46-45a4-47fa-99a2-3d3a7529f2fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:22.766332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bd4a8a46-45a4-47fa-99a2-3d3a7529f2fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:22.766764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bd4a8a46-45a4-47fa-99a2-3d3a7529f2fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:22.767445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bd4a8a46-45a4-47fa-99a2-3d3a7529f2fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:22.767895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bd4a8a46-45a4-47fa-99a2-3d3a7529f2fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:22.768314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bd4a8a46-45a4-47fa-99a2-3d3a7529f2fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:22.797765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bd4a8a46-45a4-47fa-99a2-3d3a7529f2fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044298 Sep 01 05:23:22.798325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 628/1223] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:22 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:23.429889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2f421c42-fa71-4d3b-9837-701f8055db5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:23.430502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2f421c42-fa71-4d3b-9837-701f8055db5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:23.436339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f421c42-fa71-4d3b-9837-701f8055db5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:23.436827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f421c42-fa71-4d3b-9837-701f8055db5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:23.437256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f421c42-fa71-4d3b-9837-701f8055db5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:23.437929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f421c42-fa71-4d3b-9837-701f8055db5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:23.438370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f421c42-fa71-4d3b-9837-701f8055db5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:23.438791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f421c42-fa71-4d3b-9837-701f8055db5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:23.502703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2f421c42-fa71-4d3b-9837-701f8055db5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:23.510424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2f421c42-fa71-4d3b-9837-701f8055db5a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084414 Sep 01 05:23:23.510978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 596/1224] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:23 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:23.765776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c8102be7-0564-4936-81ff-c722271f6da5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:23.767878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c8102be7-0564-4936-81ff-c722271f6da5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:23.774920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c8102be7-0564-4936-81ff-c722271f6da5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:23.775393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c8102be7-0564-4936-81ff-c722271f6da5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:23.775821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c8102be7-0564-4936-81ff-c722271f6da5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:23.776496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c8102be7-0564-4936-81ff-c722271f6da5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:23.776967 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c8102be7-0564-4936-81ff-c722271f6da5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:23.777381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c8102be7-0564-4936-81ff-c722271f6da5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:23.780871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:23.808387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c8102be7-0564-4936-81ff-c722271f6da5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046518 Sep 01 05:23:23.809347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 629/1225] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:23.815369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ce6a7b15-1733-4698-9078-cb5bd4c2c0b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:23.817600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ce6a7b15-1733-4698-9078-cb5bd4c2c0b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:23.824049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce6a7b15-1733-4698-9078-cb5bd4c2c0b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:23.824530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce6a7b15-1733-4698-9078-cb5bd4c2c0b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:23.825000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce6a7b15-1733-4698-9078-cb5bd4c2c0b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:23.825694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce6a7b15-1733-4698-9078-cb5bd4c2c0b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:23.826162 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce6a7b15-1733-4698-9078-cb5bd4c2c0b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:23.826582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce6a7b15-1733-4698-9078-cb5bd4c2c0b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:23.857140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ce6a7b15-1733-4698-9078-cb5bd4c2c0b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051112 Sep 01 05:23:23.857704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 597/1226] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:23 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:24.531519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9ca791a3-18c4-4310-8cf7-5c7206ed593d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:24.532052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9ca791a3-18c4-4310-8cf7-5c7206ed593d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:24.538323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9ca791a3-18c4-4310-8cf7-5c7206ed593d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:24.538795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9ca791a3-18c4-4310-8cf7-5c7206ed593d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:24.539219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9ca791a3-18c4-4310-8cf7-5c7206ed593d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:24.539890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9ca791a3-18c4-4310-8cf7-5c7206ed593d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:24.540334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9ca791a3-18c4-4310-8cf7-5c7206ed593d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:24.540748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9ca791a3-18c4-4310-8cf7-5c7206ed593d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:24.601079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9ca791a3-18c4-4310-8cf7-5c7206ed593d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:24.608787 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9ca791a3-18c4-4310-8cf7-5c7206ed593d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081250 Sep 01 05:23:24.609374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 630/1227] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:24 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:24.821046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fce7b73b-a446-43f4-bf5e-052648ff3d65 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:24.823151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fce7b73b-a446-43f4-bf5e-052648ff3d65 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:24.829493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fce7b73b-a446-43f4-bf5e-052648ff3d65 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:24.829964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fce7b73b-a446-43f4-bf5e-052648ff3d65 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:24.830442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fce7b73b-a446-43f4-bf5e-052648ff3d65 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:24.831064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fce7b73b-a446-43f4-bf5e-052648ff3d65 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:24.831629 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fce7b73b-a446-43f4-bf5e-052648ff3d65 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:24.832195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fce7b73b-a446-43f4-bf5e-052648ff3d65 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:24.861499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fce7b73b-a446-43f4-bf5e-052648ff3d65 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044599 Sep 01 05:23:24.862049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 598/1228] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:24.869930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-762d092f-666b-4eb6-a9ac-695d366e0133 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:24.872140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-762d092f-666b-4eb6-a9ac-695d366e0133 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:24.879651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-762d092f-666b-4eb6-a9ac-695d366e0133 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:24.879651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-762d092f-666b-4eb6-a9ac-695d366e0133 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:24.879994 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-762d092f-666b-4eb6-a9ac-695d366e0133 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:24.880533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-762d092f-666b-4eb6-a9ac-695d366e0133 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:24.881037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-762d092f-666b-4eb6-a9ac-695d366e0133 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:24.881458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-762d092f-666b-4eb6-a9ac-695d366e0133 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:24.911275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-762d092f-666b-4eb6-a9ac-695d366e0133 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045761 Sep 01 05:23:24.911811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 631/1229] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:24 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:25.630987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-478e06df-57f5-4ca7-ae27-7e825f104bb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:25.631601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-478e06df-57f5-4ca7-ae27-7e825f104bb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:25.637488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-478e06df-57f5-4ca7-ae27-7e825f104bb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:25.637968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-478e06df-57f5-4ca7-ae27-7e825f104bb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:25.638399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-478e06df-57f5-4ca7-ae27-7e825f104bb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:25.639081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-478e06df-57f5-4ca7-ae27-7e825f104bb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:25.639527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-478e06df-57f5-4ca7-ae27-7e825f104bb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:25.639943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-478e06df-57f5-4ca7-ae27-7e825f104bb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:25.700720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-478e06df-57f5-4ca7-ae27-7e825f104bb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:25.709137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-478e06df-57f5-4ca7-ae27-7e825f104bb5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082713 Sep 01 05:23:25.709690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 599/1230] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:25 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:25.874533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d1023053-9e43-43ce-ac32-d2a19fd30c88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:25.876629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d1023053-9e43-43ce-ac32-d2a19fd30c88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:25.884222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d1023053-9e43-43ce-ac32-d2a19fd30c88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:25.884702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d1023053-9e43-43ce-ac32-d2a19fd30c88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:25.885169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d1023053-9e43-43ce-ac32-d2a19fd30c88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:25.885855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d1023053-9e43-43ce-ac32-d2a19fd30c88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:25.886302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d1023053-9e43-43ce-ac32-d2a19fd30c88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:25.886914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d1023053-9e43-43ce-ac32-d2a19fd30c88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:25.918319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d1023053-9e43-43ce-ac32-d2a19fd30c88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047768 Sep 01 05:23:25.918993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 632/1231] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:23:25.923606 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8456f1b2-1ae7-4398-9a8a-4b5a9a9b1453 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:25.926367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8456f1b2-1ae7-4398-9a8a-4b5a9a9b1453 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:25.932716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8456f1b2-1ae7-4398-9a8a-4b5a9a9b1453 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:25.933232 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8456f1b2-1ae7-4398-9a8a-4b5a9a9b1453 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:25.933667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8456f1b2-1ae7-4398-9a8a-4b5a9a9b1453 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:25.934359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8456f1b2-1ae7-4398-9a8a-4b5a9a9b1453 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:25.934808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8456f1b2-1ae7-4398-9a8a-4b5a9a9b1453 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:25.935228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8456f1b2-1ae7-4398-9a8a-4b5a9a9b1453 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:25.965893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8456f1b2-1ae7-4398-9a8a-4b5a9a9b1453 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046256 Sep 01 05:23:25.966457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 600/1232] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:25 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:26.730424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-309aa3ea-3db4-4db4-8ff2-2f6e0719a2d5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:26.731038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-309aa3ea-3db4-4db4-8ff2-2f6e0719a2d5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:26.737193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-309aa3ea-3db4-4db4-8ff2-2f6e0719a2d5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:26.738257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-309aa3ea-3db4-4db4-8ff2-2f6e0719a2d5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:26.738754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-309aa3ea-3db4-4db4-8ff2-2f6e0719a2d5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:26.739493 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-309aa3ea-3db4-4db4-8ff2-2f6e0719a2d5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:26.739951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-309aa3ea-3db4-4db4-8ff2-2f6e0719a2d5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:26.740374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-309aa3ea-3db4-4db4-8ff2-2f6e0719a2d5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:26.802756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-309aa3ea-3db4-4db4-8ff2-2f6e0719a2d5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:26.810523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-309aa3ea-3db4-4db4-8ff2-2f6e0719a2d5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084014 Sep 01 05:23:26.811087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 633/1233] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:26 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:26.930910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-86360e06-bf84-4c67-ac01-8a508da528a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:26.933072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-86360e06-bf84-4c67-ac01-8a508da528a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:26.939384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86360e06-bf84-4c67-ac01-8a508da528a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:26.940119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86360e06-bf84-4c67-ac01-8a508da528a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:26.940543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86360e06-bf84-4c67-ac01-8a508da528a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:26.942004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86360e06-bf84-4c67-ac01-8a508da528a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:26.942455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86360e06-bf84-4c67-ac01-8a508da528a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:26.942876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86360e06-bf84-4c67-ac01-8a508da528a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:26.971687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-86360e06-bf84-4c67-ac01-8a508da528a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044702 Sep 01 05:23:26.972630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 601/1234] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:26.978472 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f7b36706-fc9e-4e02-a181-0ab1997ab051 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:26.980692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f7b36706-fc9e-4e02-a181-0ab1997ab051 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:26.987039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7b36706-fc9e-4e02-a181-0ab1997ab051 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:26.988273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7b36706-fc9e-4e02-a181-0ab1997ab051 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:26.988961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7b36706-fc9e-4e02-a181-0ab1997ab051 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:26.989652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7b36706-fc9e-4e02-a181-0ab1997ab051 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:26.990103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7b36706-fc9e-4e02-a181-0ab1997ab051 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:26.990525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7b36706-fc9e-4e02-a181-0ab1997ab051 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:27.020366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f7b36706-fc9e-4e02-a181-0ab1997ab051 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045869 Sep 01 05:23:27.020950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 634/1235] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:26 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:27.832673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e278a7a1-4342-40b8-9b49-f4edc6333b98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:27.833237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e278a7a1-4342-40b8-9b49-f4edc6333b98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:27.839122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e278a7a1-4342-40b8-9b49-f4edc6333b98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:27.839600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e278a7a1-4342-40b8-9b49-f4edc6333b98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:27.840032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e278a7a1-4342-40b8-9b49-f4edc6333b98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:27.840738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e278a7a1-4342-40b8-9b49-f4edc6333b98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:27.841207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e278a7a1-4342-40b8-9b49-f4edc6333b98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:27.841626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e278a7a1-4342-40b8-9b49-f4edc6333b98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:27.905163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e278a7a1-4342-40b8-9b49-f4edc6333b98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:27.913384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e278a7a1-4342-40b8-9b49-f4edc6333b98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085290 Sep 01 05:23:27.913951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 602/1236] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:27 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:27.984178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ff1ac994-f65a-4e50-8a45-e5273acd1fe3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:27.986363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ff1ac994-f65a-4e50-8a45-e5273acd1fe3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:27.993160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff1ac994-f65a-4e50-8a45-e5273acd1fe3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:27.993639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff1ac994-f65a-4e50-8a45-e5273acd1fe3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:27.994072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff1ac994-f65a-4e50-8a45-e5273acd1fe3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:27.994753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff1ac994-f65a-4e50-8a45-e5273acd1fe3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:27.995203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff1ac994-f65a-4e50-8a45-e5273acd1fe3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:27.995621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff1ac994-f65a-4e50-8a45-e5273acd1fe3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:28.025688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ff1ac994-f65a-4e50-8a45-e5273acd1fe3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045495 Sep 01 05:23:28.026635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 635/1237] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:27 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:28.031845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dd97185d-8825-4c70-866d-56fc548e76f5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:28.034004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dd97185d-8825-4c70-866d-56fc548e76f5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:28.040466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd97185d-8825-4c70-866d-56fc548e76f5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:28.040987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd97185d-8825-4c70-866d-56fc548e76f5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:28.041418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd97185d-8825-4c70-866d-56fc548e76f5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:28.042092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd97185d-8825-4c70-866d-56fc548e76f5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:28.042537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd97185d-8825-4c70-866d-56fc548e76f5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:28.042983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd97185d-8825-4c70-866d-56fc548e76f5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:28.072820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dd97185d-8825-4c70-866d-56fc548e76f5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Sep 01 05:23:28.073362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 603/1238] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:28 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:28.933909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d8d647df-2baf-49d8-af1c-f94c2047e8cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:28.934524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d8d647df-2baf-49d8-af1c-f94c2047e8cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:28.940760 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8d647df-2baf-49d8-af1c-f94c2047e8cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:28.941360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8d647df-2baf-49d8-af1c-f94c2047e8cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:28.941795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8d647df-2baf-49d8-af1c-f94c2047e8cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:28.942480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8d647df-2baf-49d8-af1c-f94c2047e8cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:28.942933 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8d647df-2baf-49d8-af1c-f94c2047e8cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:28.943356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8d647df-2baf-49d8-af1c-f94c2047e8cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:29.003035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d8d647df-2baf-49d8-af1c-f94c2047e8cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:29.010915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d8d647df-2baf-49d8-af1c-f94c2047e8cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.080873 Sep 01 05:23:29.011486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 636/1239] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:28 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:29.038899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b8acd8bd-5bd3-4d92-b4ce-1e5ef0a03d84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:29.041079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b8acd8bd-5bd3-4d92-b4ce-1e5ef0a03d84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:29.047593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8acd8bd-5bd3-4d92-b4ce-1e5ef0a03d84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:29.048072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8acd8bd-5bd3-4d92-b4ce-1e5ef0a03d84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:29.048508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8acd8bd-5bd3-4d92-b4ce-1e5ef0a03d84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:29.049218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8acd8bd-5bd3-4d92-b4ce-1e5ef0a03d84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:29.049675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8acd8bd-5bd3-4d92-b4ce-1e5ef0a03d84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:29.050130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8acd8bd-5bd3-4d92-b4ce-1e5ef0a03d84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:29.079336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b8acd8bd-5bd3-4d92-b4ce-1e5ef0a03d84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045218 Sep 01 05:23:29.079894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 604/1240] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:29 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:29.086638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ef81b1eb-5097-44e3-8ffd-f10a54f3407f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:29.088795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ef81b1eb-5097-44e3-8ffd-f10a54f3407f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:29.095469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef81b1eb-5097-44e3-8ffd-f10a54f3407f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:29.095950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef81b1eb-5097-44e3-8ffd-f10a54f3407f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:29.096375 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef81b1eb-5097-44e3-8ffd-f10a54f3407f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:29.097885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef81b1eb-5097-44e3-8ffd-f10a54f3407f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:29.098349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef81b1eb-5097-44e3-8ffd-f10a54f3407f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:29.098761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef81b1eb-5097-44e3-8ffd-f10a54f3407f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:29.127253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ef81b1eb-5097-44e3-8ffd-f10a54f3407f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046276 Sep 01 05:23:29.127801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 637/1241] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:29 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:30.032160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5f5ce788-8789-4630-89c6-e8e1dbdba95a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:30.032767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5f5ce788-8789-4630-89c6-e8e1dbdba95a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:30.038918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5f5ce788-8789-4630-89c6-e8e1dbdba95a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:30.039472 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5f5ce788-8789-4630-89c6-e8e1dbdba95a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:30.039795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5f5ce788-8789-4630-89c6-e8e1dbdba95a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:30.040465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5f5ce788-8789-4630-89c6-e8e1dbdba95a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:30.040944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5f5ce788-8789-4630-89c6-e8e1dbdba95a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:30.041360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5f5ce788-8789-4630-89c6-e8e1dbdba95a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:30.092616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d82bb908-f1b9-4d97-8d97-0985fdcfd097 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:30.094753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d82bb908-f1b9-4d97-8d97-0985fdcfd097 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:30.101922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d82bb908-f1b9-4d97-8d97-0985fdcfd097 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:30.102428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d82bb908-f1b9-4d97-8d97-0985fdcfd097 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:30.102856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d82bb908-f1b9-4d97-8d97-0985fdcfd097 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:30.103544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d82bb908-f1b9-4d97-8d97-0985fdcfd097 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:30.103788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5f5ce788-8789-4630-89c6-e8e1dbdba95a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:30.103989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d82bb908-f1b9-4d97-8d97-0985fdcfd097 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:30.104404 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d82bb908-f1b9-4d97-8d97-0985fdcfd097 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:30.111565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5f5ce788-8789-4630-89c6-e8e1dbdba95a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083126 Sep 01 05:23:30.112187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 605/1242] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:30 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:30.134500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d82bb908-f1b9-4d97-8d97-0985fdcfd097 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045747 Sep 01 05:23:30.135059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 638/1243] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:30 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:23:30.139380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-30d91ce4-0b82-4cbc-81e3-3e6d9d415739 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:30.141546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-30d91ce4-0b82-4cbc-81e3-3e6d9d415739 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:30.147526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30d91ce4-0b82-4cbc-81e3-3e6d9d415739 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:30.147941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30d91ce4-0b82-4cbc-81e3-3e6d9d415739 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:30.148369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30d91ce4-0b82-4cbc-81e3-3e6d9d415739 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:30.149067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30d91ce4-0b82-4cbc-81e3-3e6d9d415739 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:30.149512 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30d91ce4-0b82-4cbc-81e3-3e6d9d415739 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:30.149926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30d91ce4-0b82-4cbc-81e3-3e6d9d415739 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:30.179914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-30d91ce4-0b82-4cbc-81e3-3e6d9d415739 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 Sep 01 05:23:30.180455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 606/1244] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:30 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:31.133411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c709cb2a-e132-41bc-b58d-653e44622110 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:31.134077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c709cb2a-e132-41bc-b58d-653e44622110 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:31.140329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c709cb2a-e132-41bc-b58d-653e44622110 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:31.140821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c709cb2a-e132-41bc-b58d-653e44622110 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:31.141252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c709cb2a-e132-41bc-b58d-653e44622110 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:31.141932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c709cb2a-e132-41bc-b58d-653e44622110 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:31.142380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c709cb2a-e132-41bc-b58d-653e44622110 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:31.142799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c709cb2a-e132-41bc-b58d-653e44622110 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:31.146769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7b530993-5938-4df6-9a18-2adb4f2de912 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:31.149063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7b530993-5938-4df6-9a18-2adb4f2de912 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:31.155360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7b530993-5938-4df6-9a18-2adb4f2de912 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:31.155838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7b530993-5938-4df6-9a18-2adb4f2de912 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:31.156270 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7b530993-5938-4df6-9a18-2adb4f2de912 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:31.156989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7b530993-5938-4df6-9a18-2adb4f2de912 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:31.157439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7b530993-5938-4df6-9a18-2adb4f2de912 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:31.157875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7b530993-5938-4df6-9a18-2adb4f2de912 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:31.189000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7b530993-5938-4df6-9a18-2adb4f2de912 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046433 Sep 01 05:23:31.189568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 607/1245] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:23:31.195217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-07f6849b-01f6-4ae1-b21e-c2eb3059a1a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:31.197132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-07f6849b-01f6-4ae1-b21e-c2eb3059a1a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:31.203115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07f6849b-01f6-4ae1-b21e-c2eb3059a1a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:31.203598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07f6849b-01f6-4ae1-b21e-c2eb3059a1a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:31.204030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07f6849b-01f6-4ae1-b21e-c2eb3059a1a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:31.204730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07f6849b-01f6-4ae1-b21e-c2eb3059a1a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:31.205209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07f6849b-01f6-4ae1-b21e-c2eb3059a1a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:31.205627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07f6849b-01f6-4ae1-b21e-c2eb3059a1a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:31.208824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:31.210253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c709cb2a-e132-41bc-b58d-653e44622110 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:31.218182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c709cb2a-e132-41bc-b58d-653e44622110 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088584 Sep 01 05:23:31.218755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 639/1246] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:31 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:31.238490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-07f6849b-01f6-4ae1-b21e-c2eb3059a1a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047606 Sep 01 05:23:31.239044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 608/1247] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:31 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:32.202190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-becf9909-9863-4c65-acd8-5a658d6eae33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:32.204369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-becf9909-9863-4c65-acd8-5a658d6eae33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:32.211273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-becf9909-9863-4c65-acd8-5a658d6eae33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:32.211752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-becf9909-9863-4c65-acd8-5a658d6eae33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:32.212186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-becf9909-9863-4c65-acd8-5a658d6eae33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:32.212917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-becf9909-9863-4c65-acd8-5a658d6eae33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:32.213352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-becf9909-9863-4c65-acd8-5a658d6eae33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:32.213771 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-becf9909-9863-4c65-acd8-5a658d6eae33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:32.240296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-778de5d7-7b25-4e9e-9f30-c01b60c1993b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:32.241020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-778de5d7-7b25-4e9e-9f30-c01b60c1993b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:32.244017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-becf9909-9863-4c65-acd8-5a658d6eae33 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045894 Sep 01 05:23:32.244793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 640/1248] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:32.247809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-778de5d7-7b25-4e9e-9f30-c01b60c1993b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:32.248289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-778de5d7-7b25-4e9e-9f30-c01b60c1993b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:32.248720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-778de5d7-7b25-4e9e-9f30-c01b60c1993b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:32.249433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-778de5d7-7b25-4e9e-9f30-c01b60c1993b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:32.249879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-778de5d7-7b25-4e9e-9f30-c01b60c1993b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:32.250279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4d00bae5-f75a-4854-9051-a3c23a6e8d62 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:32.250393 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-778de5d7-7b25-4e9e-9f30-c01b60c1993b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:32.252437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4d00bae5-f75a-4854-9051-a3c23a6e8d62 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:32.259070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d00bae5-f75a-4854-9051-a3c23a6e8d62 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:32.259545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d00bae5-f75a-4854-9051-a3c23a6e8d62 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:32.259972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d00bae5-f75a-4854-9051-a3c23a6e8d62 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:32.260649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d00bae5-f75a-4854-9051-a3c23a6e8d62 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:32.261117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d00bae5-f75a-4854-9051-a3c23a6e8d62 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:32.261534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d00bae5-f75a-4854-9051-a3c23a6e8d62 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:32.291473 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4d00bae5-f75a-4854-9051-a3c23a6e8d62 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044820 Sep 01 05:23:32.292254 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 641/1249] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:32 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:32.317325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-778de5d7-7b25-4e9e-9f30-c01b60c1993b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:32.324899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-778de5d7-7b25-4e9e-9f30-c01b60c1993b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.089391 Sep 01 05:23:32.325453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 609/1250] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:32 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:33.256695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7ad6dfad-a321-44cd-a183-4cd54de0a491 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:33.258792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7ad6dfad-a321-44cd-a183-4cd54de0a491 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:33.265198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7ad6dfad-a321-44cd-a183-4cd54de0a491 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:33.265684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7ad6dfad-a321-44cd-a183-4cd54de0a491 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:33.266118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7ad6dfad-a321-44cd-a183-4cd54de0a491 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:33.266799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7ad6dfad-a321-44cd-a183-4cd54de0a491 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:33.267278 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7ad6dfad-a321-44cd-a183-4cd54de0a491 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:33.267698 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7ad6dfad-a321-44cd-a183-4cd54de0a491 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:33.299506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7ad6dfad-a321-44cd-a183-4cd54de0a491 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046212 Sep 01 05:23:33.301340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 642/1251] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:33.304420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-25fe4f78-ec19-4b92-9b4c-11ff7540d65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:33.306690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-25fe4f78-ec19-4b92-9b4c-11ff7540d65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:33.313230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25fe4f78-ec19-4b92-9b4c-11ff7540d65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:33.313717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25fe4f78-ec19-4b92-9b4c-11ff7540d65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:33.314156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25fe4f78-ec19-4b92-9b4c-11ff7540d65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:33.315107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25fe4f78-ec19-4b92-9b4c-11ff7540d65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:33.315559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25fe4f78-ec19-4b92-9b4c-11ff7540d65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:33.316010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25fe4f78-ec19-4b92-9b4c-11ff7540d65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:33.345311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-25fe4f78-ec19-4b92-9b4c-11ff7540d65c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045590 Sep 01 05:23:33.345522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5576a065-2e26-4f55-b3ad-a0ef04c6575d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:33.345876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 610/1252] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:33.346129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5576a065-2e26-4f55-b3ad-a0ef04c6575d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:33.352565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5576a065-2e26-4f55-b3ad-a0ef04c6575d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:33.353085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5576a065-2e26-4f55-b3ad-a0ef04c6575d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:33.353524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5576a065-2e26-4f55-b3ad-a0ef04c6575d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:33.354213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5576a065-2e26-4f55-b3ad-a0ef04c6575d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:33.354665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5576a065-2e26-4f55-b3ad-a0ef04c6575d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:33.355091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5576a065-2e26-4f55-b3ad-a0ef04c6575d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:33.416116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5576a065-2e26-4f55-b3ad-a0ef04c6575d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:33.423812 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5576a065-2e26-4f55-b3ad-a0ef04c6575d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082046 Sep 01 05:23:33.424369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 643/1253] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:33 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:34.313889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-542fbce6-3bfb-482a-be42-74fbf689d536 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:34.316966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-542fbce6-3bfb-482a-be42-74fbf689d536 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:34.323503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-542fbce6-3bfb-482a-be42-74fbf689d536 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:34.323987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-542fbce6-3bfb-482a-be42-74fbf689d536 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:34.324422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-542fbce6-3bfb-482a-be42-74fbf689d536 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:34.325141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-542fbce6-3bfb-482a-be42-74fbf689d536 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:34.325588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-542fbce6-3bfb-482a-be42-74fbf689d536 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:34.326014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-542fbce6-3bfb-482a-be42-74fbf689d536 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:34.357793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-542fbce6-3bfb-482a-be42-74fbf689d536 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048566 Sep 01 05:23:34.358284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ddbe9609-cf28-4a1c-a587-76c78fc74ece tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:34.360456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ddbe9609-cf28-4a1c-a587-76c78fc74ece tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:34.363382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 611/1254] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:34.367791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ddbe9609-cf28-4a1c-a587-76c78fc74ece tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:34.368285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ddbe9609-cf28-4a1c-a587-76c78fc74ece tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:34.368731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ddbe9609-cf28-4a1c-a587-76c78fc74ece tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:34.369460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ddbe9609-cf28-4a1c-a587-76c78fc74ece tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:34.369924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ddbe9609-cf28-4a1c-a587-76c78fc74ece tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:34.370350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ddbe9609-cf28-4a1c-a587-76c78fc74ece tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:34.404539 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ddbe9609-cf28-4a1c-a587-76c78fc74ece tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050072 Sep 01 05:23:34.405401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 644/1255] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:34.446076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-25b9b2ff-d3b9-4d2f-a91a-59f72e8f237b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:34.446700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-25b9b2ff-d3b9-4d2f-a91a-59f72e8f237b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:34.454129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25b9b2ff-d3b9-4d2f-a91a-59f72e8f237b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:34.454616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25b9b2ff-d3b9-4d2f-a91a-59f72e8f237b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:34.455051 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25b9b2ff-d3b9-4d2f-a91a-59f72e8f237b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:34.456936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25b9b2ff-d3b9-4d2f-a91a-59f72e8f237b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:34.457765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25b9b2ff-d3b9-4d2f-a91a-59f72e8f237b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:34.458560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25b9b2ff-d3b9-4d2f-a91a-59f72e8f237b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:34.522406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-25b9b2ff-d3b9-4d2f-a91a-59f72e8f237b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:34.530214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-25b9b2ff-d3b9-4d2f-a91a-59f72e8f237b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088062 Sep 01 05:23:34.531021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 612/1256] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:34 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:35.370593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-74be0370-67c5-4c30-b268-d28c64e1e468 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:35.372679 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-74be0370-67c5-4c30-b268-d28c64e1e468 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:35.379094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74be0370-67c5-4c30-b268-d28c64e1e468 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:35.379572 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74be0370-67c5-4c30-b268-d28c64e1e468 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:35.380002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74be0370-67c5-4c30-b268-d28c64e1e468 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:35.380680 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74be0370-67c5-4c30-b268-d28c64e1e468 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:35.381154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74be0370-67c5-4c30-b268-d28c64e1e468 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:35.381573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74be0370-67c5-4c30-b268-d28c64e1e468 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:35.405826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:35.411606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-74be0370-67c5-4c30-b268-d28c64e1e468 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045180 Sep 01 05:23:35.412147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 645/1257] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:35.418505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-60e5a0a1-9558-457e-a474-d64f4c26a43b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:35.420637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-60e5a0a1-9558-457e-a474-d64f4c26a43b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:35.427743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60e5a0a1-9558-457e-a474-d64f4c26a43b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:35.428216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60e5a0a1-9558-457e-a474-d64f4c26a43b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:35.428647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60e5a0a1-9558-457e-a474-d64f4c26a43b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:35.429354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60e5a0a1-9558-457e-a474-d64f4c26a43b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:35.429803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60e5a0a1-9558-457e-a474-d64f4c26a43b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:35.430219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60e5a0a1-9558-457e-a474-d64f4c26a43b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:35.459272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-60e5a0a1-9558-457e-a474-d64f4c26a43b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044627 Sep 01 05:23:35.459811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 613/1258] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:35 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:35.551785 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-49f248d1-de3a-449d-a1af-16bb55bcae1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:35.552426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-49f248d1-de3a-449d-a1af-16bb55bcae1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:35.558571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49f248d1-de3a-449d-a1af-16bb55bcae1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:35.559051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49f248d1-de3a-449d-a1af-16bb55bcae1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:35.559482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49f248d1-de3a-449d-a1af-16bb55bcae1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:35.560157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49f248d1-de3a-449d-a1af-16bb55bcae1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:35.560603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49f248d1-de3a-449d-a1af-16bb55bcae1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:35.561048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49f248d1-de3a-449d-a1af-16bb55bcae1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:35.621386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-49f248d1-de3a-449d-a1af-16bb55bcae1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:35.629406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-49f248d1-de3a-449d-a1af-16bb55bcae1b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082205 Sep 01 05:23:35.629960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 646/1259] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:35 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:36.423605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-81f22d1c-026b-4a9a-8193-94f4cddf2cf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:36.426911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-81f22d1c-026b-4a9a-8193-94f4cddf2cf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:36.433520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81f22d1c-026b-4a9a-8193-94f4cddf2cf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:36.433990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81f22d1c-026b-4a9a-8193-94f4cddf2cf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:36.434419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81f22d1c-026b-4a9a-8193-94f4cddf2cf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:36.435092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81f22d1c-026b-4a9a-8193-94f4cddf2cf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:36.435534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81f22d1c-026b-4a9a-8193-94f4cddf2cf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:36.435947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81f22d1c-026b-4a9a-8193-94f4cddf2cf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:36.465689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-81f22d1c-026b-4a9a-8193-94f4cddf2cf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046004 Sep 01 05:23:36.466644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 614/1260] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:36.471471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3609ae91-ebcf-499a-8809-33a4e2f74fb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:36.474925 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3609ae91-ebcf-499a-8809-33a4e2f74fb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:36.481272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3609ae91-ebcf-499a-8809-33a4e2f74fb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:36.481736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3609ae91-ebcf-499a-8809-33a4e2f74fb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:36.482167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3609ae91-ebcf-499a-8809-33a4e2f74fb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:36.482845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3609ae91-ebcf-499a-8809-33a4e2f74fb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:36.483294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3609ae91-ebcf-499a-8809-33a4e2f74fb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:36.483713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3609ae91-ebcf-499a-8809-33a4e2f74fb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:36.512404 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3609ae91-ebcf-499a-8809-33a4e2f74fb7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Sep 01 05:23:36.512979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 647/1261] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:36 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:36.650205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e206ed34-745b-4f88-815a-73e922763f75 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:36.650811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e206ed34-745b-4f88-815a-73e922763f75 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:36.656594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e206ed34-745b-4f88-815a-73e922763f75 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:36.657096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e206ed34-745b-4f88-815a-73e922763f75 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:36.657520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e206ed34-745b-4f88-815a-73e922763f75 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:36.658188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e206ed34-745b-4f88-815a-73e922763f75 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:36.658635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e206ed34-745b-4f88-815a-73e922763f75 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:36.659045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e206ed34-745b-4f88-815a-73e922763f75 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:36.720318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e206ed34-745b-4f88-815a-73e922763f75 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:36.728704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e206ed34-745b-4f88-815a-73e922763f75 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082355 Sep 01 05:23:36.729293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 615/1262] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:36 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:37.479052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-61ac4e40-650b-4c22-a230-6f9998ad6a58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:37.481201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-61ac4e40-650b-4c22-a230-6f9998ad6a58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:37.487705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-61ac4e40-650b-4c22-a230-6f9998ad6a58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:37.488144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-61ac4e40-650b-4c22-a230-6f9998ad6a58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:37.488573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-61ac4e40-650b-4c22-a230-6f9998ad6a58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:37.489278 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-61ac4e40-650b-4c22-a230-6f9998ad6a58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:37.489923 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-61ac4e40-650b-4c22-a230-6f9998ad6a58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:37.490341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-61ac4e40-650b-4c22-a230-6f9998ad6a58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:37.519722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-61ac4e40-650b-4c22-a230-6f9998ad6a58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044240 Sep 01 05:23:37.520437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 648/1263] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:37 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:37.524667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9c30223e-2dda-4355-b923-6509c52c99f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:37.526845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9c30223e-2dda-4355-b923-6509c52c99f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:37.532762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c30223e-2dda-4355-b923-6509c52c99f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:37.533269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c30223e-2dda-4355-b923-6509c52c99f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:37.533707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c30223e-2dda-4355-b923-6509c52c99f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:37.534393 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c30223e-2dda-4355-b923-6509c52c99f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:37.535532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c30223e-2dda-4355-b923-6509c52c99f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:37.535989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c30223e-2dda-4355-b923-6509c52c99f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:37.565472 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9c30223e-2dda-4355-b923-6509c52c99f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045012 Sep 01 05:23:37.566620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 616/1264] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:37 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:37.749449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-02b41316-ffd3-4308-b1b0-f6507f926e22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:37.749982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-02b41316-ffd3-4308-b1b0-f6507f926e22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:37.756292 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02b41316-ffd3-4308-b1b0-f6507f926e22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:37.756765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02b41316-ffd3-4308-b1b0-f6507f926e22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:37.757213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02b41316-ffd3-4308-b1b0-f6507f926e22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:37.757881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02b41316-ffd3-4308-b1b0-f6507f926e22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:37.758320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02b41316-ffd3-4308-b1b0-f6507f926e22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:37.758733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02b41316-ffd3-4308-b1b0-f6507f926e22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:37.818989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-02b41316-ffd3-4308-b1b0-f6507f926e22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:37.826545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-02b41316-ffd3-4308-b1b0-f6507f926e22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081052 Sep 01 05:23:37.827276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 649/1265] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:37 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:38.532340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-952bca80-3ed0-4cc0-9fec-e05e43b22c75 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:38.534509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-952bca80-3ed0-4cc0-9fec-e05e43b22c75 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:38.540978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-952bca80-3ed0-4cc0-9fec-e05e43b22c75 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:38.541448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-952bca80-3ed0-4cc0-9fec-e05e43b22c75 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:38.541870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-952bca80-3ed0-4cc0-9fec-e05e43b22c75 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:38.542536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-952bca80-3ed0-4cc0-9fec-e05e43b22c75 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:38.542973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-952bca80-3ed0-4cc0-9fec-e05e43b22c75 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:38.543385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-952bca80-3ed0-4cc0-9fec-e05e43b22c75 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:38.572505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-952bca80-3ed0-4cc0-9fec-e05e43b22c75 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044382 Sep 01 05:23:38.573082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 617/1266] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:38 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:38.579046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cace6650-f3e2-428c-b7b0-234e14e5beec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:38.581243 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cace6650-f3e2-428c-b7b0-234e14e5beec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:38.587804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cace6650-f3e2-428c-b7b0-234e14e5beec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:38.588288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cace6650-f3e2-428c-b7b0-234e14e5beec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:38.588726 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cace6650-f3e2-428c-b7b0-234e14e5beec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:38.589443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cace6650-f3e2-428c-b7b0-234e14e5beec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:38.589894 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cace6650-f3e2-428c-b7b0-234e14e5beec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:38.590316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cace6650-f3e2-428c-b7b0-234e14e5beec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:38.620317 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cace6650-f3e2-428c-b7b0-234e14e5beec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045340 Sep 01 05:23:38.620894 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 650/1267] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:38 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:38.847526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1a702d74-eabd-494d-aca6-f990247ffa3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:38.848223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1a702d74-eabd-494d-aca6-f990247ffa3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:38.854145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a702d74-eabd-494d-aca6-f990247ffa3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:38.854623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a702d74-eabd-494d-aca6-f990247ffa3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:38.855061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a702d74-eabd-494d-aca6-f990247ffa3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:38.855737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a702d74-eabd-494d-aca6-f990247ffa3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:38.856182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a702d74-eabd-494d-aca6-f990247ffa3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:38.856599 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a702d74-eabd-494d-aca6-f990247ffa3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:38.919083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1a702d74-eabd-494d-aca6-f990247ffa3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:38.927525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1a702d74-eabd-494d-aca6-f990247ffa3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084023 Sep 01 05:23:38.928083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 618/1268] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:38 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:39.585882 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4cf1bdab-6938-4c06-89a2-c43de8bb50c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:39.588152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4cf1bdab-6938-4c06-89a2-c43de8bb50c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:39.594598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4cf1bdab-6938-4c06-89a2-c43de8bb50c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:39.595070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4cf1bdab-6938-4c06-89a2-c43de8bb50c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:39.595496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4cf1bdab-6938-4c06-89a2-c43de8bb50c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:39.596175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4cf1bdab-6938-4c06-89a2-c43de8bb50c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:39.596616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4cf1bdab-6938-4c06-89a2-c43de8bb50c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:39.597088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4cf1bdab-6938-4c06-89a2-c43de8bb50c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:39.626232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4cf1bdab-6938-4c06-89a2-c43de8bb50c9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044795 Sep 01 05:23:39.626780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 651/1269] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:39 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:39.632574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-65a0f0a3-647d-40a9-9fc5-6bf0dd99186a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:39.634723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-65a0f0a3-647d-40a9-9fc5-6bf0dd99186a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:39.641225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65a0f0a3-647d-40a9-9fc5-6bf0dd99186a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:39.641695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65a0f0a3-647d-40a9-9fc5-6bf0dd99186a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:39.642122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65a0f0a3-647d-40a9-9fc5-6bf0dd99186a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:39.642808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65a0f0a3-647d-40a9-9fc5-6bf0dd99186a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:39.643240 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65a0f0a3-647d-40a9-9fc5-6bf0dd99186a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:39.643651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65a0f0a3-647d-40a9-9fc5-6bf0dd99186a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:39.673253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-65a0f0a3-647d-40a9-9fc5-6bf0dd99186a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044620 Sep 01 05:23:39.673792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 619/1270] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:39.947995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2b28677e-6b27-4cf4-b664-867287ea440f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:39.948608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2b28677e-6b27-4cf4-b664-867287ea440f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:39.954581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b28677e-6b27-4cf4-b664-867287ea440f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:39.955066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b28677e-6b27-4cf4-b664-867287ea440f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:39.955502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b28677e-6b27-4cf4-b664-867287ea440f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:39.956185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b28677e-6b27-4cf4-b664-867287ea440f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:39.957381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b28677e-6b27-4cf4-b664-867287ea440f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:39.957817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2b28677e-6b27-4cf4-b664-867287ea440f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:40.017646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2b28677e-6b27-4cf4-b664-867287ea440f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:40.026360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2b28677e-6b27-4cf4-b664-867287ea440f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082232 Sep 01 05:23:40.026922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 652/1271] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:39 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:40.637846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a9780869-0dac-473f-a01d-7daed901d266 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:40.639971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a9780869-0dac-473f-a01d-7daed901d266 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:40.646802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9780869-0dac-473f-a01d-7daed901d266 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:40.647275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9780869-0dac-473f-a01d-7daed901d266 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:40.647708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9780869-0dac-473f-a01d-7daed901d266 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:40.648389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9780869-0dac-473f-a01d-7daed901d266 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:40.648867 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9780869-0dac-473f-a01d-7daed901d266 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:40.649348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9780869-0dac-473f-a01d-7daed901d266 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:40.685589 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a9780869-0dac-473f-a01d-7daed901d266 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051709 Sep 01 05:23:40.685794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9b77ab64-6632-4c16-a0b9-e8267df3af6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:40.686469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 620/1272] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:40.687859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9b77ab64-6632-4c16-a0b9-e8267df3af6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:40.694739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b77ab64-6632-4c16-a0b9-e8267df3af6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:40.695214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b77ab64-6632-4c16-a0b9-e8267df3af6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:40.695641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b77ab64-6632-4c16-a0b9-e8267df3af6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:40.696320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b77ab64-6632-4c16-a0b9-e8267df3af6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:40.696812 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b77ab64-6632-4c16-a0b9-e8267df3af6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:40.697301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b77ab64-6632-4c16-a0b9-e8267df3af6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:40.727406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9b77ab64-6632-4c16-a0b9-e8267df3af6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045672 Sep 01 05:23:40.727967 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 653/1273] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:40 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:41.046968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-818efe1b-56e8-48a6-a5e3-eb4eab758f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:41.047579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-818efe1b-56e8-48a6-a5e3-eb4eab758f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:41.053619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-818efe1b-56e8-48a6-a5e3-eb4eab758f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:41.054097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-818efe1b-56e8-48a6-a5e3-eb4eab758f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:41.054529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-818efe1b-56e8-48a6-a5e3-eb4eab758f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:41.055206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-818efe1b-56e8-48a6-a5e3-eb4eab758f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:41.055657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-818efe1b-56e8-48a6-a5e3-eb4eab758f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:41.056074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-818efe1b-56e8-48a6-a5e3-eb4eab758f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:41.120949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-818efe1b-56e8-48a6-a5e3-eb4eab758f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:41.128610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-818efe1b-56e8-48a6-a5e3-eb4eab758f3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085570 Sep 01 05:23:41.129205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 621/1274] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:41 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:41.697917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4ac61536-f13c-405d-9a45-3847fc3f13dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:41.700066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4ac61536-f13c-405d-9a45-3847fc3f13dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:41.706412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ac61536-f13c-405d-9a45-3847fc3f13dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:41.706885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ac61536-f13c-405d-9a45-3847fc3f13dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:41.707315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ac61536-f13c-405d-9a45-3847fc3f13dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:41.708659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ac61536-f13c-405d-9a45-3847fc3f13dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:41.709120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ac61536-f13c-405d-9a45-3847fc3f13dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:41.709561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ac61536-f13c-405d-9a45-3847fc3f13dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:41.738776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4ac61536-f13c-405d-9a45-3847fc3f13dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044786 Sep 01 05:23:41.739401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 654/1275] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:41.739570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5aaab1c6-def3-4c1c-8a09-19baa72efe12 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:41.741682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5aaab1c6-def3-4c1c-8a09-19baa72efe12 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:41.748088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5aaab1c6-def3-4c1c-8a09-19baa72efe12 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:41.748556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5aaab1c6-def3-4c1c-8a09-19baa72efe12 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:41.749022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5aaab1c6-def3-4c1c-8a09-19baa72efe12 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:41.749700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5aaab1c6-def3-4c1c-8a09-19baa72efe12 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:41.750143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5aaab1c6-def3-4c1c-8a09-19baa72efe12 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:41.750558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5aaab1c6-def3-4c1c-8a09-19baa72efe12 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:41.779818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5aaab1c6-def3-4c1c-8a09-19baa72efe12 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044241 Sep 01 05:23:41.780365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 622/1276] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:42.150107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-708a4863-38d1-4e63-a127-61845f6cb37a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:42.150722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-708a4863-38d1-4e63-a127-61845f6cb37a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:42.156649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-708a4863-38d1-4e63-a127-61845f6cb37a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:42.157185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-708a4863-38d1-4e63-a127-61845f6cb37a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:42.157621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-708a4863-38d1-4e63-a127-61845f6cb37a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:42.158306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-708a4863-38d1-4e63-a127-61845f6cb37a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:42.158758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-708a4863-38d1-4e63-a127-61845f6cb37a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:42.159188 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-708a4863-38d1-4e63-a127-61845f6cb37a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:42.221966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-708a4863-38d1-4e63-a127-61845f6cb37a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:42.230205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-708a4863-38d1-4e63-a127-61845f6cb37a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084716 Sep 01 05:23:42.230769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 655/1277] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:42 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:42.750992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d6d30f60-074e-4a85-b8cb-00af0b5c8e4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:42.753137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d6d30f60-074e-4a85-b8cb-00af0b5c8e4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:42.759671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d6d30f60-074e-4a85-b8cb-00af0b5c8e4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:42.760137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d6d30f60-074e-4a85-b8cb-00af0b5c8e4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:42.760560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d6d30f60-074e-4a85-b8cb-00af0b5c8e4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:42.761263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d6d30f60-074e-4a85-b8cb-00af0b5c8e4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:42.761705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d6d30f60-074e-4a85-b8cb-00af0b5c8e4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:42.762116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d6d30f60-074e-4a85-b8cb-00af0b5c8e4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:42.792556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d6d30f60-074e-4a85-b8cb-00af0b5c8e4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045604 Sep 01 05:23:42.793056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-752781cc-05e5-487e-90c0-c524babb0546 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:42.793515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 623/1278] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:42.795650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-752781cc-05e5-487e-90c0-c524babb0546 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:42.801913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-752781cc-05e5-487e-90c0-c524babb0546 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:42.802391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-752781cc-05e5-487e-90c0-c524babb0546 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:42.802827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-752781cc-05e5-487e-90c0-c524babb0546 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:42.803524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-752781cc-05e5-487e-90c0-c524babb0546 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:42.803975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-752781cc-05e5-487e-90c0-c524babb0546 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:42.804396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-752781cc-05e5-487e-90c0-c524babb0546 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:42.834554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-752781cc-05e5-487e-90c0-c524babb0546 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045032 Sep 01 05:23:42.835282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 656/1279] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:42 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:43.251608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3b9c3191-b20d-4c12-8fcb-fe35383784b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:43.252218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3b9c3191-b20d-4c12-8fcb-fe35383784b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:43.259199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3b9c3191-b20d-4c12-8fcb-fe35383784b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:43.259672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3b9c3191-b20d-4c12-8fcb-fe35383784b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:43.260104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3b9c3191-b20d-4c12-8fcb-fe35383784b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:43.260805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3b9c3191-b20d-4c12-8fcb-fe35383784b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:43.261253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3b9c3191-b20d-4c12-8fcb-fe35383784b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:43.261673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3b9c3191-b20d-4c12-8fcb-fe35383784b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:43.322937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3b9c3191-b20d-4c12-8fcb-fe35383784b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:43.325110 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:43.332088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3b9c3191-b20d-4c12-8fcb-fe35383784b0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084416 Sep 01 05:23:43.332646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 624/1280] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:43 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:43.805388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e20fd8be-5226-4dd0-b570-1493173b171e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:43.807565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e20fd8be-5226-4dd0-b570-1493173b171e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:43.813977 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e20fd8be-5226-4dd0-b570-1493173b171e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:43.814458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e20fd8be-5226-4dd0-b570-1493173b171e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:43.814896 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e20fd8be-5226-4dd0-b570-1493173b171e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:43.815842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e20fd8be-5226-4dd0-b570-1493173b171e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:43.816293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e20fd8be-5226-4dd0-b570-1493173b171e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:43.816717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e20fd8be-5226-4dd0-b570-1493173b171e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:43.845464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e20fd8be-5226-4dd0-b570-1493173b171e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044667 Sep 01 05:23:43.845947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 657/1281] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:43.847089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-91f662ad-4861-4887-bdca-172d92d87f8c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:43.850299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-91f662ad-4861-4887-bdca-172d92d87f8c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:43.856750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91f662ad-4861-4887-bdca-172d92d87f8c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:43.857260 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91f662ad-4861-4887-bdca-172d92d87f8c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:43.857694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91f662ad-4861-4887-bdca-172d92d87f8c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:43.858383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91f662ad-4861-4887-bdca-172d92d87f8c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:43.858832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91f662ad-4861-4887-bdca-172d92d87f8c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:43.859249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91f662ad-4861-4887-bdca-172d92d87f8c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:43.889004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-91f662ad-4861-4887-bdca-172d92d87f8c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045979 Sep 01 05:23:43.889549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 625/1282] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:43 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:44.352641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a10167e2-e1b1-4436-b1f4-78825abd6ac7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:44.353283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a10167e2-e1b1-4436-b1f4-78825abd6ac7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:44.359146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a10167e2-e1b1-4436-b1f4-78825abd6ac7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:44.359629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a10167e2-e1b1-4436-b1f4-78825abd6ac7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:44.360061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a10167e2-e1b1-4436-b1f4-78825abd6ac7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:44.360741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a10167e2-e1b1-4436-b1f4-78825abd6ac7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:44.361221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a10167e2-e1b1-4436-b1f4-78825abd6ac7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:44.361642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a10167e2-e1b1-4436-b1f4-78825abd6ac7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:44.421399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a10167e2-e1b1-4436-b1f4-78825abd6ac7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:44.429142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a10167e2-e1b1-4436-b1f4-78825abd6ac7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.080314 Sep 01 05:23:44.429699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 658/1283] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:44 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:44.858478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3ce9b51d-a88c-409e-9b5c-0eea52d49e4d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:44.860710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3ce9b51d-a88c-409e-9b5c-0eea52d49e4d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:44.867906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ce9b51d-a88c-409e-9b5c-0eea52d49e4d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:44.868385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ce9b51d-a88c-409e-9b5c-0eea52d49e4d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:44.868839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ce9b51d-a88c-409e-9b5c-0eea52d49e4d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:44.869532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ce9b51d-a88c-409e-9b5c-0eea52d49e4d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:44.869979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ce9b51d-a88c-409e-9b5c-0eea52d49e4d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:44.870395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ce9b51d-a88c-409e-9b5c-0eea52d49e4d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:44.901495 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-090d0c9d-67b0-4c3b-a27e-c525bf5a9a74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:44.902154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3ce9b51d-a88c-409e-9b5c-0eea52d49e4d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047609 Sep 01 05:23:44.902896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 626/1284] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:44.903889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-090d0c9d-67b0-4c3b-a27e-c525bf5a9a74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:44.910295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-090d0c9d-67b0-4c3b-a27e-c525bf5a9a74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:44.910848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-090d0c9d-67b0-4c3b-a27e-c525bf5a9a74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:44.911353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-090d0c9d-67b0-4c3b-a27e-c525bf5a9a74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:44.912678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-090d0c9d-67b0-4c3b-a27e-c525bf5a9a74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:44.913216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-090d0c9d-67b0-4c3b-a27e-c525bf5a9a74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:44.913717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-090d0c9d-67b0-4c3b-a27e-c525bf5a9a74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:44.943573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-090d0c9d-67b0-4c3b-a27e-c525bf5a9a74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045925 Sep 01 05:23:44.944125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 659/1285] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:44 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:45.450591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1710834b-e020-43ec-9307-8641a7e3b7cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:45.451202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1710834b-e020-43ec-9307-8641a7e3b7cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:45.457144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1710834b-e020-43ec-9307-8641a7e3b7cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:45.457619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1710834b-e020-43ec-9307-8641a7e3b7cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:45.458052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1710834b-e020-43ec-9307-8641a7e3b7cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:45.458784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1710834b-e020-43ec-9307-8641a7e3b7cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:45.459833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1710834b-e020-43ec-9307-8641a7e3b7cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:45.460264 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1710834b-e020-43ec-9307-8641a7e3b7cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:45.520118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1710834b-e020-43ec-9307-8641a7e3b7cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:45.528609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1710834b-e020-43ec-9307-8641a7e3b7cf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081926 Sep 01 05:23:45.529205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 627/1286] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:45 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:45.914247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-80b44a8e-f056-4571-ae53-cbb12d41fc04 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:45.916391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-80b44a8e-f056-4571-ae53-cbb12d41fc04 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:45.922911 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80b44a8e-f056-4571-ae53-cbb12d41fc04 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:45.923395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80b44a8e-f056-4571-ae53-cbb12d41fc04 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:45.923836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80b44a8e-f056-4571-ae53-cbb12d41fc04 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:45.924527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80b44a8e-f056-4571-ae53-cbb12d41fc04 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:45.925005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80b44a8e-f056-4571-ae53-cbb12d41fc04 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:45.925430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80b44a8e-f056-4571-ae53-cbb12d41fc04 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:45.955265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-80b44a8e-f056-4571-ae53-cbb12d41fc04 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045501 Sep 01 05:23:45.955548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7dca27f6-cdc3-438f-8ab2-a0777dc1026b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:45.955984 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 660/1287] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:45 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:45.957928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7dca27f6-cdc3-438f-8ab2-a0777dc1026b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:45.964504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7dca27f6-cdc3-438f-8ab2-a0777dc1026b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:45.965015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7dca27f6-cdc3-438f-8ab2-a0777dc1026b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:45.965441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7dca27f6-cdc3-438f-8ab2-a0777dc1026b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:45.966122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7dca27f6-cdc3-438f-8ab2-a0777dc1026b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:45.966566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7dca27f6-cdc3-438f-8ab2-a0777dc1026b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:45.966978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7dca27f6-cdc3-438f-8ab2-a0777dc1026b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:45.997928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7dca27f6-cdc3-438f-8ab2-a0777dc1026b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046294 Sep 01 05:23:45.998483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 628/1288] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:46.549616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5c399eeb-2fad-4913-8f4c-1635708ee4ae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:46.550226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5c399eeb-2fad-4913-8f4c-1635708ee4ae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:46.556136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c399eeb-2fad-4913-8f4c-1635708ee4ae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:46.556615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c399eeb-2fad-4913-8f4c-1635708ee4ae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:46.557076 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c399eeb-2fad-4913-8f4c-1635708ee4ae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:46.557753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c399eeb-2fad-4913-8f4c-1635708ee4ae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:46.558199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c399eeb-2fad-4913-8f4c-1635708ee4ae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:46.558616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c399eeb-2fad-4913-8f4c-1635708ee4ae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:46.618948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5c399eeb-2fad-4913-8f4c-1635708ee4ae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:46.626681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5c399eeb-2fad-4913-8f4c-1635708ee4ae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.080850 Sep 01 05:23:46.627224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 661/1289] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:46 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:46.967776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c5bf2b96-a052-4a20-b152-496b10d118f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:46.969964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c5bf2b96-a052-4a20-b152-496b10d118f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:46.977139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c5bf2b96-a052-4a20-b152-496b10d118f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:46.977613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c5bf2b96-a052-4a20-b152-496b10d118f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:46.978039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c5bf2b96-a052-4a20-b152-496b10d118f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:46.978712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c5bf2b96-a052-4a20-b152-496b10d118f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:46.979155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c5bf2b96-a052-4a20-b152-496b10d118f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:46.979569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c5bf2b96-a052-4a20-b152-496b10d118f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:47.009010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c5bf2b96-a052-4a20-b152-496b10d118f9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045111 Sep 01 05:23:47.009585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 629/1290] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:47.010489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6b3bffcc-493f-41f9-9c15-952600b6e6a9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:47.012683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6b3bffcc-493f-41f9-9c15-952600b6e6a9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:47.019137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b3bffcc-493f-41f9-9c15-952600b6e6a9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:47.019620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b3bffcc-493f-41f9-9c15-952600b6e6a9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:47.020057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b3bffcc-493f-41f9-9c15-952600b6e6a9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:47.020739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b3bffcc-493f-41f9-9c15-952600b6e6a9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:47.021218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b3bffcc-493f-41f9-9c15-952600b6e6a9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:47.022748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b3bffcc-493f-41f9-9c15-952600b6e6a9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:47.036237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:47.053858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6b3bffcc-493f-41f9-9c15-952600b6e6a9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047899 Sep 01 05:23:47.054417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 662/1291] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:47.649719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1e316595-1430-403d-9efb-2185cab99e93 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:47.650328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1e316595-1430-403d-9efb-2185cab99e93 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:47.652177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=84 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:47.657500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e316595-1430-403d-9efb-2185cab99e93 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:47.657969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e316595-1430-403d-9efb-2185cab99e93 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:47.658396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e316595-1430-403d-9efb-2185cab99e93 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:47.659070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e316595-1430-403d-9efb-2185cab99e93 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:47.659506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e316595-1430-403d-9efb-2185cab99e93 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:47.659917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e316595-1430-403d-9efb-2185cab99e93 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:47.721890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1e316595-1430-403d-9efb-2185cab99e93 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:47.729644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1e316595-1430-403d-9efb-2185cab99e93 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084632 Sep 01 05:23:47.730201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 630/1292] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:47 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:48.020829 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-231883c7-d937-4887-be0c-388fd45d6202 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:48.023673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-231883c7-d937-4887-be0c-388fd45d6202 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:48.030188 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-231883c7-d937-4887-be0c-388fd45d6202 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:48.030666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-231883c7-d937-4887-be0c-388fd45d6202 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:48.031101 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-231883c7-d937-4887-be0c-388fd45d6202 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:48.031786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-231883c7-d937-4887-be0c-388fd45d6202 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:48.032235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-231883c7-d937-4887-be0c-388fd45d6202 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:48.032653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-231883c7-d937-4887-be0c-388fd45d6202 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:48.064144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-231883c7-d937-4887-be0c-388fd45d6202 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047308 Sep 01 05:23:48.064700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 663/1293] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:48.066212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a2321a39-4b4c-4989-a50b-309af7621e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:48.068489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a2321a39-4b4c-4989-a50b-309af7621e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:48.074928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2321a39-4b4c-4989-a50b-309af7621e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:48.075406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2321a39-4b4c-4989-a50b-309af7621e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:48.075841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2321a39-4b4c-4989-a50b-309af7621e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:48.076524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2321a39-4b4c-4989-a50b-309af7621e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:48.077012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2321a39-4b4c-4989-a50b-309af7621e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:48.077431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2321a39-4b4c-4989-a50b-309af7621e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:48.106379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a2321a39-4b4c-4989-a50b-309af7621e3e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044490 Sep 01 05:23:48.106931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 631/1294] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:48 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:48.749990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4f8a316c-1056-4eb0-87f7-91fd20b50fb6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:48.750607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4f8a316c-1056-4eb0-87f7-91fd20b50fb6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:48.757282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4f8a316c-1056-4eb0-87f7-91fd20b50fb6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:48.757769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4f8a316c-1056-4eb0-87f7-91fd20b50fb6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:48.758202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4f8a316c-1056-4eb0-87f7-91fd20b50fb6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:48.758885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4f8a316c-1056-4eb0-87f7-91fd20b50fb6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:48.759334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4f8a316c-1056-4eb0-87f7-91fd20b50fb6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:48.759754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4f8a316c-1056-4eb0-87f7-91fd20b50fb6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:48.820725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4f8a316c-1056-4eb0-87f7-91fd20b50fb6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:48.828559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4f8a316c-1056-4eb0-87f7-91fd20b50fb6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082437 Sep 01 05:23:48.829150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 664/1295] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:48 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:49.076952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7c6b9e18-5e0e-4c01-aa7d-806f099c69ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:49.078993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7c6b9e18-5e0e-4c01-aa7d-806f099c69ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:49.085852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7c6b9e18-5e0e-4c01-aa7d-806f099c69ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:49.086328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7c6b9e18-5e0e-4c01-aa7d-806f099c69ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:49.086756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7c6b9e18-5e0e-4c01-aa7d-806f099c69ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:49.087441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7c6b9e18-5e0e-4c01-aa7d-806f099c69ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:49.087884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7c6b9e18-5e0e-4c01-aa7d-806f099c69ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:49.088315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7c6b9e18-5e0e-4c01-aa7d-806f099c69ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:49.118910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7c6b9e18-5e0e-4c01-aa7d-806f099c69ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046014 Sep 01 05:23:49.119330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-24c09e8b-bb2e-40d5-9ff2-e62cfac6a6b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:49.119849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 632/1296] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:49 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:49.121684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-24c09e8b-bb2e-40d5-9ff2-e62cfac6a6b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:49.128040 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24c09e8b-bb2e-40d5-9ff2-e62cfac6a6b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:49.128514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24c09e8b-bb2e-40d5-9ff2-e62cfac6a6b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:49.128981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24c09e8b-bb2e-40d5-9ff2-e62cfac6a6b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:49.129660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24c09e8b-bb2e-40d5-9ff2-e62cfac6a6b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:49.130143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24c09e8b-bb2e-40d5-9ff2-e62cfac6a6b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:49.130557 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24c09e8b-bb2e-40d5-9ff2-e62cfac6a6b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:49.159985 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-24c09e8b-bb2e-40d5-9ff2-e62cfac6a6b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045292 Sep 01 05:23:49.160528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 665/1297] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:49 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:49.850799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-29d83875-677f-4a3f-be1f-c32b5eb18836 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:49.851322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-29d83875-677f-4a3f-be1f-c32b5eb18836 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:49.857268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29d83875-677f-4a3f-be1f-c32b5eb18836 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:49.857992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29d83875-677f-4a3f-be1f-c32b5eb18836 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:49.858514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29d83875-677f-4a3f-be1f-c32b5eb18836 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:49.859337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29d83875-677f-4a3f-be1f-c32b5eb18836 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:49.859899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29d83875-677f-4a3f-be1f-c32b5eb18836 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:49.860400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29d83875-677f-4a3f-be1f-c32b5eb18836 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:49.924871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-29d83875-677f-4a3f-be1f-c32b5eb18836 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:49.933571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-29d83875-677f-4a3f-be1f-c32b5eb18836 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086845 Sep 01 05:23:49.934140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 633/1298] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:49 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:50.131903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6bed9c5a-ee3b-47c7-a0f7-c4807f65962b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:50.134110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6bed9c5a-ee3b-47c7-a0f7-c4807f65962b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:50.140535 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6bed9c5a-ee3b-47c7-a0f7-c4807f65962b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:50.141050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6bed9c5a-ee3b-47c7-a0f7-c4807f65962b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:50.141489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6bed9c5a-ee3b-47c7-a0f7-c4807f65962b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:50.142181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6bed9c5a-ee3b-47c7-a0f7-c4807f65962b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:50.142632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6bed9c5a-ee3b-47c7-a0f7-c4807f65962b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:50.143055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6bed9c5a-ee3b-47c7-a0f7-c4807f65962b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:50.171948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6bed9c5a-ee3b-47c7-a0f7-c4807f65962b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044677 Sep 01 05:23:50.172686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 666/1299] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:50.172906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2bca5a8f-db42-43fc-8db8-7040be63fa1a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:50.175605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2bca5a8f-db42-43fc-8db8-7040be63fa1a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:50.182911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2bca5a8f-db42-43fc-8db8-7040be63fa1a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:50.183392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2bca5a8f-db42-43fc-8db8-7040be63fa1a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:50.183854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2bca5a8f-db42-43fc-8db8-7040be63fa1a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:50.184539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2bca5a8f-db42-43fc-8db8-7040be63fa1a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:50.185027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2bca5a8f-db42-43fc-8db8-7040be63fa1a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:50.185449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2bca5a8f-db42-43fc-8db8-7040be63fa1a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:50.215614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2bca5a8f-db42-43fc-8db8-7040be63fa1a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046822 Sep 01 05:23:50.216167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 634/1300] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:50 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:50.955155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-94563ad4-8940-4009-a569-2f3d3822dc10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:50.955766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-94563ad4-8940-4009-a569-2f3d3822dc10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:50.962485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94563ad4-8940-4009-a569-2f3d3822dc10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:50.962978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94563ad4-8940-4009-a569-2f3d3822dc10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:50.963413 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94563ad4-8940-4009-a569-2f3d3822dc10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:50.964098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94563ad4-8940-4009-a569-2f3d3822dc10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:50.964551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94563ad4-8940-4009-a569-2f3d3822dc10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:50.965019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94563ad4-8940-4009-a569-2f3d3822dc10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:51.027761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-94563ad4-8940-4009-a569-2f3d3822dc10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:51.035460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-94563ad4-8940-4009-a569-2f3d3822dc10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084190 Sep 01 05:23:51.036019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 667/1301] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:50 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:51.184139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c6f7a180-7946-4f5d-b604-84c1695f361c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:51.186848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c6f7a180-7946-4f5d-b604-84c1695f361c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:51.195268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6f7a180-7946-4f5d-b604-84c1695f361c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:51.195268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6f7a180-7946-4f5d-b604-84c1695f361c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:51.195509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6f7a180-7946-4f5d-b604-84c1695f361c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:51.196087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6f7a180-7946-4f5d-b604-84c1695f361c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:51.196569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6f7a180-7946-4f5d-b604-84c1695f361c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:51.197093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c6f7a180-7946-4f5d-b604-84c1695f361c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:51.227647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a3760363-be78-4905-ad95-5362782af497 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:51.228467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c6f7a180-7946-4f5d-b604-84c1695f361c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048572 Sep 01 05:23:51.229074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 635/1302] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:51 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:51.229956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a3760363-be78-4905-ad95-5362782af497 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:51.236341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3760363-be78-4905-ad95-5362782af497 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:51.236842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3760363-be78-4905-ad95-5362782af497 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:51.237282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3760363-be78-4905-ad95-5362782af497 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:51.237966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3760363-be78-4905-ad95-5362782af497 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:51.238410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3760363-be78-4905-ad95-5362782af497 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:51.238847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3760363-be78-4905-ad95-5362782af497 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:51.268340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a3760363-be78-4905-ad95-5362782af497 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044673 Sep 01 05:23:51.268901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 668/1303] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:52.057412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-722c4b9b-10fc-4b8b-b79e-80a41b6f9582 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:52.058027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-722c4b9b-10fc-4b8b-b79e-80a41b6f9582 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:52.064018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-722c4b9b-10fc-4b8b-b79e-80a41b6f9582 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:52.064496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-722c4b9b-10fc-4b8b-b79e-80a41b6f9582 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:52.064955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-722c4b9b-10fc-4b8b-b79e-80a41b6f9582 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:52.065895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-722c4b9b-10fc-4b8b-b79e-80a41b6f9582 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:52.066342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-722c4b9b-10fc-4b8b-b79e-80a41b6f9582 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:52.066758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-722c4b9b-10fc-4b8b-b79e-80a41b6f9582 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:52.128131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-722c4b9b-10fc-4b8b-b79e-80a41b6f9582 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:52.136624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-722c4b9b-10fc-4b8b-b79e-80a41b6f9582 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083787 Sep 01 05:23:52.137208 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 636/1304] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:52 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:52.241578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dd7f914c-fecd-4071-a609-0bbfb885d744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:52.243691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dd7f914c-fecd-4071-a609-0bbfb885d744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:52.246026 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=86 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:52.251437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd7f914c-fecd-4071-a609-0bbfb885d744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:52.251945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd7f914c-fecd-4071-a609-0bbfb885d744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:52.252385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd7f914c-fecd-4071-a609-0bbfb885d744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:52.253131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd7f914c-fecd-4071-a609-0bbfb885d744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:52.253588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd7f914c-fecd-4071-a609-0bbfb885d744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:52.254009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd7f914c-fecd-4071-a609-0bbfb885d744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:52.281609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-aceb41e7-1b23-47ea-a936-98c08ba16d4c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:52.283899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-aceb41e7-1b23-47ea-a936-98c08ba16d4c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:52.285028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dd7f914c-fecd-4071-a609-0bbfb885d744 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048105 Sep 01 05:23:52.285498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 669/1305] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:52.290864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aceb41e7-1b23-47ea-a936-98c08ba16d4c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:52.291366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aceb41e7-1b23-47ea-a936-98c08ba16d4c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:52.291795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aceb41e7-1b23-47ea-a936-98c08ba16d4c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:52.292482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aceb41e7-1b23-47ea-a936-98c08ba16d4c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:52.292954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aceb41e7-1b23-47ea-a936-98c08ba16d4c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:52.293370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aceb41e7-1b23-47ea-a936-98c08ba16d4c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:52.324700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-aceb41e7-1b23-47ea-a936-98c08ba16d4c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047229 Sep 01 05:23:52.325284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 637/1306] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:53.158194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-56175498-9cf1-4c91-8ec6-d03aff185b20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:53.158720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-56175498-9cf1-4c91-8ec6-d03aff185b20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:53.164606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-56175498-9cf1-4c91-8ec6-d03aff185b20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:53.165123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-56175498-9cf1-4c91-8ec6-d03aff185b20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:53.165560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-56175498-9cf1-4c91-8ec6-d03aff185b20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:53.166231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-56175498-9cf1-4c91-8ec6-d03aff185b20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:53.166675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-56175498-9cf1-4c91-8ec6-d03aff185b20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:53.167089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-56175498-9cf1-4c91-8ec6-d03aff185b20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:53.229220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-56175498-9cf1-4c91-8ec6-d03aff185b20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:53.236839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-56175498-9cf1-4c91-8ec6-d03aff185b20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082554 Sep 01 05:23:53.237398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 670/1307] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:53 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:53.297052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ffb87e5f-ac85-4665-b253-9a025b698c2c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:53.299202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ffb87e5f-ac85-4665-b253-9a025b698c2c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:53.305687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffb87e5f-ac85-4665-b253-9a025b698c2c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:53.306160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffb87e5f-ac85-4665-b253-9a025b698c2c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:53.306584 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffb87e5f-ac85-4665-b253-9a025b698c2c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:53.307263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffb87e5f-ac85-4665-b253-9a025b698c2c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:53.307710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffb87e5f-ac85-4665-b253-9a025b698c2c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:53.308120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffb87e5f-ac85-4665-b253-9a025b698c2c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:53.337616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5907e93b-3d38-4464-ba97-417c3441a7c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:53.338324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ffb87e5f-ac85-4665-b253-9a025b698c2c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045178 Sep 01 05:23:53.338894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 638/1308] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:53.339839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5907e93b-3d38-4464-ba97-417c3441a7c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:53.346371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5907e93b-3d38-4464-ba97-417c3441a7c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:53.346855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5907e93b-3d38-4464-ba97-417c3441a7c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:53.347293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5907e93b-3d38-4464-ba97-417c3441a7c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:53.347983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5907e93b-3d38-4464-ba97-417c3441a7c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:53.348435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5907e93b-3d38-4464-ba97-417c3441a7c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:53.348889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5907e93b-3d38-4464-ba97-417c3441a7c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:53.378063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5907e93b-3d38-4464-ba97-417c3441a7c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 Sep 01 05:23:53.378610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 671/1309] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:54.258897 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0c81da0b-ee80-4bc7-9c36-8dab5d7aff55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:54.259663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0c81da0b-ee80-4bc7-9c36-8dab5d7aff55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:54.266371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c81da0b-ee80-4bc7-9c36-8dab5d7aff55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:54.266856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c81da0b-ee80-4bc7-9c36-8dab5d7aff55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:54.267289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c81da0b-ee80-4bc7-9c36-8dab5d7aff55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:54.267977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c81da0b-ee80-4bc7-9c36-8dab5d7aff55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:54.268428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c81da0b-ee80-4bc7-9c36-8dab5d7aff55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:54.268889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c81da0b-ee80-4bc7-9c36-8dab5d7aff55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:54.330381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0c81da0b-ee80-4bc7-9c36-8dab5d7aff55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:54.338153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0c81da0b-ee80-4bc7-9c36-8dab5d7aff55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084248 Sep 01 05:23:54.338710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 639/1310] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:54 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:54.351231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6975e405-cc66-4189-b2c6-d85217138f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:54.353518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6975e405-cc66-4189-b2c6-d85217138f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:54.359796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6975e405-cc66-4189-b2c6-d85217138f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:54.360271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6975e405-cc66-4189-b2c6-d85217138f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:54.360698 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6975e405-cc66-4189-b2c6-d85217138f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:54.361401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6975e405-cc66-4189-b2c6-d85217138f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:54.361863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6975e405-cc66-4189-b2c6-d85217138f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:54.362279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6975e405-cc66-4189-b2c6-d85217138f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:54.390110 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ffac7572-90db-4d8e-8a0f-e5a4b1387e14 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:54.392413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ffac7572-90db-4d8e-8a0f-e5a4b1387e14 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:54.392915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6975e405-cc66-4189-b2c6-d85217138f2e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046262 Sep 01 05:23:54.393479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 672/1311] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:54.399000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffac7572-90db-4d8e-8a0f-e5a4b1387e14 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:54.399471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffac7572-90db-4d8e-8a0f-e5a4b1387e14 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:54.399897 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffac7572-90db-4d8e-8a0f-e5a4b1387e14 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:54.400580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffac7572-90db-4d8e-8a0f-e5a4b1387e14 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:54.401049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffac7572-90db-4d8e-8a0f-e5a4b1387e14 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:54.401466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffac7572-90db-4d8e-8a0f-e5a4b1387e14 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:54.431704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ffac7572-90db-4d8e-8a0f-e5a4b1387e14 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045443 Sep 01 05:23:54.432278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 640/1312] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:55.359602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fa58fac9-07c3-47f0-8864-54158db5fba4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:55.360166 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fa58fac9-07c3-47f0-8864-54158db5fba4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:55.366714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa58fac9-07c3-47f0-8864-54158db5fba4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:55.367190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa58fac9-07c3-47f0-8864-54158db5fba4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:55.367623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa58fac9-07c3-47f0-8864-54158db5fba4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:55.368300 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa58fac9-07c3-47f0-8864-54158db5fba4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:55.368749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa58fac9-07c3-47f0-8864-54158db5fba4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:55.369194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa58fac9-07c3-47f0-8864-54158db5fba4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:55.405785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8c5da3ba-d571-4229-915c-2d44c910a0df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:55.407922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8c5da3ba-d571-4229-915c-2d44c910a0df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:55.414903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c5da3ba-d571-4229-915c-2d44c910a0df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:55.415395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c5da3ba-d571-4229-915c-2d44c910a0df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:55.415831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c5da3ba-d571-4229-915c-2d44c910a0df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:55.416533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c5da3ba-d571-4229-915c-2d44c910a0df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:55.417081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c5da3ba-d571-4229-915c-2d44c910a0df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:55.417502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c5da3ba-d571-4229-915c-2d44c910a0df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:55.431724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fa58fac9-07c3-47f0-8864-54158db5fba4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:55.432582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:55.442491 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fa58fac9-07c3-47f0-8864-54158db5fba4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086807 Sep 01 05:23:55.443366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 673/1313] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:55 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:55.449733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4238724e-acc6-465e-9674-e394b6086590 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:55.451136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8c5da3ba-d571-4229-915c-2d44c910a0df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049345 Sep 01 05:23:55.452011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4238724e-acc6-465e-9674-e394b6086590 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:55.452161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 641/1314] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:23:55.457978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4238724e-acc6-465e-9674-e394b6086590 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:55.458454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4238724e-acc6-465e-9674-e394b6086590 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:55.458884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4238724e-acc6-465e-9674-e394b6086590 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:55.460180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4238724e-acc6-465e-9674-e394b6086590 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:55.460625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4238724e-acc6-465e-9674-e394b6086590 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:55.461063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4238724e-acc6-465e-9674-e394b6086590 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:55.490936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4238724e-acc6-465e-9674-e394b6086590 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045885 Sep 01 05:23:55.491519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 674/1315] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:55 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:56.463477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ad068139-68ef-4718-ae49-69f864a1ba47 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:56.464152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-19ffbfcb-e3a3-4e92-ba1c-330c25fd99b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:56.464525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ad068139-68ef-4718-ae49-69f864a1ba47 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:56.465748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-19ffbfcb-e3a3-4e92-ba1c-330c25fd99b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:56.470793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ad068139-68ef-4718-ae49-69f864a1ba47 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:56.471273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ad068139-68ef-4718-ae49-69f864a1ba47 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:56.471705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ad068139-68ef-4718-ae49-69f864a1ba47 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:56.472093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-19ffbfcb-e3a3-4e92-ba1c-330c25fd99b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:56.472397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ad068139-68ef-4718-ae49-69f864a1ba47 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:56.472575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-19ffbfcb-e3a3-4e92-ba1c-330c25fd99b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:56.472865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ad068139-68ef-4718-ae49-69f864a1ba47 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:56.473286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ad068139-68ef-4718-ae49-69f864a1ba47 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:56.473689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-19ffbfcb-e3a3-4e92-ba1c-330c25fd99b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:56.474366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-19ffbfcb-e3a3-4e92-ba1c-330c25fd99b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:56.475501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-19ffbfcb-e3a3-4e92-ba1c-330c25fd99b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:56.476141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-19ffbfcb-e3a3-4e92-ba1c-330c25fd99b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:56.507027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-19ffbfcb-e3a3-4e92-ba1c-330c25fd99b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046759 Sep 01 05:23:56.507593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 642/1316] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:56.512116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ed3cfd39-6dd7-4c91-b814-d10780d49864 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:56.514272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ed3cfd39-6dd7-4c91-b814-d10780d49864 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:56.520278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ed3cfd39-6dd7-4c91-b814-d10780d49864 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:56.520756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ed3cfd39-6dd7-4c91-b814-d10780d49864 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:56.521222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ed3cfd39-6dd7-4c91-b814-d10780d49864 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:56.522530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ed3cfd39-6dd7-4c91-b814-d10780d49864 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:56.522967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ed3cfd39-6dd7-4c91-b814-d10780d49864 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:56.523385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ed3cfd39-6dd7-4c91-b814-d10780d49864 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:56.542809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ad068139-68ef-4718-ae49-69f864a1ba47 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:56.550557 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ad068139-68ef-4718-ae49-69f864a1ba47 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.090991 Sep 01 05:23:56.551131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 675/1317] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:56 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:56.554234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ed3cfd39-6dd7-4c91-b814-d10780d49864 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045630 Sep 01 05:23:56.554787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 643/1318] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:57.519481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-96276397-dc13-4c4b-a70e-2092ddddb1d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:57.521737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-96276397-dc13-4c4b-a70e-2092ddddb1d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:57.528157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96276397-dc13-4c4b-a70e-2092ddddb1d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:57.528640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96276397-dc13-4c4b-a70e-2092ddddb1d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:57.529127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96276397-dc13-4c4b-a70e-2092ddddb1d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:57.529813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96276397-dc13-4c4b-a70e-2092ddddb1d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:57.530265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96276397-dc13-4c4b-a70e-2092ddddb1d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:57.530688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96276397-dc13-4c4b-a70e-2092ddddb1d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:57.560509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-96276397-dc13-4c4b-a70e-2092ddddb1d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045009 Sep 01 05:23:57.561100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 676/1319] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:57.566604 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7e541952-bb36-4aeb-8e6d-43db7115f0cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:57.568519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7e541952-bb36-4aeb-8e6d-43db7115f0cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:57.571744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-429b3ece-4da8-480f-902c-296af4161954 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:57.572382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-429b3ece-4da8-480f-902c-296af4161954 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:57.576087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e541952-bb36-4aeb-8e6d-43db7115f0cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:57.576573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e541952-bb36-4aeb-8e6d-43db7115f0cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:57.577027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e541952-bb36-4aeb-8e6d-43db7115f0cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:57.577719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e541952-bb36-4aeb-8e6d-43db7115f0cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:57.577993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-429b3ece-4da8-480f-902c-296af4161954 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:57.578172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e541952-bb36-4aeb-8e6d-43db7115f0cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:57.578470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-429b3ece-4da8-480f-902c-296af4161954 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:57.578597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e541952-bb36-4aeb-8e6d-43db7115f0cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:57.578896 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-429b3ece-4da8-480f-902c-296af4161954 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:57.579566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-429b3ece-4da8-480f-902c-296af4161954 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:57.580008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-429b3ece-4da8-480f-902c-296af4161954 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:57.580421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-429b3ece-4da8-480f-902c-296af4161954 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:57.608681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7e541952-bb36-4aeb-8e6d-43db7115f0cd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046380 Sep 01 05:23:57.609282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 644/1320] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:57 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:57.643258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-429b3ece-4da8-480f-902c-296af4161954 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:57.651036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-429b3ece-4da8-480f-902c-296af4161954 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083493 Sep 01 05:23:57.651587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 677/1321] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:57 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:58.574421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-79743b10-43d6-47ce-b9e2-7defcdf2a667 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:58.576489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-79743b10-43d6-47ce-b9e2-7defcdf2a667 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:58.583041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79743b10-43d6-47ce-b9e2-7defcdf2a667 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:58.583515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79743b10-43d6-47ce-b9e2-7defcdf2a667 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:58.583947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79743b10-43d6-47ce-b9e2-7defcdf2a667 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:58.585541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79743b10-43d6-47ce-b9e2-7defcdf2a667 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:58.586034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79743b10-43d6-47ce-b9e2-7defcdf2a667 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:58.586459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-79743b10-43d6-47ce-b9e2-7defcdf2a667 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:58.615177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-79743b10-43d6-47ce-b9e2-7defcdf2a667 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044961 Sep 01 05:23:58.615913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 645/1322] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:58.621184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ed829859-ed8f-4d08-97f7-84e6780eb01a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:58.623344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ed829859-ed8f-4d08-97f7-84e6780eb01a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:58.629637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed829859-ed8f-4d08-97f7-84e6780eb01a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:58.630110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed829859-ed8f-4d08-97f7-84e6780eb01a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:58.630543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed829859-ed8f-4d08-97f7-84e6780eb01a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:58.631721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed829859-ed8f-4d08-97f7-84e6780eb01a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:58.632189 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed829859-ed8f-4d08-97f7-84e6780eb01a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:58.632813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed829859-ed8f-4d08-97f7-84e6780eb01a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:58.662250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ed829859-ed8f-4d08-97f7-84e6780eb01a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Sep 01 05:23:58.662868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 678/1323] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:58 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:58.671307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-04ea567c-3c8e-4177-a636-664cb3124136 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:58.671927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-04ea567c-3c8e-4177-a636-664cb3124136 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:58.677854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ea567c-3c8e-4177-a636-664cb3124136 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:58.678410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ea567c-3c8e-4177-a636-664cb3124136 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:58.678887 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ea567c-3c8e-4177-a636-664cb3124136 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:58.679572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ea567c-3c8e-4177-a636-664cb3124136 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:58.680026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ea567c-3c8e-4177-a636-664cb3124136 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:58.680453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ea567c-3c8e-4177-a636-664cb3124136 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:58.742898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-04ea567c-3c8e-4177-a636-664cb3124136 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:58.750583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-04ea567c-3c8e-4177-a636-664cb3124136 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083141 Sep 01 05:23:58.751144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 646/1324] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:58 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:59.628322 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-86839b6b-2ad3-4d35-a2a2-6759a6004892 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:59.630516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-86839b6b-2ad3-4d35-a2a2-6759a6004892 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:59.637953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86839b6b-2ad3-4d35-a2a2-6759a6004892 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:59.638452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86839b6b-2ad3-4d35-a2a2-6759a6004892 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:59.638888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86839b6b-2ad3-4d35-a2a2-6759a6004892 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:59.639571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86839b6b-2ad3-4d35-a2a2-6759a6004892 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:59.640018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86839b6b-2ad3-4d35-a2a2-6759a6004892 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:59.640442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86839b6b-2ad3-4d35-a2a2-6759a6004892 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:59.644164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:59.671019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-86839b6b-2ad3-4d35-a2a2-6759a6004892 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046663 Sep 01 05:23:59.671574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 679/1325] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:59 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:59.674381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b1339377-3991-4fd6-8b4c-f8134e86374c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:59.676574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b1339377-3991-4fd6-8b4c-f8134e86374c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:59.683476 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1339377-3991-4fd6-8b4c-f8134e86374c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:59.683947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1339377-3991-4fd6-8b4c-f8134e86374c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:59.684373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1339377-3991-4fd6-8b4c-f8134e86374c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:59.685084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1339377-3991-4fd6-8b4c-f8134e86374c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:59.685529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1339377-3991-4fd6-8b4c-f8134e86374c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:59.685945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1339377-3991-4fd6-8b4c-f8134e86374c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:59.715817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b1339377-3991-4fd6-8b4c-f8134e86374c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045334 Sep 01 05:23:59.716357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 647/1326] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:23:59 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:59.771573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a8969c72-b50f-4d8c-a961-c79c1a3f2eb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:59.772255 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a8969c72-b50f-4d8c-a961-c79c1a3f2eb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:59.778313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a8969c72-b50f-4d8c-a961-c79c1a3f2eb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:59.778789 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a8969c72-b50f-4d8c-a961-c79c1a3f2eb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:59.779220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a8969c72-b50f-4d8c-a961-c79c1a3f2eb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:59.779895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a8969c72-b50f-4d8c-a961-c79c1a3f2eb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:59.780339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a8969c72-b50f-4d8c-a961-c79c1a3f2eb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:59.780757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a8969c72-b50f-4d8c-a961-c79c1a3f2eb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:59.840579 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a8969c72-b50f-4d8c-a961-c79c1a3f2eb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:59.848206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a8969c72-b50f-4d8c-a961-c79c1a3f2eb2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.080467 Sep 01 05:23:59.848765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 680/1327] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:59 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:00.683425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8a35adec-9411-4041-b0b1-860ff662b05b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:00.685651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8a35adec-9411-4041-b0b1-860ff662b05b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:00.692313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a35adec-9411-4041-b0b1-860ff662b05b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:00.692805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a35adec-9411-4041-b0b1-860ff662b05b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:00.693249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a35adec-9411-4041-b0b1-860ff662b05b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:00.693924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a35adec-9411-4041-b0b1-860ff662b05b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:00.694372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a35adec-9411-4041-b0b1-860ff662b05b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:00.694788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a35adec-9411-4041-b0b1-860ff662b05b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:00.724305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8a35adec-9411-4041-b0b1-860ff662b05b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044909 Sep 01 05:24:00.725079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 648/1328] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:00 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:00.730294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-472fbc4a-d6fc-461a-9641-3b8e49c061c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:00.732423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-472fbc4a-d6fc-461a-9641-3b8e49c061c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:00.740523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-472fbc4a-d6fc-461a-9641-3b8e49c061c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:00.741035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-472fbc4a-d6fc-461a-9641-3b8e49c061c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:00.741467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-472fbc4a-d6fc-461a-9641-3b8e49c061c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:00.742966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-472fbc4a-d6fc-461a-9641-3b8e49c061c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:00.743412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-472fbc4a-d6fc-461a-9641-3b8e49c061c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:00.743827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-472fbc4a-d6fc-461a-9641-3b8e49c061c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:00.773350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-472fbc4a-d6fc-461a-9641-3b8e49c061c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048501 Sep 01 05:24:00.774673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 681/1329] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:00.868708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e6eafbdf-2f86-4d28-a9fe-92ea9702a86e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:00.869351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e6eafbdf-2f86-4d28-a9fe-92ea9702a86e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:00.875324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6eafbdf-2f86-4d28-a9fe-92ea9702a86e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:00.875800 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6eafbdf-2f86-4d28-a9fe-92ea9702a86e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:00.876231 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6eafbdf-2f86-4d28-a9fe-92ea9702a86e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:00.876937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6eafbdf-2f86-4d28-a9fe-92ea9702a86e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:00.877388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6eafbdf-2f86-4d28-a9fe-92ea9702a86e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:00.877804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6eafbdf-2f86-4d28-a9fe-92ea9702a86e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:00.942984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e6eafbdf-2f86-4d28-a9fe-92ea9702a86e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:00.951127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e6eafbdf-2f86-4d28-a9fe-92ea9702a86e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086583 Sep 01 05:24:00.951688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 649/1330] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:00 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:01.737384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5be7a0ba-4ffe-4aa1-8e38-ca5a558701b4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:01.739493 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5be7a0ba-4ffe-4aa1-8e38-ca5a558701b4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:01.746556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5be7a0ba-4ffe-4aa1-8e38-ca5a558701b4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:01.747024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5be7a0ba-4ffe-4aa1-8e38-ca5a558701b4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:01.747450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5be7a0ba-4ffe-4aa1-8e38-ca5a558701b4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:01.748127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5be7a0ba-4ffe-4aa1-8e38-ca5a558701b4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:01.748570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5be7a0ba-4ffe-4aa1-8e38-ca5a558701b4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:01.749007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5be7a0ba-4ffe-4aa1-8e38-ca5a558701b4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:01.779085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5be7a0ba-4ffe-4aa1-8e38-ca5a558701b4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045647 Sep 01 05:24:01.779662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 682/1331] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:01.786366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a77e6361-025a-4507-8c6c-b17745174665 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:01.788514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a77e6361-025a-4507-8c6c-b17745174665 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:01.795028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a77e6361-025a-4507-8c6c-b17745174665 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:01.795505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a77e6361-025a-4507-8c6c-b17745174665 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:01.795934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a77e6361-025a-4507-8c6c-b17745174665 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:01.796616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a77e6361-025a-4507-8c6c-b17745174665 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:01.797095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a77e6361-025a-4507-8c6c-b17745174665 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:01.797518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a77e6361-025a-4507-8c6c-b17745174665 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:01.827788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a77e6361-025a-4507-8c6c-b17745174665 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Sep 01 05:24:01.828339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 650/1332] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:01 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:01.971346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b79b1924-40f0-4f0c-8277-65cbcca02ee2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:01.971950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b79b1924-40f0-4f0c-8277-65cbcca02ee2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:01.977956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b79b1924-40f0-4f0c-8277-65cbcca02ee2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:01.978517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b79b1924-40f0-4f0c-8277-65cbcca02ee2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:01.978954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b79b1924-40f0-4f0c-8277-65cbcca02ee2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:01.979626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b79b1924-40f0-4f0c-8277-65cbcca02ee2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:01.980071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b79b1924-40f0-4f0c-8277-65cbcca02ee2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:01.980484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b79b1924-40f0-4f0c-8277-65cbcca02ee2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:02.043338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b79b1924-40f0-4f0c-8277-65cbcca02ee2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:02.051007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b79b1924-40f0-4f0c-8277-65cbcca02ee2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083477 Sep 01 05:24:02.051568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 683/1333] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:01 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:02.791949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0ea5b8b0-847f-4fa1-8574-e2c97889137e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:02.794155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0ea5b8b0-847f-4fa1-8574-e2c97889137e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:02.800545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ea5b8b0-847f-4fa1-8574-e2c97889137e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:02.801048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ea5b8b0-847f-4fa1-8574-e2c97889137e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:02.801475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ea5b8b0-847f-4fa1-8574-e2c97889137e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:02.802147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ea5b8b0-847f-4fa1-8574-e2c97889137e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:02.802586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ea5b8b0-847f-4fa1-8574-e2c97889137e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:02.802999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ea5b8b0-847f-4fa1-8574-e2c97889137e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:02.832229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0ea5b8b0-847f-4fa1-8574-e2c97889137e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044882 Sep 01 05:24:02.833053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 651/1334] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:02.840063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d23af063-a16a-4409-be54-57fde27e7ddd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:02.842233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d23af063-a16a-4409-be54-57fde27e7ddd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:02.848580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d23af063-a16a-4409-be54-57fde27e7ddd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:02.849094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d23af063-a16a-4409-be54-57fde27e7ddd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:02.849536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d23af063-a16a-4409-be54-57fde27e7ddd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:02.850221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d23af063-a16a-4409-be54-57fde27e7ddd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:02.850677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d23af063-a16a-4409-be54-57fde27e7ddd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:02.851103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d23af063-a16a-4409-be54-57fde27e7ddd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:02.880512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d23af063-a16a-4409-be54-57fde27e7ddd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Sep 01 05:24:02.881087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 684/1335] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:02 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:03.073160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5d337e4b-7fdb-4772-909e-2890aa52b677 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:03.073700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5d337e4b-7fdb-4772-909e-2890aa52b677 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:03.079684 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d337e4b-7fdb-4772-909e-2890aa52b677 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:03.080158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d337e4b-7fdb-4772-909e-2890aa52b677 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:03.080587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d337e4b-7fdb-4772-909e-2890aa52b677 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:03.081290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d337e4b-7fdb-4772-909e-2890aa52b677 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:03.081740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d337e4b-7fdb-4772-909e-2890aa52b677 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:03.082168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d337e4b-7fdb-4772-909e-2890aa52b677 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:03.143676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5d337e4b-7fdb-4772-909e-2890aa52b677 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:03.152120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5d337e4b-7fdb-4772-909e-2890aa52b677 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084297 Sep 01 05:24:03.152673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 652/1336] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:03 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:03.844553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d59a8cba-2e6a-47fd-b400-db94d24b5999 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:03.846688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d59a8cba-2e6a-47fd-b400-db94d24b5999 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:03.853773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d59a8cba-2e6a-47fd-b400-db94d24b5999 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:03.854191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d59a8cba-2e6a-47fd-b400-db94d24b5999 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:03.854618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d59a8cba-2e6a-47fd-b400-db94d24b5999 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:03.855293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d59a8cba-2e6a-47fd-b400-db94d24b5999 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:03.855767 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d59a8cba-2e6a-47fd-b400-db94d24b5999 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:03.856187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d59a8cba-2e6a-47fd-b400-db94d24b5999 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:03.886207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d59a8cba-2e6a-47fd-b400-db94d24b5999 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045615 Sep 01 05:24:03.886758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 685/1337] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:03.892667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cfe004e8-1da0-46b2-9e1c-981b62cbc570 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:03.894909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cfe004e8-1da0-46b2-9e1c-981b62cbc570 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:03.901747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfe004e8-1da0-46b2-9e1c-981b62cbc570 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:03.902221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfe004e8-1da0-46b2-9e1c-981b62cbc570 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:03.902646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfe004e8-1da0-46b2-9e1c-981b62cbc570 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:03.903325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfe004e8-1da0-46b2-9e1c-981b62cbc570 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:03.903768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfe004e8-1da0-46b2-9e1c-981b62cbc570 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:03.904183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfe004e8-1da0-46b2-9e1c-981b62cbc570 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:03.934662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cfe004e8-1da0-46b2-9e1c-981b62cbc570 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045890 Sep 01 05:24:03.935212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 653/1338] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:03 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:04.172542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-501ab53c-704c-4426-ac8c-d21d6c39cb20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:04.173177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-501ab53c-704c-4426-ac8c-d21d6c39cb20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:04.179028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-501ab53c-704c-4426-ac8c-d21d6c39cb20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:04.179502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-501ab53c-704c-4426-ac8c-d21d6c39cb20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:04.179926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-501ab53c-704c-4426-ac8c-d21d6c39cb20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:04.180599 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-501ab53c-704c-4426-ac8c-d21d6c39cb20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:04.181099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-501ab53c-704c-4426-ac8c-d21d6c39cb20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:04.181635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-501ab53c-704c-4426-ac8c-d21d6c39cb20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:04.242397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-501ab53c-704c-4426-ac8c-d21d6c39cb20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:04.250145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-501ab53c-704c-4426-ac8c-d21d6c39cb20 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081449 Sep 01 05:24:04.250697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 686/1339] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:04 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:04.898432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e9c0288c-c87e-4af6-b04f-fbee505fa9d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:04.900763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e9c0288c-c87e-4af6-b04f-fbee505fa9d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:04.907099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9c0288c-c87e-4af6-b04f-fbee505fa9d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:04.907570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9c0288c-c87e-4af6-b04f-fbee505fa9d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:04.907996 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9c0288c-c87e-4af6-b04f-fbee505fa9d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:04.908704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9c0288c-c87e-4af6-b04f-fbee505fa9d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:04.909171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9c0288c-c87e-4af6-b04f-fbee505fa9d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:04.909588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9c0288c-c87e-4af6-b04f-fbee505fa9d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:04.939064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e9c0288c-c87e-4af6-b04f-fbee505fa9d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044666 Sep 01 05:24:04.939617 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 654/1340] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:04.947638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-be96d065-9420-460a-9fa1-1562de2b3add tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:04.949810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-be96d065-9420-460a-9fa1-1562de2b3add tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:04.956095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be96d065-9420-460a-9fa1-1562de2b3add tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:04.956571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be96d065-9420-460a-9fa1-1562de2b3add tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:04.957037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be96d065-9420-460a-9fa1-1562de2b3add tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:04.957736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be96d065-9420-460a-9fa1-1562de2b3add tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:04.958184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be96d065-9420-460a-9fa1-1562de2b3add tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:04.958604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be96d065-9420-460a-9fa1-1562de2b3add tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:04.986920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-be96d065-9420-460a-9fa1-1562de2b3add tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 Sep 01 05:24:04.987455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 687/1341] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:05.271376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4d3b122c-98d2-44b0-b647-122993e71851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:05.271911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4d3b122c-98d2-44b0-b647-122993e71851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:05.278279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d3b122c-98d2-44b0-b647-122993e71851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:05.278762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d3b122c-98d2-44b0-b647-122993e71851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:05.279197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d3b122c-98d2-44b0-b647-122993e71851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:05.279885 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d3b122c-98d2-44b0-b647-122993e71851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:05.280337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d3b122c-98d2-44b0-b647-122993e71851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:05.280759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d3b122c-98d2-44b0-b647-122993e71851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:05.343376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4d3b122c-98d2-44b0-b647-122993e71851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:05.351041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4d3b122c-98d2-44b0-b647-122993e71851 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083650 Sep 01 05:24:05.351603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 655/1342] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:05 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:05.952078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1c35c2f3-f258-4d86-b9f7-d71676ce7b34 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:05.954235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1c35c2f3-f258-4d86-b9f7-d71676ce7b34 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:05.960709 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c35c2f3-f258-4d86-b9f7-d71676ce7b34 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:05.961220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c35c2f3-f258-4d86-b9f7-d71676ce7b34 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:05.961653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c35c2f3-f258-4d86-b9f7-d71676ce7b34 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:05.963153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c35c2f3-f258-4d86-b9f7-d71676ce7b34 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:05.963814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c35c2f3-f258-4d86-b9f7-d71676ce7b34 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:05.964241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c35c2f3-f258-4d86-b9f7-d71676ce7b34 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:05.992981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1c35c2f3-f258-4d86-b9f7-d71676ce7b34 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045137 Sep 01 05:24:05.993570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 688/1343] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:05.999248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d69ba0e0-dd38-49d8-98d3-63be6a4438b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:06.001413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d69ba0e0-dd38-49d8-98d3-63be6a4438b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:06.007748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d69ba0e0-dd38-49d8-98d3-63be6a4438b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:06.008216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d69ba0e0-dd38-49d8-98d3-63be6a4438b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:06.008643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d69ba0e0-dd38-49d8-98d3-63be6a4438b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:06.009864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d69ba0e0-dd38-49d8-98d3-63be6a4438b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:06.010307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d69ba0e0-dd38-49d8-98d3-63be6a4438b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:06.010716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d69ba0e0-dd38-49d8-98d3-63be6a4438b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:06.040177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d69ba0e0-dd38-49d8-98d3-63be6a4438b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044949 Sep 01 05:24:06.040924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 656/1344] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:05 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:06.372429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-252ae193-85b3-42f0-8022-8eac9870aab5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:06.373024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-252ae193-85b3-42f0-8022-8eac9870aab5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:06.378940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-252ae193-85b3-42f0-8022-8eac9870aab5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:06.379427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-252ae193-85b3-42f0-8022-8eac9870aab5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:06.379861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-252ae193-85b3-42f0-8022-8eac9870aab5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:06.380539 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-252ae193-85b3-42f0-8022-8eac9870aab5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:06.381029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-252ae193-85b3-42f0-8022-8eac9870aab5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:06.381454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-252ae193-85b3-42f0-8022-8eac9870aab5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:06.445902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-252ae193-85b3-42f0-8022-8eac9870aab5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:06.454373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-252ae193-85b3-42f0-8022-8eac9870aab5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086418 Sep 01 05:24:06.454927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 689/1345] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:06 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:07.005481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f25e1da5-5a90-47b0-8fda-dde273efaa24 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:07.007628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f25e1da5-5a90-47b0-8fda-dde273efaa24 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:07.014055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f25e1da5-5a90-47b0-8fda-dde273efaa24 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:07.014529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f25e1da5-5a90-47b0-8fda-dde273efaa24 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:07.014967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f25e1da5-5a90-47b0-8fda-dde273efaa24 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:07.015626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f25e1da5-5a90-47b0-8fda-dde273efaa24 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:07.016068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f25e1da5-5a90-47b0-8fda-dde273efaa24 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:07.016482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f25e1da5-5a90-47b0-8fda-dde273efaa24 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:07.045538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f25e1da5-5a90-47b0-8fda-dde273efaa24 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044055 Sep 01 05:24:07.046092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 657/1346] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:07 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:07.051591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-806cd20f-88ac-433a-8282-8f8914a53872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:07.053757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-806cd20f-88ac-433a-8282-8f8914a53872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:07.060742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806cd20f-88ac-433a-8282-8f8914a53872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:07.061256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806cd20f-88ac-433a-8282-8f8914a53872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:07.061697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806cd20f-88ac-433a-8282-8f8914a53872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:07.062385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806cd20f-88ac-433a-8282-8f8914a53872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:07.062839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806cd20f-88ac-433a-8282-8f8914a53872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:07.063266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806cd20f-88ac-433a-8282-8f8914a53872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:07.093853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-806cd20f-88ac-433a-8282-8f8914a53872 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046175 Sep 01 05:24:07.094401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 690/1347] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:07 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:07.474129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-55170822-a9b5-4786-8a46-9439b987b249 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:07.474806 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-55170822-a9b5-4786-8a46-9439b987b249 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:07.481302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55170822-a9b5-4786-8a46-9439b987b249 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:07.481782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55170822-a9b5-4786-8a46-9439b987b249 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:07.482220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55170822-a9b5-4786-8a46-9439b987b249 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:07.482905 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55170822-a9b5-4786-8a46-9439b987b249 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:07.483357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55170822-a9b5-4786-8a46-9439b987b249 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:07.483781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55170822-a9b5-4786-8a46-9439b987b249 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:07.488098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:07.545368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-55170822-a9b5-4786-8a46-9439b987b249 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:07.553107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-55170822-a9b5-4786-8a46-9439b987b249 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082864 Sep 01 05:24:07.553668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 658/1348] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:07 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:08.057359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a3545cb1-3bd8-4bf1-a0e3-8dab332d011e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:08.059517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a3545cb1-3bd8-4bf1-a0e3-8dab332d011e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:08.065937 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3545cb1-3bd8-4bf1-a0e3-8dab332d011e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:08.066681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3545cb1-3bd8-4bf1-a0e3-8dab332d011e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:08.067115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3545cb1-3bd8-4bf1-a0e3-8dab332d011e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:08.067802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3545cb1-3bd8-4bf1-a0e3-8dab332d011e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:08.068250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3545cb1-3bd8-4bf1-a0e3-8dab332d011e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:08.068672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a3545cb1-3bd8-4bf1-a0e3-8dab332d011e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:08.098929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a3545cb1-3bd8-4bf1-a0e3-8dab332d011e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045922 Sep 01 05:24:08.099508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 691/1349] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:08.106826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-739a3bbb-5894-4110-a3f0-a07213173e84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:08.109028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-739a3bbb-5894-4110-a3f0-a07213173e84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:08.115007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-739a3bbb-5894-4110-a3f0-a07213173e84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:08.115489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-739a3bbb-5894-4110-a3f0-a07213173e84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:08.115922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-739a3bbb-5894-4110-a3f0-a07213173e84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:08.116611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-739a3bbb-5894-4110-a3f0-a07213173e84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:08.117105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-739a3bbb-5894-4110-a3f0-a07213173e84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:08.117528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-739a3bbb-5894-4110-a3f0-a07213173e84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:08.146981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-739a3bbb-5894-4110-a3f0-a07213173e84 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044971 Sep 01 05:24:08.147474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 659/1350] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:08 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:08.575375 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e90783d5-2765-4ae1-9975-19a30eddd1a3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:08.575888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e90783d5-2765-4ae1-9975-19a30eddd1a3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:08.581751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e90783d5-2765-4ae1-9975-19a30eddd1a3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:08.582227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e90783d5-2765-4ae1-9975-19a30eddd1a3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:08.582692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e90783d5-2765-4ae1-9975-19a30eddd1a3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:08.583442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e90783d5-2765-4ae1-9975-19a30eddd1a3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:08.583887 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e90783d5-2765-4ae1-9975-19a30eddd1a3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:08.584328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e90783d5-2765-4ae1-9975-19a30eddd1a3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:08.646938 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e90783d5-2765-4ae1-9975-19a30eddd1a3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:08.658210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e90783d5-2765-4ae1-9975-19a30eddd1a3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086808 Sep 01 05:24:08.658775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 692/1351] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:08 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:09.112268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-168ae8cf-30b1-47da-8067-b83309ea8811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:09.114489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-168ae8cf-30b1-47da-8067-b83309ea8811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:09.121492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-168ae8cf-30b1-47da-8067-b83309ea8811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:09.121969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-168ae8cf-30b1-47da-8067-b83309ea8811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:09.122396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-168ae8cf-30b1-47da-8067-b83309ea8811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:09.123145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-168ae8cf-30b1-47da-8067-b83309ea8811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:09.123589 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-168ae8cf-30b1-47da-8067-b83309ea8811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:09.124005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-168ae8cf-30b1-47da-8067-b83309ea8811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:09.154605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-168ae8cf-30b1-47da-8067-b83309ea8811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046196 Sep 01 05:24:09.155091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 660/1352] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:09 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:09.159578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-672950c6-d566-4005-a1dd-ae2e4c68981d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:09.162161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-672950c6-d566-4005-a1dd-ae2e4c68981d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:09.169445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-672950c6-d566-4005-a1dd-ae2e4c68981d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:09.169924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-672950c6-d566-4005-a1dd-ae2e4c68981d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:09.170352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-672950c6-d566-4005-a1dd-ae2e4c68981d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:09.171031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-672950c6-d566-4005-a1dd-ae2e4c68981d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:09.171503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-672950c6-d566-4005-a1dd-ae2e4c68981d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:09.171948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-672950c6-d566-4005-a1dd-ae2e4c68981d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:09.201538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-672950c6-d566-4005-a1dd-ae2e4c68981d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045916 Sep 01 05:24:09.202085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 693/1353] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:09 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:09.679192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c4c62ec7-5a6d-4060-8893-0406277a22c1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:09.679799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c4c62ec7-5a6d-4060-8893-0406277a22c1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:09.685847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4c62ec7-5a6d-4060-8893-0406277a22c1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:09.686318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4c62ec7-5a6d-4060-8893-0406277a22c1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:09.686742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4c62ec7-5a6d-4060-8893-0406277a22c1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:09.687412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4c62ec7-5a6d-4060-8893-0406277a22c1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:09.687859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4c62ec7-5a6d-4060-8893-0406277a22c1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:09.688273 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4c62ec7-5a6d-4060-8893-0406277a22c1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:09.751801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c4c62ec7-5a6d-4060-8893-0406277a22c1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:09.759396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c4c62ec7-5a6d-4060-8893-0406277a22c1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083992 Sep 01 05:24:09.759958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 661/1354] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:09 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:10.168010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-93bae5b1-25be-4a6c-8034-a9e1674611ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:10.170096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-93bae5b1-25be-4a6c-8034-a9e1674611ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:10.176568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93bae5b1-25be-4a6c-8034-a9e1674611ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:10.177109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93bae5b1-25be-4a6c-8034-a9e1674611ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:10.177545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93bae5b1-25be-4a6c-8034-a9e1674611ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:10.178221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93bae5b1-25be-4a6c-8034-a9e1674611ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:10.178668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93bae5b1-25be-4a6c-8034-a9e1674611ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:10.179090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-93bae5b1-25be-4a6c-8034-a9e1674611ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:10.208478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-93bae5b1-25be-4a6c-8034-a9e1674611ec tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045514 Sep 01 05:24:10.209223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 694/1355] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:10 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:10.214201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7f917a62-f220-46e5-b057-501569b27fc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:10.216395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7f917a62-f220-46e5-b057-501569b27fc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:10.222894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f917a62-f220-46e5-b057-501569b27fc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:10.223384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f917a62-f220-46e5-b057-501569b27fc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:10.223861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f917a62-f220-46e5-b057-501569b27fc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:10.224556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f917a62-f220-46e5-b057-501569b27fc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:10.225042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f917a62-f220-46e5-b057-501569b27fc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:10.225467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f917a62-f220-46e5-b057-501569b27fc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:10.257561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7f917a62-f220-46e5-b057-501569b27fc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047961 Sep 01 05:24:10.258128 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 662/1356] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:10.780070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2a051fb8-391a-4b15-8654-25e198c7a4f7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:10.780686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2a051fb8-391a-4b15-8654-25e198c7a4f7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:10.786580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2a051fb8-391a-4b15-8654-25e198c7a4f7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:10.787059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2a051fb8-391a-4b15-8654-25e198c7a4f7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:10.787493 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2a051fb8-391a-4b15-8654-25e198c7a4f7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:10.788169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2a051fb8-391a-4b15-8654-25e198c7a4f7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:10.788619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2a051fb8-391a-4b15-8654-25e198c7a4f7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:10.789066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2a051fb8-391a-4b15-8654-25e198c7a4f7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:10.850362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2a051fb8-391a-4b15-8654-25e198c7a4f7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:10.852481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:10.859285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2a051fb8-391a-4b15-8654-25e198c7a4f7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084134 Sep 01 05:24:10.859843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 695/1357] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:10 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:11.221627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-450c33d1-5eb4-4e4a-b8de-cdd1bda7bb38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:11.224354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-450c33d1-5eb4-4e4a-b8de-cdd1bda7bb38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:11.232121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-450c33d1-5eb4-4e4a-b8de-cdd1bda7bb38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:11.232592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-450c33d1-5eb4-4e4a-b8de-cdd1bda7bb38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:11.233057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-450c33d1-5eb4-4e4a-b8de-cdd1bda7bb38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:11.233740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-450c33d1-5eb4-4e4a-b8de-cdd1bda7bb38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:11.234179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-450c33d1-5eb4-4e4a-b8de-cdd1bda7bb38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:11.234592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-450c33d1-5eb4-4e4a-b8de-cdd1bda7bb38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:11.264093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-450c33d1-5eb4-4e4a-b8de-cdd1bda7bb38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046453 Sep 01 05:24:11.264651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 663/1358] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:11.270206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b09ee247-7a27-46c8-a234-74d7a17dd336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:11.272344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b09ee247-7a27-46c8-a234-74d7a17dd336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:11.278725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b09ee247-7a27-46c8-a234-74d7a17dd336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:11.279205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b09ee247-7a27-46c8-a234-74d7a17dd336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:11.279640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b09ee247-7a27-46c8-a234-74d7a17dd336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:11.280326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b09ee247-7a27-46c8-a234-74d7a17dd336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:11.280798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b09ee247-7a27-46c8-a234-74d7a17dd336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:11.281231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b09ee247-7a27-46c8-a234-74d7a17dd336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:11.311616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b09ee247-7a27-46c8-a234-74d7a17dd336 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Sep 01 05:24:11.312173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 696/1359] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:11 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:11.880639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cdd93c3e-ce02-48b6-95b4-03ddc279c2ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:11.881293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cdd93c3e-ce02-48b6-95b4-03ddc279c2ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:11.887356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdd93c3e-ce02-48b6-95b4-03ddc279c2ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:11.887827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdd93c3e-ce02-48b6-95b4-03ddc279c2ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:11.888275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdd93c3e-ce02-48b6-95b4-03ddc279c2ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:11.888999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdd93c3e-ce02-48b6-95b4-03ddc279c2ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:11.889451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdd93c3e-ce02-48b6-95b4-03ddc279c2ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:11.889870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdd93c3e-ce02-48b6-95b4-03ddc279c2ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:11.951414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cdd93c3e-ce02-48b6-95b4-03ddc279c2ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:11.959088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cdd93c3e-ce02-48b6-95b4-03ddc279c2ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082301 Sep 01 05:24:11.959647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 664/1360] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:11 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:12.276284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1ba5d6d0-d646-41cd-bf01-360ac10fd29c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:12.278451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1ba5d6d0-d646-41cd-bf01-360ac10fd29c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:12.284877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba5d6d0-d646-41cd-bf01-360ac10fd29c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:12.285359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba5d6d0-d646-41cd-bf01-360ac10fd29c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:12.285794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba5d6d0-d646-41cd-bf01-360ac10fd29c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:12.286480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba5d6d0-d646-41cd-bf01-360ac10fd29c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:12.286932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba5d6d0-d646-41cd-bf01-360ac10fd29c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:12.287356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ba5d6d0-d646-41cd-bf01-360ac10fd29c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:12.317702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1ba5d6d0-d646-41cd-bf01-360ac10fd29c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046097 Sep 01 05:24:12.318437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 697/1361] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:12 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:12.324524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-16613bba-50b3-408a-a8ff-84f85de57edd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:12.326678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-16613bba-50b3-408a-a8ff-84f85de57edd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:12.333019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16613bba-50b3-408a-a8ff-84f85de57edd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:12.333492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16613bba-50b3-408a-a8ff-84f85de57edd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:12.333922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16613bba-50b3-408a-a8ff-84f85de57edd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:12.334594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16613bba-50b3-408a-a8ff-84f85de57edd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:12.335039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16613bba-50b3-408a-a8ff-84f85de57edd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:12.335453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16613bba-50b3-408a-a8ff-84f85de57edd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:12.365177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-16613bba-50b3-408a-a8ff-84f85de57edd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045209 Sep 01 05:24:12.365727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 665/1362] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:12 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:12.981072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2bd7d669-71c8-4b4f-8f25-e769c6f0885a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:12.981685 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2bd7d669-71c8-4b4f-8f25-e769c6f0885a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:12.987739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2bd7d669-71c8-4b4f-8f25-e769c6f0885a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:12.988221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2bd7d669-71c8-4b4f-8f25-e769c6f0885a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:12.988653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2bd7d669-71c8-4b4f-8f25-e769c6f0885a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:12.989364 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2bd7d669-71c8-4b4f-8f25-e769c6f0885a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:12.989816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2bd7d669-71c8-4b4f-8f25-e769c6f0885a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:12.990236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2bd7d669-71c8-4b4f-8f25-e769c6f0885a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:13.050622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2bd7d669-71c8-4b4f-8f25-e769c6f0885a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:13.059055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2bd7d669-71c8-4b4f-8f25-e769c6f0885a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082656 Sep 01 05:24:13.059654 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 698/1363] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:12 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:13.330251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0ab20411-b940-4d12-a34e-17c12fb32796 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:13.332293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0ab20411-b940-4d12-a34e-17c12fb32796 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:13.339331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ab20411-b940-4d12-a34e-17c12fb32796 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:13.339796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ab20411-b940-4d12-a34e-17c12fb32796 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:13.340698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ab20411-b940-4d12-a34e-17c12fb32796 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:13.341397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ab20411-b940-4d12-a34e-17c12fb32796 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:13.341847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ab20411-b940-4d12-a34e-17c12fb32796 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:13.342260 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ab20411-b940-4d12-a34e-17c12fb32796 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:13.371369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0ab20411-b940-4d12-a34e-17c12fb32796 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045163 Sep 01 05:24:13.371915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 666/1364] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:13 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:13.378085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f34fee43-f894-4a96-8b33-85908f6d53e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:13.380252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f34fee43-f894-4a96-8b33-85908f6d53e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:13.386563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f34fee43-f894-4a96-8b33-85908f6d53e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:13.387043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f34fee43-f894-4a96-8b33-85908f6d53e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:13.387478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f34fee43-f894-4a96-8b33-85908f6d53e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:13.388156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f34fee43-f894-4a96-8b33-85908f6d53e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:13.388606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f34fee43-f894-4a96-8b33-85908f6d53e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:13.389066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f34fee43-f894-4a96-8b33-85908f6d53e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:13.419109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f34fee43-f894-4a96-8b33-85908f6d53e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044983 Sep 01 05:24:13.419659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 699/1365] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:14.079808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e03eecc9-b5d8-4c1c-8a1d-a9a5b1c47de6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:14.080418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e03eecc9-b5d8-4c1c-8a1d-a9a5b1c47de6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:14.086397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e03eecc9-b5d8-4c1c-8a1d-a9a5b1c47de6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:14.086880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e03eecc9-b5d8-4c1c-8a1d-a9a5b1c47de6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:14.087321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e03eecc9-b5d8-4c1c-8a1d-a9a5b1c47de6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:14.088652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e03eecc9-b5d8-4c1c-8a1d-a9a5b1c47de6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:14.089144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e03eecc9-b5d8-4c1c-8a1d-a9a5b1c47de6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:14.089571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e03eecc9-b5d8-4c1c-8a1d-a9a5b1c47de6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:14.149775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e03eecc9-b5d8-4c1c-8a1d-a9a5b1c47de6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:14.158297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e03eecc9-b5d8-4c1c-8a1d-a9a5b1c47de6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082399 Sep 01 05:24:14.158857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 667/1366] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:14 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:14.383645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9dd7d9fc-f405-48a9-99a7-2be2288c09df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:14.386481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9dd7d9fc-f405-48a9-99a7-2be2288c09df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:14.392826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9dd7d9fc-f405-48a9-99a7-2be2288c09df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:14.393400 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9dd7d9fc-f405-48a9-99a7-2be2288c09df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:14.393748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9dd7d9fc-f405-48a9-99a7-2be2288c09df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:14.394476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9dd7d9fc-f405-48a9-99a7-2be2288c09df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:14.394931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9dd7d9fc-f405-48a9-99a7-2be2288c09df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:14.395354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9dd7d9fc-f405-48a9-99a7-2be2288c09df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:14.426761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9dd7d9fc-f405-48a9-99a7-2be2288c09df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047011 Sep 01 05:24:14.427387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 700/1367] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:14.431979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cb06d77a-8d00-471e-b70c-87f395274ea0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:14.434198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cb06d77a-8d00-471e-b70c-87f395274ea0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:14.440625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb06d77a-8d00-471e-b70c-87f395274ea0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:14.441169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb06d77a-8d00-471e-b70c-87f395274ea0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:14.441833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb06d77a-8d00-471e-b70c-87f395274ea0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:14.442517 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb06d77a-8d00-471e-b70c-87f395274ea0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:14.443004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb06d77a-8d00-471e-b70c-87f395274ea0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:14.443424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb06d77a-8d00-471e-b70c-87f395274ea0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:14.475090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cb06d77a-8d00-471e-b70c-87f395274ea0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047914 Sep 01 05:24:14.476150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 668/1368] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:14 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:15.179773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-594379fe-242d-47c1-9531-9fd31a992e35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:15.180346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-594379fe-242d-47c1-9531-9fd31a992e35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:15.186276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-594379fe-242d-47c1-9531-9fd31a992e35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:15.186758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-594379fe-242d-47c1-9531-9fd31a992e35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:15.187195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-594379fe-242d-47c1-9531-9fd31a992e35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:15.187875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-594379fe-242d-47c1-9531-9fd31a992e35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:15.188324 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-594379fe-242d-47c1-9531-9fd31a992e35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:15.188746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-594379fe-242d-47c1-9531-9fd31a992e35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:15.253286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-594379fe-242d-47c1-9531-9fd31a992e35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:15.261532 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-594379fe-242d-47c1-9531-9fd31a992e35 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085703 Sep 01 05:24:15.262096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 701/1369] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:15 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:15.439198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-93c96e28-acfb-4595-bacd-7eeea98b735e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:15.441325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-93c96e28-acfb-4595-bacd-7eeea98b735e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:15.448904 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-93c96e28-acfb-4595-bacd-7eeea98b735e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:15.449386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-93c96e28-acfb-4595-bacd-7eeea98b735e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:15.449821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-93c96e28-acfb-4595-bacd-7eeea98b735e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:15.450515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-93c96e28-acfb-4595-bacd-7eeea98b735e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:15.450963 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-93c96e28-acfb-4595-bacd-7eeea98b735e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:15.451381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-93c96e28-acfb-4595-bacd-7eeea98b735e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:15.480416 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-93c96e28-acfb-4595-bacd-7eeea98b735e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045294 Sep 01 05:24:15.481089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 669/1370] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:15.487687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6fb5977d-78a8-4b7e-bafd-8907fc008dbb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:15.489901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6fb5977d-78a8-4b7e-bafd-8907fc008dbb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:15.496730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6fb5977d-78a8-4b7e-bafd-8907fc008dbb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:15.497240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6fb5977d-78a8-4b7e-bafd-8907fc008dbb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:15.497675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6fb5977d-78a8-4b7e-bafd-8907fc008dbb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:15.498359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6fb5977d-78a8-4b7e-bafd-8907fc008dbb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:15.498811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6fb5977d-78a8-4b7e-bafd-8907fc008dbb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:15.499233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6fb5977d-78a8-4b7e-bafd-8907fc008dbb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:15.528682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6fb5977d-78a8-4b7e-bafd-8907fc008dbb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044998 Sep 01 05:24:15.529262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 702/1371] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:16.282140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-72504fc3-85f7-4970-b83f-e53430ec1d94 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:16.282672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-72504fc3-85f7-4970-b83f-e53430ec1d94 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:16.288655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72504fc3-85f7-4970-b83f-e53430ec1d94 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:16.289166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72504fc3-85f7-4970-b83f-e53430ec1d94 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:16.289606 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72504fc3-85f7-4970-b83f-e53430ec1d94 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:16.290290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72504fc3-85f7-4970-b83f-e53430ec1d94 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:16.291451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72504fc3-85f7-4970-b83f-e53430ec1d94 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:16.291900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72504fc3-85f7-4970-b83f-e53430ec1d94 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:16.353038 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72504fc3-85f7-4970-b83f-e53430ec1d94 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:16.361232 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-72504fc3-85f7-4970-b83f-e53430ec1d94 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083008 Sep 01 05:24:16.361862 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 670/1372] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:16 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:16.492725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-36115c04-d5fe-417d-9495-60ec028ee3e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:16.494921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-36115c04-d5fe-417d-9495-60ec028ee3e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:16.501325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-36115c04-d5fe-417d-9495-60ec028ee3e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:16.501796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-36115c04-d5fe-417d-9495-60ec028ee3e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:16.502220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-36115c04-d5fe-417d-9495-60ec028ee3e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:16.502891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-36115c04-d5fe-417d-9495-60ec028ee3e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:16.503328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-36115c04-d5fe-417d-9495-60ec028ee3e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:16.503737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-36115c04-d5fe-417d-9495-60ec028ee3e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:16.533452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-36115c04-d5fe-417d-9495-60ec028ee3e3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044579 Sep 01 05:24:16.534248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 703/1373] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:16 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:16.540272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-af51dd85-c9e0-490a-ac0f-034359b5b66b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:16.542447 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-af51dd85-c9e0-490a-ac0f-034359b5b66b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:16.548681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af51dd85-c9e0-490a-ac0f-034359b5b66b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:16.549185 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af51dd85-c9e0-490a-ac0f-034359b5b66b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:16.549610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af51dd85-c9e0-490a-ac0f-034359b5b66b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:16.550289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af51dd85-c9e0-490a-ac0f-034359b5b66b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:16.550734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af51dd85-c9e0-490a-ac0f-034359b5b66b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:16.551147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af51dd85-c9e0-490a-ac0f-034359b5b66b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:16.582794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-af51dd85-c9e0-490a-ac0f-034359b5b66b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046414 Sep 01 05:24:16.583346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 671/1374] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:16 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:17.381903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-559b0449-b84f-4bd9-b305-5e2fd4c00775 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:17.382517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-559b0449-b84f-4bd9-b305-5e2fd4c00775 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:17.388621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-559b0449-b84f-4bd9-b305-5e2fd4c00775 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:17.389129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-559b0449-b84f-4bd9-b305-5e2fd4c00775 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:17.389565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-559b0449-b84f-4bd9-b305-5e2fd4c00775 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:17.390242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-559b0449-b84f-4bd9-b305-5e2fd4c00775 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:17.390692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-559b0449-b84f-4bd9-b305-5e2fd4c00775 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:17.391115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-559b0449-b84f-4bd9-b305-5e2fd4c00775 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:17.451784 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-559b0449-b84f-4bd9-b305-5e2fd4c00775 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:17.459398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-559b0449-b84f-4bd9-b305-5e2fd4c00775 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081395 Sep 01 05:24:17.459952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 704/1375] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:17 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:17.546092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d38aa64f-4ba7-4325-8350-857cd385a290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:17.548281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d38aa64f-4ba7-4325-8350-857cd385a290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:17.554610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d38aa64f-4ba7-4325-8350-857cd385a290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:17.555082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d38aa64f-4ba7-4325-8350-857cd385a290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:17.555506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d38aa64f-4ba7-4325-8350-857cd385a290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:17.556176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d38aa64f-4ba7-4325-8350-857cd385a290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:17.557248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d38aa64f-4ba7-4325-8350-857cd385a290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:17.557859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d38aa64f-4ba7-4325-8350-857cd385a290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:17.586634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d38aa64f-4ba7-4325-8350-857cd385a290 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044455 Sep 01 05:24:17.587171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 672/1376] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:17 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:17.595246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-97957599-09b1-487d-8879-a3b206a6b8ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:17.597471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-97957599-09b1-487d-8879-a3b206a6b8ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:17.604453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97957599-09b1-487d-8879-a3b206a6b8ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:17.604982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97957599-09b1-487d-8879-a3b206a6b8ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:17.605416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97957599-09b1-487d-8879-a3b206a6b8ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:17.606100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97957599-09b1-487d-8879-a3b206a6b8ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:17.606549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97957599-09b1-487d-8879-a3b206a6b8ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:17.606970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97957599-09b1-487d-8879-a3b206a6b8ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:17.636249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-97957599-09b1-487d-8879-a3b206a6b8ab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044871 Sep 01 05:24:17.636734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 705/1377] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:17 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:18.480058 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e87d2644-9c0f-40fc-8dcf-85f1db1b66dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:18.480698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e87d2644-9c0f-40fc-8dcf-85f1db1b66dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:18.482577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=86 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:18.487727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e87d2644-9c0f-40fc-8dcf-85f1db1b66dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:18.488213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e87d2644-9c0f-40fc-8dcf-85f1db1b66dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:18.488646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e87d2644-9c0f-40fc-8dcf-85f1db1b66dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:18.489373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e87d2644-9c0f-40fc-8dcf-85f1db1b66dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:18.489824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e87d2644-9c0f-40fc-8dcf-85f1db1b66dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:18.490248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e87d2644-9c0f-40fc-8dcf-85f1db1b66dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:18.553822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e87d2644-9c0f-40fc-8dcf-85f1db1b66dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:18.562218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e87d2644-9c0f-40fc-8dcf-85f1db1b66dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086266 Sep 01 05:24:18.562783 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 673/1378] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:18 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:18.599339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-eca69eaf-2f4b-4439-9081-ac96be4b44db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:18.601505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-eca69eaf-2f4b-4439-9081-ac96be4b44db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:18.607853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eca69eaf-2f4b-4439-9081-ac96be4b44db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:18.608328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eca69eaf-2f4b-4439-9081-ac96be4b44db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:18.608756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eca69eaf-2f4b-4439-9081-ac96be4b44db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:18.609457 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eca69eaf-2f4b-4439-9081-ac96be4b44db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:18.609897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eca69eaf-2f4b-4439-9081-ac96be4b44db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:18.610309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eca69eaf-2f4b-4439-9081-ac96be4b44db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:18.639830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-eca69eaf-2f4b-4439-9081-ac96be4b44db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044481 Sep 01 05:24:18.640369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 706/1379] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:18 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:18.647471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-48024841-0aa5-4b26-96de-9c37eb7a9b20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:18.649677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-48024841-0aa5-4b26-96de-9c37eb7a9b20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:18.655632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48024841-0aa5-4b26-96de-9c37eb7a9b20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:18.656117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48024841-0aa5-4b26-96de-9c37eb7a9b20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:18.656554 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48024841-0aa5-4b26-96de-9c37eb7a9b20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:18.657271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48024841-0aa5-4b26-96de-9c37eb7a9b20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:18.657728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48024841-0aa5-4b26-96de-9c37eb7a9b20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:18.658153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48024841-0aa5-4b26-96de-9c37eb7a9b20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:18.683542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:18.688659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-48024841-0aa5-4b26-96de-9c37eb7a9b20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045126 Sep 01 05:24:18.689244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 674/1380] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:18 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:19.583495 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7b0b527c-02e7-45e5-9c4b-2c3fc4f65f7c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:19.584100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7b0b527c-02e7-45e5-9c4b-2c3fc4f65f7c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:19.590155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b0b527c-02e7-45e5-9c4b-2c3fc4f65f7c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:19.590629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b0b527c-02e7-45e5-9c4b-2c3fc4f65f7c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:19.591052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b0b527c-02e7-45e5-9c4b-2c3fc4f65f7c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:19.591750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b0b527c-02e7-45e5-9c4b-2c3fc4f65f7c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:19.592194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b0b527c-02e7-45e5-9c4b-2c3fc4f65f7c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:19.592614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b0b527c-02e7-45e5-9c4b-2c3fc4f65f7c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:19.651657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e289d2e7-bb54-47b5-ba93-22c78776c336 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:19.652882 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7b0b527c-02e7-45e5-9c4b-2c3fc4f65f7c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:19.653878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e289d2e7-bb54-47b5-ba93-22c78776c336 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:19.660278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e289d2e7-bb54-47b5-ba93-22c78776c336 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:19.660697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7b0b527c-02e7-45e5-9c4b-2c3fc4f65f7c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081106 Sep 01 05:24:19.660847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e289d2e7-bb54-47b5-ba93-22c78776c336 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:19.661202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e289d2e7-bb54-47b5-ba93-22c78776c336 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:19.661582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 707/1381] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:19 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:19.662014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e289d2e7-bb54-47b5-ba93-22c78776c336 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:19.662468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e289d2e7-bb54-47b5-ba93-22c78776c336 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:19.662884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e289d2e7-bb54-47b5-ba93-22c78776c336 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:19.693102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e289d2e7-bb54-47b5-ba93-22c78776c336 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045469 Sep 01 05:24:19.693647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 675/1382] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:19 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:19.701089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-73d9271c-9dc3-42b5-bc3e-1999fa4f7e56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:19.703252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-73d9271c-9dc3-42b5-bc3e-1999fa4f7e56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:19.709122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-73d9271c-9dc3-42b5-bc3e-1999fa4f7e56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:19.709598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-73d9271c-9dc3-42b5-bc3e-1999fa4f7e56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:19.710025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-73d9271c-9dc3-42b5-bc3e-1999fa4f7e56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:19.710702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-73d9271c-9dc3-42b5-bc3e-1999fa4f7e56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:19.711149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-73d9271c-9dc3-42b5-bc3e-1999fa4f7e56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:19.711569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-73d9271c-9dc3-42b5-bc3e-1999fa4f7e56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:19.741312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-73d9271c-9dc3-42b5-bc3e-1999fa4f7e56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044305 Sep 01 05:24:19.741848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 708/1383] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:19 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:20.683076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9391f5bd-6d53-4fb6-b788-93b1b7e00fc1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:20.683687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9391f5bd-6d53-4fb6-b788-93b1b7e00fc1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:20.690076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9391f5bd-6d53-4fb6-b788-93b1b7e00fc1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:20.690548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9391f5bd-6d53-4fb6-b788-93b1b7e00fc1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:20.690978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9391f5bd-6d53-4fb6-b788-93b1b7e00fc1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:20.691653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9391f5bd-6d53-4fb6-b788-93b1b7e00fc1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:20.692353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9391f5bd-6d53-4fb6-b788-93b1b7e00fc1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:20.692794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9391f5bd-6d53-4fb6-b788-93b1b7e00fc1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:20.705602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4c64734d-3d26-4cbf-b13b-77d1d4e1edb9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:20.707720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4c64734d-3d26-4cbf-b13b-77d1d4e1edb9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:20.715221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c64734d-3d26-4cbf-b13b-77d1d4e1edb9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:20.715704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c64734d-3d26-4cbf-b13b-77d1d4e1edb9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:20.716146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c64734d-3d26-4cbf-b13b-77d1d4e1edb9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:20.716871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c64734d-3d26-4cbf-b13b-77d1d4e1edb9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:20.717327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c64734d-3d26-4cbf-b13b-77d1d4e1edb9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:20.717752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c64734d-3d26-4cbf-b13b-77d1d4e1edb9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:20.748940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4c64734d-3d26-4cbf-b13b-77d1d4e1edb9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047224 Sep 01 05:24:20.749700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 709/1384] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:20.754187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-71a14d2e-db97-4ba9-8044-7280b0dfcc3d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:20.756807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-71a14d2e-db97-4ba9-8044-7280b0dfcc3d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:20.758580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9391f5bd-6d53-4fb6-b788-93b1b7e00fc1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:20.763737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71a14d2e-db97-4ba9-8044-7280b0dfcc3d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:20.764233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71a14d2e-db97-4ba9-8044-7280b0dfcc3d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:20.764674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71a14d2e-db97-4ba9-8044-7280b0dfcc3d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:20.765448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71a14d2e-db97-4ba9-8044-7280b0dfcc3d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:20.765900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71a14d2e-db97-4ba9-8044-7280b0dfcc3d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:20.766327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71a14d2e-db97-4ba9-8044-7280b0dfcc3d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:20.767313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9391f5bd-6d53-4fb6-b788-93b1b7e00fc1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088926 Sep 01 05:24:20.767889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 676/1385] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:20 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:20.797170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-71a14d2e-db97-4ba9-8044-7280b0dfcc3d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046528 Sep 01 05:24:20.797651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 710/1386] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:20 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:21.761842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-441a03eb-d348-459e-95cf-f1fa7fd00a50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:21.763965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-441a03eb-d348-459e-95cf-f1fa7fd00a50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:21.770361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-441a03eb-d348-459e-95cf-f1fa7fd00a50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:21.770830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-441a03eb-d348-459e-95cf-f1fa7fd00a50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:21.771254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-441a03eb-d348-459e-95cf-f1fa7fd00a50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:21.771922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-441a03eb-d348-459e-95cf-f1fa7fd00a50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:21.772361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-441a03eb-d348-459e-95cf-f1fa7fd00a50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:21.772794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-441a03eb-d348-459e-95cf-f1fa7fd00a50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:21.788407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-13f144b4-1c49-43f8-bf41-5b3b880455b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:21.789163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-13f144b4-1c49-43f8-bf41-5b3b880455b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:21.796336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13f144b4-1c49-43f8-bf41-5b3b880455b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:21.796844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13f144b4-1c49-43f8-bf41-5b3b880455b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:21.797280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13f144b4-1c49-43f8-bf41-5b3b880455b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:21.797971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13f144b4-1c49-43f8-bf41-5b3b880455b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:21.798422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13f144b4-1c49-43f8-bf41-5b3b880455b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:21.798843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13f144b4-1c49-43f8-bf41-5b3b880455b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:21.802189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-441a03eb-d348-459e-95cf-f1fa7fd00a50 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044468 Sep 01 05:24:21.804035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 677/1387] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:21 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:21.809538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ee2f646e-ae03-4dab-8266-ea3b2fd270cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:21.811642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ee2f646e-ae03-4dab-8266-ea3b2fd270cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:21.817625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee2f646e-ae03-4dab-8266-ea3b2fd270cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:21.818099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee2f646e-ae03-4dab-8266-ea3b2fd270cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:21.818526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee2f646e-ae03-4dab-8266-ea3b2fd270cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:21.819204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee2f646e-ae03-4dab-8266-ea3b2fd270cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:21.819646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee2f646e-ae03-4dab-8266-ea3b2fd270cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:21.820072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee2f646e-ae03-4dab-8266-ea3b2fd270cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:21.848901 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ee2f646e-ae03-4dab-8266-ea3b2fd270cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043635 Sep 01 05:24:21.849470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 678/1388] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:21 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:21.864643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-13f144b4-1c49-43f8-bf41-5b3b880455b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:21.872995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-13f144b4-1c49-43f8-bf41-5b3b880455b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088373 Sep 01 05:24:21.873551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 711/1389] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:21 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:22.814743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-65b3b22f-e788-4999-8800-a4e4af65e165 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:22.817193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-65b3b22f-e788-4999-8800-a4e4af65e165 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:22.824450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65b3b22f-e788-4999-8800-a4e4af65e165 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:22.825032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65b3b22f-e788-4999-8800-a4e4af65e165 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:22.825480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65b3b22f-e788-4999-8800-a4e4af65e165 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:22.826165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65b3b22f-e788-4999-8800-a4e4af65e165 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:22.826617 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65b3b22f-e788-4999-8800-a4e4af65e165 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:22.827042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65b3b22f-e788-4999-8800-a4e4af65e165 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:22.855969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-65b3b22f-e788-4999-8800-a4e4af65e165 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045227 Sep 01 05:24:22.856630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 679/1390] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:22.861720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8be70b08-7c15-4f09-83af-cb32e6be1f96 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:22.863891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8be70b08-7c15-4f09-83af-cb32e6be1f96 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:22.866202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=86 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:22.872665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8be70b08-7c15-4f09-83af-cb32e6be1f96 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:22.873225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8be70b08-7c15-4f09-83af-cb32e6be1f96 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:22.873713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8be70b08-7c15-4f09-83af-cb32e6be1f96 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:22.874448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8be70b08-7c15-4f09-83af-cb32e6be1f96 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:22.874952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8be70b08-7c15-4f09-83af-cb32e6be1f96 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:22.875418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8be70b08-7c15-4f09-83af-cb32e6be1f96 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:22.890066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:22.895343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dd14b838-f1ad-4844-9284-fb67b3b87c7e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:22.896172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dd14b838-f1ad-4844-9284-fb67b3b87c7e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:22.902152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd14b838-f1ad-4844-9284-fb67b3b87c7e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:22.902649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd14b838-f1ad-4844-9284-fb67b3b87c7e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:22.903080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd14b838-f1ad-4844-9284-fb67b3b87c7e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:22.903772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd14b838-f1ad-4844-9284-fb67b3b87c7e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:22.904219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd14b838-f1ad-4844-9284-fb67b3b87c7e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:22.904640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd14b838-f1ad-4844-9284-fb67b3b87c7e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:22.907261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8be70b08-7c15-4f09-83af-cb32e6be1f96 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049564 Sep 01 05:24:22.907829 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 712/1391] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:22 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:22.966165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-dd14b838-f1ad-4844-9284-fb67b3b87c7e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:22.973806 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dd14b838-f1ad-4844-9284-fb67b3b87c7e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084130 Sep 01 05:24:22.974363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 680/1392] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:22 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:23.920945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d90018a4-74b7-4af1-bb45-7968166abcf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:23.923217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d90018a4-74b7-4af1-bb45-7968166abcf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:23.929595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d90018a4-74b7-4af1-bb45-7968166abcf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:23.930066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d90018a4-74b7-4af1-bb45-7968166abcf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:23.930494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d90018a4-74b7-4af1-bb45-7968166abcf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:23.931178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d90018a4-74b7-4af1-bb45-7968166abcf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:23.931692 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d90018a4-74b7-4af1-bb45-7968166abcf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:23.932126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d90018a4-74b7-4af1-bb45-7968166abcf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:23.940160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ed06af4d-6cbe-4b11-aaa7-44f00c6bd7d1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:23.942841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ed06af4d-6cbe-4b11-aaa7-44f00c6bd7d1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:23.949721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed06af4d-6cbe-4b11-aaa7-44f00c6bd7d1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:23.950276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed06af4d-6cbe-4b11-aaa7-44f00c6bd7d1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:23.950780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed06af4d-6cbe-4b11-aaa7-44f00c6bd7d1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:23.951564 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed06af4d-6cbe-4b11-aaa7-44f00c6bd7d1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:23.952074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed06af4d-6cbe-4b11-aaa7-44f00c6bd7d1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:23.952495 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed06af4d-6cbe-4b11-aaa7-44f00c6bd7d1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:23.966454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d90018a4-74b7-4af1-bb45-7968166abcf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051267 Sep 01 05:24:23.967237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 681/1393] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:23 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:23.982410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ed06af4d-6cbe-4b11-aaa7-44f00c6bd7d1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.118604 Sep 01 05:24:23.982949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 713/1394] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:23.994213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-55ba7391-6384-4fb8-9dcd-4c0c07f36e1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:23.994950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-55ba7391-6384-4fb8-9dcd-4c0c07f36e1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:24.000734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55ba7391-6384-4fb8-9dcd-4c0c07f36e1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:24.001239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55ba7391-6384-4fb8-9dcd-4c0c07f36e1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:24.001666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55ba7391-6384-4fb8-9dcd-4c0c07f36e1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:24.002340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55ba7391-6384-4fb8-9dcd-4c0c07f36e1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:24.002782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55ba7391-6384-4fb8-9dcd-4c0c07f36e1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:24.003202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55ba7391-6384-4fb8-9dcd-4c0c07f36e1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:24.065305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-55ba7391-6384-4fb8-9dcd-4c0c07f36e1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:24.073702 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-55ba7391-6384-4fb8-9dcd-4c0c07f36e1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082584 Sep 01 05:24:24.074361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 682/1395] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:23 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:24.978762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5413b052-4b99-4e77-b6cd-7d33a0b641e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:24.981529 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5413b052-4b99-4e77-b6cd-7d33a0b641e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:24.987942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5413b052-4b99-4e77-b6cd-7d33a0b641e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:24.988432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5413b052-4b99-4e77-b6cd-7d33a0b641e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:24.988974 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5413b052-4b99-4e77-b6cd-7d33a0b641e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:24.989669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5413b052-4b99-4e77-b6cd-7d33a0b641e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:24.990179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5413b052-4b99-4e77-b6cd-7d33a0b641e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:24.990541 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5413b052-4b99-4e77-b6cd-7d33a0b641e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:24.994029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-778a21d8-235b-4d6c-b373-12e3a4704eee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:24.997035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-778a21d8-235b-4d6c-b373-12e3a4704eee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:25.003498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-778a21d8-235b-4d6c-b373-12e3a4704eee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:25.003977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-778a21d8-235b-4d6c-b373-12e3a4704eee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:25.004407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-778a21d8-235b-4d6c-b373-12e3a4704eee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:25.005112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-778a21d8-235b-4d6c-b373-12e3a4704eee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:25.005553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-778a21d8-235b-4d6c-b373-12e3a4704eee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:25.005969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-778a21d8-235b-4d6c-b373-12e3a4704eee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:25.021186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5413b052-4b99-4e77-b6cd-7d33a0b641e8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046277 Sep 01 05:24:25.021770 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 714/1396] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:24 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:25.035353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-778a21d8-235b-4d6c-b373-12e3a4704eee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045296 Sep 01 05:24:25.035926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 683/1397] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:25.095113 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-383ed601-7640-4a20-9bb4-c37e66a900e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:25.095723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-383ed601-7640-4a20-9bb4-c37e66a900e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:25.101555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-383ed601-7640-4a20-9bb4-c37e66a900e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:25.102027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-383ed601-7640-4a20-9bb4-c37e66a900e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:25.102454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-383ed601-7640-4a20-9bb4-c37e66a900e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:25.103128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-383ed601-7640-4a20-9bb4-c37e66a900e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:25.103571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-383ed601-7640-4a20-9bb4-c37e66a900e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:25.103983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-383ed601-7640-4a20-9bb4-c37e66a900e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:25.168191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-383ed601-7640-4a20-9bb4-c37e66a900e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:25.175971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-383ed601-7640-4a20-9bb4-c37e66a900e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084962 Sep 01 05:24:25.176531 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 715/1398] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:25 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:26.033503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5c5e929a-5c63-44df-b93c-64f480fd0b6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:26.035661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5c5e929a-5c63-44df-b93c-64f480fd0b6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:26.042848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c5e929a-5c63-44df-b93c-64f480fd0b6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.043281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c5e929a-5c63-44df-b93c-64f480fd0b6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.043710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c5e929a-5c63-44df-b93c-64f480fd0b6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:26.044394 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c5e929a-5c63-44df-b93c-64f480fd0b6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.044919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c5e929a-5c63-44df-b93c-64f480fd0b6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.045345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c5e929a-5c63-44df-b93c-64f480fd0b6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:26.047913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-53a1b7f7-7ad7-49bb-8fce-178a8fa2db58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:26.050091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-53a1b7f7-7ad7-49bb-8fce-178a8fa2db58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:26.056638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-53a1b7f7-7ad7-49bb-8fce-178a8fa2db58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.057147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-53a1b7f7-7ad7-49bb-8fce-178a8fa2db58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.058264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-53a1b7f7-7ad7-49bb-8fce-178a8fa2db58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:26.058970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-53a1b7f7-7ad7-49bb-8fce-178a8fa2db58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.059424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-53a1b7f7-7ad7-49bb-8fce-178a8fa2db58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.059847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-53a1b7f7-7ad7-49bb-8fce-178a8fa2db58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:26.075609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5c5e929a-5c63-44df-b93c-64f480fd0b6a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046104 Sep 01 05:24:26.076187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 684/1399] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:26 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:26.090646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-53a1b7f7-7ad7-49bb-8fce-178a8fa2db58 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046631 Sep 01 05:24:26.091211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 716/1400] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:26.196909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6b983b26-ee18-4a93-846a-e5cc46befbb0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:26.197448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6b983b26-ee18-4a93-846a-e5cc46befbb0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:26.203892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b983b26-ee18-4a93-846a-e5cc46befbb0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.204369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b983b26-ee18-4a93-846a-e5cc46befbb0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.204819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b983b26-ee18-4a93-846a-e5cc46befbb0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:26.205494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b983b26-ee18-4a93-846a-e5cc46befbb0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.205936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b983b26-ee18-4a93-846a-e5cc46befbb0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.206351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b983b26-ee18-4a93-846a-e5cc46befbb0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:26.270301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6b983b26-ee18-4a93-846a-e5cc46befbb0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:26.278939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6b983b26-ee18-4a93-846a-e5cc46befbb0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086004 Sep 01 05:24:26.279506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 685/1401] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:26 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:27.087379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d8b9070d-ce0e-4a45-b5a1-4766edd660f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:27.089895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d8b9070d-ce0e-4a45-b5a1-4766edd660f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:27.096653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8b9070d-ce0e-4a45-b5a1-4766edd660f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:27.097162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8b9070d-ce0e-4a45-b5a1-4766edd660f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:27.097640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8b9070d-ce0e-4a45-b5a1-4766edd660f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:27.098302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8b9070d-ce0e-4a45-b5a1-4766edd660f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:27.098748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8b9070d-ce0e-4a45-b5a1-4766edd660f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:27.099175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d8b9070d-ce0e-4a45-b5a1-4766edd660f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:27.103061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1e7373b3-5e09-41ab-85ed-6b8fa98d739a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:27.106333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1e7373b3-5e09-41ab-85ed-6b8fa98d739a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:27.112662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e7373b3-5e09-41ab-85ed-6b8fa98d739a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:27.113184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e7373b3-5e09-41ab-85ed-6b8fa98d739a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:27.113616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e7373b3-5e09-41ab-85ed-6b8fa98d739a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:27.114300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e7373b3-5e09-41ab-85ed-6b8fa98d739a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:27.114779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e7373b3-5e09-41ab-85ed-6b8fa98d739a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:27.115201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e7373b3-5e09-41ab-85ed-6b8fa98d739a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:27.130342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d8b9070d-ce0e-4a45-b5a1-4766edd660f9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046834 Sep 01 05:24:27.130942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 717/1402] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:27 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:27.146202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1e7373b3-5e09-41ab-85ed-6b8fa98d739a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047043 Sep 01 05:24:27.146686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 686/1403] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:27 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:27.298884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-050793ea-867d-4668-bea2-170e6b7012b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:27.299492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-050793ea-867d-4668-bea2-170e6b7012b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:27.305511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-050793ea-867d-4668-bea2-170e6b7012b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:27.305993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-050793ea-867d-4668-bea2-170e6b7012b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:27.306428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-050793ea-867d-4668-bea2-170e6b7012b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:27.307106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-050793ea-867d-4668-bea2-170e6b7012b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:27.308276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-050793ea-867d-4668-bea2-170e6b7012b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:27.308723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-050793ea-867d-4668-bea2-170e6b7012b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:27.370649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-050793ea-867d-4668-bea2-170e6b7012b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:27.378388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-050793ea-867d-4668-bea2-170e6b7012b8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083468 Sep 01 05:24:27.378949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 718/1404] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:27 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:28.142720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6048146c-f535-4516-a7c0-1ddc2370cdad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:28.144882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6048146c-f535-4516-a7c0-1ddc2370cdad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:28.151364 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6048146c-f535-4516-a7c0-1ddc2370cdad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:28.151655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6048146c-f535-4516-a7c0-1ddc2370cdad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:28.152081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6048146c-f535-4516-a7c0-1ddc2370cdad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:28.152759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6048146c-f535-4516-a7c0-1ddc2370cdad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:28.153262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6048146c-f535-4516-a7c0-1ddc2370cdad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:28.153676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6048146c-f535-4516-a7c0-1ddc2370cdad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:28.158179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-44b42d8a-58ba-433e-81c3-e2dde2dd0570 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:28.160330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-44b42d8a-58ba-433e-81c3-e2dde2dd0570 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:28.167047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44b42d8a-58ba-433e-81c3-e2dde2dd0570 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:28.167627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44b42d8a-58ba-433e-81c3-e2dde2dd0570 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:28.168069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44b42d8a-58ba-433e-81c3-e2dde2dd0570 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:28.168765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44b42d8a-58ba-433e-81c3-e2dde2dd0570 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:28.169259 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44b42d8a-58ba-433e-81c3-e2dde2dd0570 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:28.169681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44b42d8a-58ba-433e-81c3-e2dde2dd0570 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:28.184181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6048146c-f535-4516-a7c0-1ddc2370cdad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Sep 01 05:24:28.184747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 687/1405] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:28 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:28.201316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-44b42d8a-58ba-433e-81c3-e2dde2dd0570 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047081 Sep 01 05:24:28.201868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 719/1406] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:28 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:28.399143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-585561c7-03d6-4c8f-9f73-4993fccaff8a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:28.399753 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-585561c7-03d6-4c8f-9f73-4993fccaff8a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:28.406585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-585561c7-03d6-4c8f-9f73-4993fccaff8a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:28.406998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-585561c7-03d6-4c8f-9f73-4993fccaff8a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:28.407429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-585561c7-03d6-4c8f-9f73-4993fccaff8a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:28.408105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-585561c7-03d6-4c8f-9f73-4993fccaff8a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:28.408591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-585561c7-03d6-4c8f-9f73-4993fccaff8a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:28.409044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-585561c7-03d6-4c8f-9f73-4993fccaff8a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:28.470653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-585561c7-03d6-4c8f-9f73-4993fccaff8a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:28.478208 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-585561c7-03d6-4c8f-9f73-4993fccaff8a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083001 Sep 01 05:24:28.478760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 688/1407] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:28 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:29.196930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-62b24b53-184d-49a4-905a-1e4e21afdfe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:29.199703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-62b24b53-184d-49a4-905a-1e4e21afdfe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:29.206121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-62b24b53-184d-49a4-905a-1e4e21afdfe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.206597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-62b24b53-184d-49a4-905a-1e4e21afdfe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.207083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-62b24b53-184d-49a4-905a-1e4e21afdfe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.207710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-62b24b53-184d-49a4-905a-1e4e21afdfe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.208157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-62b24b53-184d-49a4-905a-1e4e21afdfe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.212539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cb3a7ea9-767b-4625-9616-f266dcc5c45c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:29.213364 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-62b24b53-184d-49a4-905a-1e4e21afdfe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.215042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cb3a7ea9-767b-4625-9616-f266dcc5c45c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:29.217963 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:24:29.218192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:24:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments (ip 10.222.0.49) !!! Sep 01 05:24:29.232332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb3a7ea9-767b-4625-9616-f266dcc5c45c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.232876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb3a7ea9-767b-4625-9616-f266dcc5c45c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.233317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb3a7ea9-767b-4625-9616-f266dcc5c45c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.234014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb3a7ea9-767b-4625-9616-f266dcc5c45c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.234464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb3a7ea9-767b-4625-9616-f266dcc5c45c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.234888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb3a7ea9-767b-4625-9616-f266dcc5c45c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.249898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-62b24b53-184d-49a4-905a-1e4e21afdfe0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057012 Sep 01 05:24:29.250840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 720/1408] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:29 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:29.275425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cb3a7ea9-767b-4625-9616-f266dcc5c45c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066425 Sep 01 05:24:29.276694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 689/1409] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:29 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:29.500871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1f7b6d19-0734-43f6-8213-fea53775b43d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:29.501456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1f7b6d19-0734-43f6-8213-fea53775b43d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:29.507353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1f7b6d19-0734-43f6-8213-fea53775b43d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.507835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1f7b6d19-0734-43f6-8213-fea53775b43d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.508272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1f7b6d19-0734-43f6-8213-fea53775b43d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.508984 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1f7b6d19-0734-43f6-8213-fea53775b43d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.509437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1f7b6d19-0734-43f6-8213-fea53775b43d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.509858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1f7b6d19-0734-43f6-8213-fea53775b43d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.572740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1f7b6d19-0734-43f6-8213-fea53775b43d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:29.580877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1f7b6d19-0734-43f6-8213-fea53775b43d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085694 Sep 01 05:24:29.581442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 721/1410] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:29 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:30.266161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b43f2c36-e713-4738-8c5e-11d4f1da6955 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:30.268254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b43f2c36-e713-4738-8c5e-11d4f1da6955 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:30.274536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b43f2c36-e713-4738-8c5e-11d4f1da6955 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:30.275006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b43f2c36-e713-4738-8c5e-11d4f1da6955 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:30.275432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b43f2c36-e713-4738-8c5e-11d4f1da6955 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:30.276876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b43f2c36-e713-4738-8c5e-11d4f1da6955 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:30.277258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b43f2c36-e713-4738-8c5e-11d4f1da6955 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:30.277681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b43f2c36-e713-4738-8c5e-11d4f1da6955 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:30.289093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cbd4a4ca-536c-4e1a-b860-9d9c9890ca31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:30.291226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cbd4a4ca-536c-4e1a-b860-9d9c9890ca31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:30.297802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbd4a4ca-536c-4e1a-b860-9d9c9890ca31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:30.298284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbd4a4ca-536c-4e1a-b860-9d9c9890ca31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:30.298720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbd4a4ca-536c-4e1a-b860-9d9c9890ca31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:30.299416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbd4a4ca-536c-4e1a-b860-9d9c9890ca31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:30.299870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbd4a4ca-536c-4e1a-b860-9d9c9890ca31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:30.300296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cbd4a4ca-536c-4e1a-b860-9d9c9890ca31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:30.307315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b43f2c36-e713-4738-8c5e-11d4f1da6955 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045173 Sep 01 05:24:30.308467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 690/1411] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:30 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:30.330924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cbd4a4ca-536c-4e1a-b860-9d9c9890ca31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045846 Sep 01 05:24:30.331478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 722/1412] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:30 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:30.602926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f155b792-2221-43c7-a2bf-b9b6b956461f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:30.603462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f155b792-2221-43c7-a2bf-b9b6b956461f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:30.610243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f155b792-2221-43c7-a2bf-b9b6b956461f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:30.610725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f155b792-2221-43c7-a2bf-b9b6b956461f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:30.611163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f155b792-2221-43c7-a2bf-b9b6b956461f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:30.611848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f155b792-2221-43c7-a2bf-b9b6b956461f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:30.612298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f155b792-2221-43c7-a2bf-b9b6b956461f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:30.612718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f155b792-2221-43c7-a2bf-b9b6b956461f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:30.627455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:30.679015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f155b792-2221-43c7-a2bf-b9b6b956461f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:30.688832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f155b792-2221-43c7-a2bf-b9b6b956461f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.089876 Sep 01 05:24:30.689404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 691/1413] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:30 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:31.319890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8970467b-2980-412c-aa76-5421f4f5997a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:31.322009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8970467b-2980-412c-aa76-5421f4f5997a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:31.328833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8970467b-2980-412c-aa76-5421f4f5997a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:31.329314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8970467b-2980-412c-aa76-5421f4f5997a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:31.329747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8970467b-2980-412c-aa76-5421f4f5997a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:31.330423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8970467b-2980-412c-aa76-5421f4f5997a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:31.330869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8970467b-2980-412c-aa76-5421f4f5997a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:31.331296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8970467b-2980-412c-aa76-5421f4f5997a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:31.344464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-940fa6f2-e733-4cdd-8a06-3171337b4e07 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:31.346624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-940fa6f2-e733-4cdd-8a06-3171337b4e07 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:31.352917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-940fa6f2-e733-4cdd-8a06-3171337b4e07 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:31.353391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-940fa6f2-e733-4cdd-8a06-3171337b4e07 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:31.353847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-940fa6f2-e733-4cdd-8a06-3171337b4e07 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:31.355348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-940fa6f2-e733-4cdd-8a06-3171337b4e07 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:31.355792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-940fa6f2-e733-4cdd-8a06-3171337b4e07 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:31.356236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-940fa6f2-e733-4cdd-8a06-3171337b4e07 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:31.361989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8970467b-2980-412c-aa76-5421f4f5997a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046346 Sep 01 05:24:31.362552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 723/1414] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:31 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:31.387573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-940fa6f2-e733-4cdd-8a06-3171337b4e07 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047886 Sep 01 05:24:31.388117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 692/1415] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:31.710914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-41f404fe-411a-4879-af17-d19d48ca5a0b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:31.711547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-41f404fe-411a-4879-af17-d19d48ca5a0b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:31.717657 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-41f404fe-411a-4879-af17-d19d48ca5a0b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:31.718139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-41f404fe-411a-4879-af17-d19d48ca5a0b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:31.718574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-41f404fe-411a-4879-af17-d19d48ca5a0b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:31.719268 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-41f404fe-411a-4879-af17-d19d48ca5a0b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:31.719726 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-41f404fe-411a-4879-af17-d19d48ca5a0b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:31.720148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-41f404fe-411a-4879-af17-d19d48ca5a0b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:31.839682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-41f404fe-411a-4879-af17-d19d48ca5a0b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:31.847273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-41f404fe-411a-4879-af17-d19d48ca5a0b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.140173 Sep 01 05:24:31.847826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 724/1416] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:31 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:32.375092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-76dbd667-3bc0-4373-b83d-e3daed8ebd5a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:32.377296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-76dbd667-3bc0-4373-b83d-e3daed8ebd5a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:32.383705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76dbd667-3bc0-4373-b83d-e3daed8ebd5a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:32.384181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76dbd667-3bc0-4373-b83d-e3daed8ebd5a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:32.384612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76dbd667-3bc0-4373-b83d-e3daed8ebd5a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:32.385311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76dbd667-3bc0-4373-b83d-e3daed8ebd5a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:32.385843 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76dbd667-3bc0-4373-b83d-e3daed8ebd5a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:32.386263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76dbd667-3bc0-4373-b83d-e3daed8ebd5a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:32.400176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5c6afcbf-60f3-4442-8eb5-bfe498992e41 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:32.402558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5c6afcbf-60f3-4442-8eb5-bfe498992e41 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:32.408768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c6afcbf-60f3-4442-8eb5-bfe498992e41 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:32.409272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c6afcbf-60f3-4442-8eb5-bfe498992e41 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:32.409720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c6afcbf-60f3-4442-8eb5-bfe498992e41 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:32.410389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c6afcbf-60f3-4442-8eb5-bfe498992e41 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:32.410829 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c6afcbf-60f3-4442-8eb5-bfe498992e41 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:32.411247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c6afcbf-60f3-4442-8eb5-bfe498992e41 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:32.415990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-76dbd667-3bc0-4373-b83d-e3daed8ebd5a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045518 Sep 01 05:24:32.416588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 693/1417] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:32 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:32.441233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5c6afcbf-60f3-4442-8eb5-bfe498992e41 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044912 Sep 01 05:24:32.441779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 725/1418] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:32.868401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-849079a9-69f4-4ad8-a827-b5a51cee3f2b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:32.869044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-849079a9-69f4-4ad8-a827-b5a51cee3f2b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:32.875330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-849079a9-69f4-4ad8-a827-b5a51cee3f2b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:32.875810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-849079a9-69f4-4ad8-a827-b5a51cee3f2b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:32.876242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-849079a9-69f4-4ad8-a827-b5a51cee3f2b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:32.876969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-849079a9-69f4-4ad8-a827-b5a51cee3f2b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:32.877418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-849079a9-69f4-4ad8-a827-b5a51cee3f2b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:32.877838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-849079a9-69f4-4ad8-a827-b5a51cee3f2b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:32.939395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-849079a9-69f4-4ad8-a827-b5a51cee3f2b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:32.947430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-849079a9-69f4-4ad8-a827-b5a51cee3f2b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082917 Sep 01 05:24:32.948478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 694/1419] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:32 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:33.429430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b0ed632d-4c7d-43be-a03b-107c8f89a9da tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:33.431564 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b0ed632d-4c7d-43be-a03b-107c8f89a9da tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:33.438745 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b0ed632d-4c7d-43be-a03b-107c8f89a9da tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:33.439229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b0ed632d-4c7d-43be-a03b-107c8f89a9da tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:33.439666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b0ed632d-4c7d-43be-a03b-107c8f89a9da tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:33.440351 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b0ed632d-4c7d-43be-a03b-107c8f89a9da tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:33.440822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b0ed632d-4c7d-43be-a03b-107c8f89a9da tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:33.441250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b0ed632d-4c7d-43be-a03b-107c8f89a9da tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:33.454463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4b5318b1-f260-4ecf-905b-34cc8f4be31b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:33.456614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4b5318b1-f260-4ecf-905b-34cc8f4be31b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:33.462845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b5318b1-f260-4ecf-905b-34cc8f4be31b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:33.463316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b5318b1-f260-4ecf-905b-34cc8f4be31b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:33.463752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b5318b1-f260-4ecf-905b-34cc8f4be31b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:33.464425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b5318b1-f260-4ecf-905b-34cc8f4be31b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:33.464893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b5318b1-f260-4ecf-905b-34cc8f4be31b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:33.465312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b5318b1-f260-4ecf-905b-34cc8f4be31b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:33.472831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b0ed632d-4c7d-43be-a03b-107c8f89a9da tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047337 Sep 01 05:24:33.473400 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 726/1420] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:33.494132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4b5318b1-f260-4ecf-905b-34cc8f4be31b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043601 Sep 01 05:24:33.494679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 695/1421] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:33.968308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0d58a748-880b-4fc6-a522-f339f986d11f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:33.968943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0d58a748-880b-4fc6-a522-f339f986d11f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:33.974819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0d58a748-880b-4fc6-a522-f339f986d11f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:33.975294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0d58a748-880b-4fc6-a522-f339f986d11f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:33.975782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0d58a748-880b-4fc6-a522-f339f986d11f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:33.976462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0d58a748-880b-4fc6-a522-f339f986d11f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:33.976944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0d58a748-880b-4fc6-a522-f339f986d11f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:33.977363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0d58a748-880b-4fc6-a522-f339f986d11f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:34.039471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0d58a748-880b-4fc6-a522-f339f986d11f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:34.047605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0d58a748-880b-4fc6-a522-f339f986d11f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083095 Sep 01 05:24:34.048157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 727/1422] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:33 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:34.485747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-425e7239-ac20-44ab-ba83-dd407a5243bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:34.487938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-425e7239-ac20-44ab-ba83-dd407a5243bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:34.494368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-425e7239-ac20-44ab-ba83-dd407a5243bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:34.494851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-425e7239-ac20-44ab-ba83-dd407a5243bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:34.495917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-425e7239-ac20-44ab-ba83-dd407a5243bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:34.496604 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-425e7239-ac20-44ab-ba83-dd407a5243bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:34.497086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-425e7239-ac20-44ab-ba83-dd407a5243bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:34.497512 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-425e7239-ac20-44ab-ba83-dd407a5243bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:34.506766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8a7bb367-857e-404c-a554-b2890015bddc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:34.508904 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8a7bb367-857e-404c-a554-b2890015bddc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:34.515290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8a7bb367-857e-404c-a554-b2890015bddc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:34.515757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8a7bb367-857e-404c-a554-b2890015bddc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:34.516181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8a7bb367-857e-404c-a554-b2890015bddc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:34.516887 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8a7bb367-857e-404c-a554-b2890015bddc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:34.517328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8a7bb367-857e-404c-a554-b2890015bddc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:34.517740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8a7bb367-857e-404c-a554-b2890015bddc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:34.526884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-425e7239-ac20-44ab-ba83-dd407a5243bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045125 Sep 01 05:24:34.527448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 696/1423] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:34.547612 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8a7bb367-857e-404c-a554-b2890015bddc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044819 Sep 01 05:24:34.548152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 728/1424] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:35.069161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2a8327c6-38d0-411f-b215-5fe5d26ed322 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:35.069775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2a8327c6-38d0-411f-b215-5fe5d26ed322 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:35.076555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a8327c6-38d0-411f-b215-5fe5d26ed322 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:35.077066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a8327c6-38d0-411f-b215-5fe5d26ed322 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:35.077501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a8327c6-38d0-411f-b215-5fe5d26ed322 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:35.078187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a8327c6-38d0-411f-b215-5fe5d26ed322 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:35.078639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a8327c6-38d0-411f-b215-5fe5d26ed322 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:35.079092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a8327c6-38d0-411f-b215-5fe5d26ed322 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:35.187860 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2a8327c6-38d0-411f-b215-5fe5d26ed322 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:35.195805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2a8327c6-38d0-411f-b215-5fe5d26ed322 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.130892 Sep 01 05:24:35.196355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 697/1425] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:35 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:35.539122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f0be61b7-a5d1-4005-bb21-41d3924099c1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:35.541279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f0be61b7-a5d1-4005-bb21-41d3924099c1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:35.549850 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0be61b7-a5d1-4005-bb21-41d3924099c1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:35.550327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0be61b7-a5d1-4005-bb21-41d3924099c1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:35.550765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0be61b7-a5d1-4005-bb21-41d3924099c1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:35.551450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0be61b7-a5d1-4005-bb21-41d3924099c1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:35.551895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0be61b7-a5d1-4005-bb21-41d3924099c1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:35.552312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0be61b7-a5d1-4005-bb21-41d3924099c1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:35.555984 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:35.561385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8002e980-4330-46c6-aeac-e06213b6fec0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:35.563628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8002e980-4330-46c6-aeac-e06213b6fec0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:35.570005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8002e980-4330-46c6-aeac-e06213b6fec0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:35.570486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8002e980-4330-46c6-aeac-e06213b6fec0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:35.570924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8002e980-4330-46c6-aeac-e06213b6fec0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:35.571619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8002e980-4330-46c6-aeac-e06213b6fec0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:35.572064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8002e980-4330-46c6-aeac-e06213b6fec0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:35.572482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8002e980-4330-46c6-aeac-e06213b6fec0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:35.584610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f0be61b7-a5d1-4005-bb21-41d3924099c1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049345 Sep 01 05:24:35.585416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 729/1426] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:35 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:35.603768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8002e980-4330-46c6-aeac-e06213b6fec0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048108 Sep 01 05:24:35.609284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 698/1427] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:36.216803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-77f3c5ca-0ebf-4d29-bd4d-004c0c2e09dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:36.217444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-77f3c5ca-0ebf-4d29-bd4d-004c0c2e09dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:36.223332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77f3c5ca-0ebf-4d29-bd4d-004c0c2e09dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:36.223803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77f3c5ca-0ebf-4d29-bd4d-004c0c2e09dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:36.224234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77f3c5ca-0ebf-4d29-bd4d-004c0c2e09dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:36.224937 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77f3c5ca-0ebf-4d29-bd4d-004c0c2e09dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:36.225382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77f3c5ca-0ebf-4d29-bd4d-004c0c2e09dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:36.225797 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77f3c5ca-0ebf-4d29-bd4d-004c0c2e09dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:36.287310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-77f3c5ca-0ebf-4d29-bd4d-004c0c2e09dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:36.295444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-77f3c5ca-0ebf-4d29-bd4d-004c0c2e09dc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082626 Sep 01 05:24:36.295999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 730/1428] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:36 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:36.597580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a0c3ae97-1866-404c-8e17-756a556322a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:36.599657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a0c3ae97-1866-404c-8e17-756a556322a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:36.606693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0c3ae97-1866-404c-8e17-756a556322a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:36.607166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0c3ae97-1866-404c-8e17-756a556322a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:36.607594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0c3ae97-1866-404c-8e17-756a556322a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:36.608269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0c3ae97-1866-404c-8e17-756a556322a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:36.608712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0c3ae97-1866-404c-8e17-756a556322a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:36.609157 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0c3ae97-1866-404c-8e17-756a556322a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:36.616950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7173b556-6b14-4843-9e35-37c203f4f183 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:36.619070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7173b556-6b14-4843-9e35-37c203f4f183 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:36.625763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7173b556-6b14-4843-9e35-37c203f4f183 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:36.626307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7173b556-6b14-4843-9e35-37c203f4f183 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:36.626741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7173b556-6b14-4843-9e35-37c203f4f183 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:36.627425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7173b556-6b14-4843-9e35-37c203f4f183 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:36.627867 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7173b556-6b14-4843-9e35-37c203f4f183 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:36.628282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7173b556-6b14-4843-9e35-37c203f4f183 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:36.639451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a0c3ae97-1866-404c-8e17-756a556322a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Sep 01 05:24:36.640023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 699/1429] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:36 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:36.660070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7173b556-6b14-4843-9e35-37c203f4f183 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047043 Sep 01 05:24:36.660623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 731/1430] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:37.316983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-355fc0d8-8b58-4633-9105-d634fc5f7b1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:37.317790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-355fc0d8-8b58-4633-9105-d634fc5f7b1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:37.323912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-355fc0d8-8b58-4633-9105-d634fc5f7b1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:37.324389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-355fc0d8-8b58-4633-9105-d634fc5f7b1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:37.324853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-355fc0d8-8b58-4633-9105-d634fc5f7b1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:37.325542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-355fc0d8-8b58-4633-9105-d634fc5f7b1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:37.325991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-355fc0d8-8b58-4633-9105-d634fc5f7b1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:37.326413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-355fc0d8-8b58-4633-9105-d634fc5f7b1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:37.387550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-355fc0d8-8b58-4633-9105-d634fc5f7b1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:37.395298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-355fc0d8-8b58-4633-9105-d634fc5f7b1d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082343 Sep 01 05:24:37.395860 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 700/1431] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:37 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:37.672939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dea63877-339b-4c3e-a97f-fb7cfb343b47 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:37.675290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dea63877-339b-4c3e-a97f-fb7cfb343b47 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:37.681635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dea63877-339b-4c3e-a97f-fb7cfb343b47 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:37.682054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dea63877-339b-4c3e-a97f-fb7cfb343b47 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:37.682496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dea63877-339b-4c3e-a97f-fb7cfb343b47 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:37.683188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dea63877-339b-4c3e-a97f-fb7cfb343b47 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:37.683671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dea63877-339b-4c3e-a97f-fb7cfb343b47 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:37.684094 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dea63877-339b-4c3e-a97f-fb7cfb343b47 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:37.715129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dea63877-339b-4c3e-a97f-fb7cfb343b47 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045403 Sep 01 05:24:37.715536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 701/1432] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:37 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:37.716188 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2fff2e0d-ea86-4aa0-8e19-1853adb514cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:37.718344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2fff2e0d-ea86-4aa0-8e19-1853adb514cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:37.724237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2fff2e0d-ea86-4aa0-8e19-1853adb514cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:37.724743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2fff2e0d-ea86-4aa0-8e19-1853adb514cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:37.725203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2fff2e0d-ea86-4aa0-8e19-1853adb514cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:37.725883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2fff2e0d-ea86-4aa0-8e19-1853adb514cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:37.726326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2fff2e0d-ea86-4aa0-8e19-1853adb514cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:37.726739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2fff2e0d-ea86-4aa0-8e19-1853adb514cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:37.756366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2fff2e0d-ea86-4aa0-8e19-1853adb514cb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108804 Sep 01 05:24:37.756932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 732/1433] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:37 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:38.416942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-325778fa-4190-4a15-9f72-f65e007d690b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:38.417553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-325778fa-4190-4a15-9f72-f65e007d690b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:38.423409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-325778fa-4190-4a15-9f72-f65e007d690b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:38.423883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-325778fa-4190-4a15-9f72-f65e007d690b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:38.424309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-325778fa-4190-4a15-9f72-f65e007d690b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:38.425009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-325778fa-4190-4a15-9f72-f65e007d690b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:38.425451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-325778fa-4190-4a15-9f72-f65e007d690b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:38.425863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-325778fa-4190-4a15-9f72-f65e007d690b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:38.486653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-325778fa-4190-4a15-9f72-f65e007d690b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:38.494204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-325778fa-4190-4a15-9f72-f65e007d690b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081399 Sep 01 05:24:38.494758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 702/1434] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:38 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:38.726681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5be77049-e16f-4d80-8ea1-b5290e9eb44f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:38.728719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5be77049-e16f-4d80-8ea1-b5290e9eb44f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:38.735390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5be77049-e16f-4d80-8ea1-b5290e9eb44f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:38.735860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5be77049-e16f-4d80-8ea1-b5290e9eb44f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:38.736289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5be77049-e16f-4d80-8ea1-b5290e9eb44f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:38.736986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5be77049-e16f-4d80-8ea1-b5290e9eb44f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:38.737434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5be77049-e16f-4d80-8ea1-b5290e9eb44f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:38.737845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5be77049-e16f-4d80-8ea1-b5290e9eb44f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:38.767830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5be77049-e16f-4d80-8ea1-b5290e9eb44f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045192 Sep 01 05:24:38.768255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bcd6018c-7434-447a-85a7-c3008a4e9fc0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:38.768709 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 733/1435] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:38 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:38.770425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bcd6018c-7434-447a-85a7-c3008a4e9fc0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:38.776384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bcd6018c-7434-447a-85a7-c3008a4e9fc0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:38.776930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bcd6018c-7434-447a-85a7-c3008a4e9fc0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:38.777415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bcd6018c-7434-447a-85a7-c3008a4e9fc0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:38.778102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bcd6018c-7434-447a-85a7-c3008a4e9fc0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:38.778552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bcd6018c-7434-447a-85a7-c3008a4e9fc0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:38.778975 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bcd6018c-7434-447a-85a7-c3008a4e9fc0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:38.808582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bcd6018c-7434-447a-85a7-c3008a4e9fc0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044377 Sep 01 05:24:38.809165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 703/1436] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:38 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:39.513618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-694ba59d-732f-4d64-b65a-d7e7c41f5fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:39.514219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-694ba59d-732f-4d64-b65a-d7e7c41f5fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:39.520180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-694ba59d-732f-4d64-b65a-d7e7c41f5fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:39.520652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-694ba59d-732f-4d64-b65a-d7e7c41f5fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:39.521104 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-694ba59d-732f-4d64-b65a-d7e7c41f5fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:39.521778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-694ba59d-732f-4d64-b65a-d7e7c41f5fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:39.522223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-694ba59d-732f-4d64-b65a-d7e7c41f5fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:39.522643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-694ba59d-732f-4d64-b65a-d7e7c41f5fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:39.584484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-694ba59d-732f-4d64-b65a-d7e7c41f5fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:39.592904 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-694ba59d-732f-4d64-b65a-d7e7c41f5fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083251 Sep 01 05:24:39.593461 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 734/1437] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:39 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:39.780358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-241e0fe2-afff-4051-aee5-9139b57370b2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:39.782434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-241e0fe2-afff-4051-aee5-9139b57370b2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:39.788750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-241e0fe2-afff-4051-aee5-9139b57370b2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:39.789254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-241e0fe2-afff-4051-aee5-9139b57370b2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:39.789679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-241e0fe2-afff-4051-aee5-9139b57370b2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:39.790346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-241e0fe2-afff-4051-aee5-9139b57370b2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:39.790789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-241e0fe2-afff-4051-aee5-9139b57370b2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:39.791202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-241e0fe2-afff-4051-aee5-9139b57370b2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:39.820805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a2bac183-1701-41af-9292-6aefe3fbaaba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:39.822786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-241e0fe2-afff-4051-aee5-9139b57370b2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047158 Sep 01 05:24:39.822944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a2bac183-1701-41af-9292-6aefe3fbaaba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:39.823909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 704/1438] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:39 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:39.830204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a2bac183-1701-41af-9292-6aefe3fbaaba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:39.830688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a2bac183-1701-41af-9292-6aefe3fbaaba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:39.831122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a2bac183-1701-41af-9292-6aefe3fbaaba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:39.831813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a2bac183-1701-41af-9292-6aefe3fbaaba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:39.832264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a2bac183-1701-41af-9292-6aefe3fbaaba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:39.832685 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a2bac183-1701-41af-9292-6aefe3fbaaba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:39.862170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a2bac183-1701-41af-9292-6aefe3fbaaba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045579 Sep 01 05:24:39.862726 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 735/1439] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:40.614393 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b72a7ec3-e4a2-417b-bf6a-0704ebf74399 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:40.615005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b72a7ec3-e4a2-417b-bf6a-0704ebf74399 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:40.621342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b72a7ec3-e4a2-417b-bf6a-0704ebf74399 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:40.621829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b72a7ec3-e4a2-417b-bf6a-0704ebf74399 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:40.622269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b72a7ec3-e4a2-417b-bf6a-0704ebf74399 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:40.622960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b72a7ec3-e4a2-417b-bf6a-0704ebf74399 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:40.623445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b72a7ec3-e4a2-417b-bf6a-0704ebf74399 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:40.623870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b72a7ec3-e4a2-417b-bf6a-0704ebf74399 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:40.684408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b72a7ec3-e4a2-417b-bf6a-0704ebf74399 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:40.692241 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b72a7ec3-e4a2-417b-bf6a-0704ebf74399 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081694 Sep 01 05:24:40.693103 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 705/1440] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:40 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:40.835732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-86b7f818-f7ee-427a-a917-5d752dde5913 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:40.837872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-86b7f818-f7ee-427a-a917-5d752dde5913 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:40.845046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86b7f818-f7ee-427a-a917-5d752dde5913 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:40.845523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86b7f818-f7ee-427a-a917-5d752dde5913 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:40.845952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86b7f818-f7ee-427a-a917-5d752dde5913 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:40.846631 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86b7f818-f7ee-427a-a917-5d752dde5913 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:40.847074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86b7f818-f7ee-427a-a917-5d752dde5913 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:40.847558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86b7f818-f7ee-427a-a917-5d752dde5913 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:40.874601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f82ee546-a020-457d-8772-27a3337ee1ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:40.876942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-86b7f818-f7ee-427a-a917-5d752dde5913 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045252 Sep 01 05:24:40.877362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f82ee546-a020-457d-8772-27a3337ee1ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:40.877751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 736/1441] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:40.883692 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f82ee546-a020-457d-8772-27a3337ee1ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:40.884166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f82ee546-a020-457d-8772-27a3337ee1ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:40.884596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f82ee546-a020-457d-8772-27a3337ee1ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:40.885306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f82ee546-a020-457d-8772-27a3337ee1ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:40.885836 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f82ee546-a020-457d-8772-27a3337ee1ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:40.886392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f82ee546-a020-457d-8772-27a3337ee1ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:40.916106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f82ee546-a020-457d-8772-27a3337ee1ef tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Sep 01 05:24:40.916665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 706/1442] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:40 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:41.714145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-83bcbd87-87ea-4dde-b91a-751901c37749 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:41.714761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-83bcbd87-87ea-4dde-b91a-751901c37749 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:41.720734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-83bcbd87-87ea-4dde-b91a-751901c37749 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:41.721237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-83bcbd87-87ea-4dde-b91a-751901c37749 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:41.721665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-83bcbd87-87ea-4dde-b91a-751901c37749 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:41.722338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-83bcbd87-87ea-4dde-b91a-751901c37749 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:41.722780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-83bcbd87-87ea-4dde-b91a-751901c37749 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:41.723196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-83bcbd87-87ea-4dde-b91a-751901c37749 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:41.786443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-83bcbd87-87ea-4dde-b91a-751901c37749 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:41.794207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-83bcbd87-87ea-4dde-b91a-751901c37749 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084090 Sep 01 05:24:41.794772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 737/1443] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:41 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:41.889223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c167e849-10e7-489b-9ef4-2dddcc0081ff tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:41.891402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c167e849-10e7-489b-9ef4-2dddcc0081ff tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:41.897961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c167e849-10e7-489b-9ef4-2dddcc0081ff tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:41.898441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c167e849-10e7-489b-9ef4-2dddcc0081ff tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:41.898875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c167e849-10e7-489b-9ef4-2dddcc0081ff tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:41.899560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c167e849-10e7-489b-9ef4-2dddcc0081ff tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:41.900002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c167e849-10e7-489b-9ef4-2dddcc0081ff tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:41.900419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c167e849-10e7-489b-9ef4-2dddcc0081ff tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:41.928854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b5193c45-f7b7-4419-b226-e4f8479777a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:41.930328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c167e849-10e7-489b-9ef4-2dddcc0081ff tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045772 Sep 01 05:24:41.930898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 707/1444] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:41.931047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b5193c45-f7b7-4419-b226-e4f8479777a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:41.938049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5193c45-f7b7-4419-b226-e4f8479777a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:41.938520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5193c45-f7b7-4419-b226-e4f8479777a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:41.938948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5193c45-f7b7-4419-b226-e4f8479777a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:41.939628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5193c45-f7b7-4419-b226-e4f8479777a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:41.940074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5193c45-f7b7-4419-b226-e4f8479777a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:41.940490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b5193c45-f7b7-4419-b226-e4f8479777a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:41.970044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b5193c45-f7b7-4419-b226-e4f8479777a8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Sep 01 05:24:41.970595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 738/1445] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:42.814803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e0831e92-5fad-4127-8831-da7e7ef3f58e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:42.815422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e0831e92-5fad-4127-8831-da7e7ef3f58e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:42.821784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0831e92-5fad-4127-8831-da7e7ef3f58e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:42.822263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0831e92-5fad-4127-8831-da7e7ef3f58e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:42.822693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0831e92-5fad-4127-8831-da7e7ef3f58e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:42.823522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0831e92-5fad-4127-8831-da7e7ef3f58e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:42.823823 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0831e92-5fad-4127-8831-da7e7ef3f58e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:42.824244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e0831e92-5fad-4127-8831-da7e7ef3f58e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:42.828153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:42.888021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e0831e92-5fad-4127-8831-da7e7ef3f58e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:42.896584 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e0831e92-5fad-4127-8831-da7e7ef3f58e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085586 Sep 01 05:24:42.897182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 708/1446] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:42 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:42.943817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8f08952c-a128-4151-86a5-c8c0a7dadbe0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:42.945980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8f08952c-a128-4151-86a5-c8c0a7dadbe0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:42.952218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f08952c-a128-4151-86a5-c8c0a7dadbe0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:42.952699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f08952c-a128-4151-86a5-c8c0a7dadbe0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:42.953167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f08952c-a128-4151-86a5-c8c0a7dadbe0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:42.953849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f08952c-a128-4151-86a5-c8c0a7dadbe0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:42.954299 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f08952c-a128-4151-86a5-c8c0a7dadbe0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:42.954720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f08952c-a128-4151-86a5-c8c0a7dadbe0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:42.982842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-16621804-26c0-4d0c-91c3-dedd53c79c42 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:42.984223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8f08952c-a128-4151-86a5-c8c0a7dadbe0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044804 Sep 01 05:24:42.984794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 739/1447] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:42.985055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-16621804-26c0-4d0c-91c3-dedd53c79c42 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:42.991073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16621804-26c0-4d0c-91c3-dedd53c79c42 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:42.991551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16621804-26c0-4d0c-91c3-dedd53c79c42 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:42.991988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16621804-26c0-4d0c-91c3-dedd53c79c42 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:42.992675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16621804-26c0-4d0c-91c3-dedd53c79c42 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:42.993157 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16621804-26c0-4d0c-91c3-dedd53c79c42 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:42.993581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16621804-26c0-4d0c-91c3-dedd53c79c42 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:43.023327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-16621804-26c0-4d0c-91c3-dedd53c79c42 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045033 Sep 01 05:24:43.023877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 709/1448] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:42 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:43.917855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-091e4196-e2f3-4742-af0b-523af1ca373e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:43.918478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-091e4196-e2f3-4742-af0b-523af1ca373e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:43.924426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-091e4196-e2f3-4742-af0b-523af1ca373e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:43.924949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-091e4196-e2f3-4742-af0b-523af1ca373e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:43.925388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-091e4196-e2f3-4742-af0b-523af1ca373e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:43.926077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-091e4196-e2f3-4742-af0b-523af1ca373e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:43.926533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-091e4196-e2f3-4742-af0b-523af1ca373e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:43.926953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-091e4196-e2f3-4742-af0b-523af1ca373e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:43.988582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-091e4196-e2f3-4742-af0b-523af1ca373e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:43.995653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-389d9b08-e25e-446d-9037-646dc34190e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:43.996439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-091e4196-e2f3-4742-af0b-523af1ca373e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083152 Sep 01 05:24:43.997039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 740/1449] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:43 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:43.998729 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-389d9b08-e25e-446d-9037-646dc34190e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:44.005308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-389d9b08-e25e-446d-9037-646dc34190e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:44.005795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-389d9b08-e25e-446d-9037-646dc34190e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:44.006208 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-389d9b08-e25e-446d-9037-646dc34190e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:44.006882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-389d9b08-e25e-446d-9037-646dc34190e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:44.007321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-389d9b08-e25e-446d-9037-646dc34190e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:44.007759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-389d9b08-e25e-446d-9037-646dc34190e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:44.035365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3a479c42-e0c0-4040-9cc7-e4d8edd81452 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:44.037426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-389d9b08-e25e-446d-9037-646dc34190e5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045739 Sep 01 05:24:44.037577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3a479c42-e0c0-4040-9cc7-e4d8edd81452 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:44.038181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 710/1450] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:24:44.044020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a479c42-e0c0-4040-9cc7-e4d8edd81452 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:44.044493 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a479c42-e0c0-4040-9cc7-e4d8edd81452 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:44.044957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a479c42-e0c0-4040-9cc7-e4d8edd81452 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:44.045641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a479c42-e0c0-4040-9cc7-e4d8edd81452 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:44.046087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a479c42-e0c0-4040-9cc7-e4d8edd81452 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:44.046511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a479c42-e0c0-4040-9cc7-e4d8edd81452 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:44.075134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3a479c42-e0c0-4040-9cc7-e4d8edd81452 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043557 Sep 01 05:24:44.075678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 741/1451] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:44 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:45.017054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-70a791c8-248b-4e03-aab6-44f1425cdb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:45.017663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-70a791c8-248b-4e03-aab6-44f1425cdb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:45.024093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-70a791c8-248b-4e03-aab6-44f1425cdb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:45.024594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-70a791c8-248b-4e03-aab6-44f1425cdb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:45.025048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-70a791c8-248b-4e03-aab6-44f1425cdb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:45.025722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-70a791c8-248b-4e03-aab6-44f1425cdb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:45.026161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-70a791c8-248b-4e03-aab6-44f1425cdb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:45.026652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-70a791c8-248b-4e03-aab6-44f1425cdb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:45.049714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ca19a5f7-9163-48cb-be9a-8ba536f73848 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:45.051875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ca19a5f7-9163-48cb-be9a-8ba536f73848 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:45.059066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca19a5f7-9163-48cb-be9a-8ba536f73848 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:45.059645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca19a5f7-9163-48cb-be9a-8ba536f73848 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:45.060078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca19a5f7-9163-48cb-be9a-8ba536f73848 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:45.060767 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca19a5f7-9163-48cb-be9a-8ba536f73848 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:45.061237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca19a5f7-9163-48cb-be9a-8ba536f73848 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:45.061656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca19a5f7-9163-48cb-be9a-8ba536f73848 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:45.090880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-70a791c8-248b-4e03-aab6-44f1425cdb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:45.094566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ca19a5f7-9163-48cb-be9a-8ba536f73848 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048755 Sep 01 05:24:45.095146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 742/1452] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:45 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:45.098649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-70a791c8-248b-4e03-aab6-44f1425cdb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085433 Sep 01 05:24:45.099469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 711/1453] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:45 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:45.099630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fd73b0de-d2d1-495b-af4a-9c34e6fcdefe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:45.101743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fd73b0de-d2d1-495b-af4a-9c34e6fcdefe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:45.107672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd73b0de-d2d1-495b-af4a-9c34e6fcdefe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:45.108147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd73b0de-d2d1-495b-af4a-9c34e6fcdefe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:45.108577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd73b0de-d2d1-495b-af4a-9c34e6fcdefe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:45.109284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd73b0de-d2d1-495b-af4a-9c34e6fcdefe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:45.109725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd73b0de-d2d1-495b-af4a-9c34e6fcdefe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:45.110141 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd73b0de-d2d1-495b-af4a-9c34e6fcdefe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:45.139037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fd73b0de-d2d1-495b-af4a-9c34e6fcdefe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042917 Sep 01 05:24:45.139581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 743/1454] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:46.107130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-247f0a25-74af-466b-8d93-598549137432 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:46.109332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-247f0a25-74af-466b-8d93-598549137432 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:46.115741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-247f0a25-74af-466b-8d93-598549137432 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:46.116216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-247f0a25-74af-466b-8d93-598549137432 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:46.116644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-247f0a25-74af-466b-8d93-598549137432 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:46.117363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-247f0a25-74af-466b-8d93-598549137432 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:46.117805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-247f0a25-74af-466b-8d93-598549137432 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:46.118216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-247f0a25-74af-466b-8d93-598549137432 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:46.118978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8e68ca7d-cc9a-4f5e-8bd3-885ba1da9e9b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:46.119596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8e68ca7d-cc9a-4f5e-8bd3-885ba1da9e9b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:46.126696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8e68ca7d-cc9a-4f5e-8bd3-885ba1da9e9b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:46.127187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8e68ca7d-cc9a-4f5e-8bd3-885ba1da9e9b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:46.127659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8e68ca7d-cc9a-4f5e-8bd3-885ba1da9e9b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:46.128352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8e68ca7d-cc9a-4f5e-8bd3-885ba1da9e9b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:46.128824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8e68ca7d-cc9a-4f5e-8bd3-885ba1da9e9b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:46.129279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8e68ca7d-cc9a-4f5e-8bd3-885ba1da9e9b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:46.149040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-247f0a25-74af-466b-8d93-598549137432 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045897 Sep 01 05:24:46.149527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 712/1455] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:46.154515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6456eb22-d4ea-47ea-900c-9af02198058a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:46.156607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6456eb22-d4ea-47ea-900c-9af02198058a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:46.162341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6456eb22-d4ea-47ea-900c-9af02198058a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:46.162812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6456eb22-d4ea-47ea-900c-9af02198058a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:46.163238 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6456eb22-d4ea-47ea-900c-9af02198058a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:46.163921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6456eb22-d4ea-47ea-900c-9af02198058a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:46.164365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6456eb22-d4ea-47ea-900c-9af02198058a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:46.164797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6456eb22-d4ea-47ea-900c-9af02198058a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:46.192094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8e68ca7d-cc9a-4f5e-8bd3-885ba1da9e9b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:46.195097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6456eb22-d4ea-47ea-900c-9af02198058a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044570 Sep 01 05:24:46.195669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 713/1456] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:46 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:46.201017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8e68ca7d-cc9a-4f5e-8bd3-885ba1da9e9b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085794 Sep 01 05:24:46.201573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 744/1457] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:46 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:47.161633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-61784da4-cf04-4ed2-8db7-6003c6acca19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:47.163695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-61784da4-cf04-4ed2-8db7-6003c6acca19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:47.170959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-61784da4-cf04-4ed2-8db7-6003c6acca19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:47.171445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-61784da4-cf04-4ed2-8db7-6003c6acca19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:47.171884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-61784da4-cf04-4ed2-8db7-6003c6acca19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:47.172569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-61784da4-cf04-4ed2-8db7-6003c6acca19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:47.173045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-61784da4-cf04-4ed2-8db7-6003c6acca19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:47.173467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-61784da4-cf04-4ed2-8db7-6003c6acca19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:47.202840 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-61784da4-cf04-4ed2-8db7-6003c6acca19 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045468 Sep 01 05:24:47.203399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 714/1458] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:47 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:47.207736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bf3e3991-a8c7-45da-a9c6-ecf325f785fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:47.209994 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bf3e3991-a8c7-45da-a9c6-ecf325f785fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:47.217166 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bf3e3991-a8c7-45da-a9c6-ecf325f785fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:47.217649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bf3e3991-a8c7-45da-a9c6-ecf325f785fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:47.218082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bf3e3991-a8c7-45da-a9c6-ecf325f785fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:47.218768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bf3e3991-a8c7-45da-a9c6-ecf325f785fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:47.219217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bf3e3991-a8c7-45da-a9c6-ecf325f785fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:47.219638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bf3e3991-a8c7-45da-a9c6-ecf325f785fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:47.221353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-eb57b169-1a8f-426a-a855-45a6db4509de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:47.221969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-eb57b169-1a8f-426a-a855-45a6db4509de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:47.227783 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb57b169-1a8f-426a-a855-45a6db4509de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:47.228263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb57b169-1a8f-426a-a855-45a6db4509de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:47.228700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb57b169-1a8f-426a-a855-45a6db4509de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:47.229409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb57b169-1a8f-426a-a855-45a6db4509de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:47.229897 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb57b169-1a8f-426a-a855-45a6db4509de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:47.230466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb57b169-1a8f-426a-a855-45a6db4509de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:47.244584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:47.250325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bf3e3991-a8c7-45da-a9c6-ecf325f785fe tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046515 Sep 01 05:24:47.250891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 745/1459] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:47.292686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-eb57b169-1a8f-426a-a855-45a6db4509de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:47.300300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-eb57b169-1a8f-426a-a855-45a6db4509de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082695 Sep 01 05:24:47.300874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 715/1460] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:47 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:48.215069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0ee0c668-0f0a-4ad1-a89e-bc5ab4c29012 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:48.217219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0ee0c668-0f0a-4ad1-a89e-bc5ab4c29012 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:48.223744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ee0c668-0f0a-4ad1-a89e-bc5ab4c29012 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:48.224224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ee0c668-0f0a-4ad1-a89e-bc5ab4c29012 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:48.224662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ee0c668-0f0a-4ad1-a89e-bc5ab4c29012 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:48.225376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ee0c668-0f0a-4ad1-a89e-bc5ab4c29012 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:48.225830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ee0c668-0f0a-4ad1-a89e-bc5ab4c29012 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:48.226253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0ee0c668-0f0a-4ad1-a89e-bc5ab4c29012 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:48.256410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0ee0c668-0f0a-4ad1-a89e-bc5ab4c29012 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045422 Sep 01 05:24:48.256996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 746/1461] 10.222.0.49 () {60 vars in 1343 bytes} [Thu Sep 1 05:24:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:48.262524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e774af9a-e780-4c4f-84ef-11c48a92cd52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:48.264826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e774af9a-e780-4c4f-84ef-11c48a92cd52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:48.271145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e774af9a-e780-4c4f-84ef-11c48a92cd52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:48.271619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e774af9a-e780-4c4f-84ef-11c48a92cd52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:48.272047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e774af9a-e780-4c4f-84ef-11c48a92cd52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:48.272726 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e774af9a-e780-4c4f-84ef-11c48a92cd52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:48.273197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e774af9a-e780-4c4f-84ef-11c48a92cd52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:48.273615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e774af9a-e780-4c4f-84ef-11c48a92cd52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:48.303843 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e774af9a-e780-4c4f-84ef-11c48a92cd52 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Sep 01 05:24:48.304404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 716/1462] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:48 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:48.320132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-946e2557-36b1-4adf-84b2-128926e18182 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:48.320750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-946e2557-36b1-4adf-84b2-128926e18182 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:48.326828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-946e2557-36b1-4adf-84b2-128926e18182 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:48.327314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-946e2557-36b1-4adf-84b2-128926e18182 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:48.327753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-946e2557-36b1-4adf-84b2-128926e18182 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:48.328435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-946e2557-36b1-4adf-84b2-128926e18182 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:48.328915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-946e2557-36b1-4adf-84b2-128926e18182 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:48.329341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-946e2557-36b1-4adf-84b2-128926e18182 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:48.391409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-946e2557-36b1-4adf-84b2-128926e18182 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:48.399089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-946e2557-36b1-4adf-84b2-128926e18182 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083068 Sep 01 05:24:48.399646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 747/1463] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:48 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:49.269408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fa7851cb-5fcb-4dfa-b2cf-4ef796e02f1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:49.271466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fa7851cb-5fcb-4dfa-b2cf-4ef796e02f1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:49.273865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=88 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:49.280042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa7851cb-5fcb-4dfa-b2cf-4ef796e02f1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:49.280594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa7851cb-5fcb-4dfa-b2cf-4ef796e02f1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:49.281049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa7851cb-5fcb-4dfa-b2cf-4ef796e02f1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:49.281727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa7851cb-5fcb-4dfa-b2cf-4ef796e02f1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:49.282248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa7851cb-5fcb-4dfa-b2cf-4ef796e02f1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:49.282675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa7851cb-5fcb-4dfa-b2cf-4ef796e02f1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:49.315990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e6b9e2a9-a901-46ef-a10b-7a66d0ea1c21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:49.318512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e6b9e2a9-a901-46ef-a10b-7a66d0ea1c21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:49.324842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e6b9e2a9-a901-46ef-a10b-7a66d0ea1c21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:49.325543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e6b9e2a9-a901-46ef-a10b-7a66d0ea1c21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:49.326157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e6b9e2a9-a901-46ef-a10b-7a66d0ea1c21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:49.326843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e6b9e2a9-a901-46ef-a10b-7a66d0ea1c21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:49.327299 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e6b9e2a9-a901-46ef-a10b-7a66d0ea1c21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:49.327718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e6b9e2a9-a901-46ef-a10b-7a66d0ea1c21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:49.364420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fa7851cb-5fcb-4dfa-b2cf-4ef796e02f1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "POST /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/action" status: 200 len: 37876 microversion: 2.20 time: 0.098518 Sep 01 05:24:49.366327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 717/1464] 10.222.0.49 () {62 vars in 1319 bytes} [Thu Sep 1 05:24:49 2022] POST /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf/action => generated 37876 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:24:49.369064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e6b9e2a9-a901-46ef-a10b-7a66d0ea1c21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056944 Sep 01 05:24:49.369656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 748/1465] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:49 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:49.421412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8b1c80e0-fc59-4f61-927b-a41eb23dc8f0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:49.422103 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8b1c80e0-fc59-4f61-927b-a41eb23dc8f0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:49.429983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b1c80e0-fc59-4f61-927b-a41eb23dc8f0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:49.430455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b1c80e0-fc59-4f61-927b-a41eb23dc8f0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:49.430888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b1c80e0-fc59-4f61-927b-a41eb23dc8f0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:49.431577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b1c80e0-fc59-4f61-927b-a41eb23dc8f0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:49.432025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b1c80e0-fc59-4f61-927b-a41eb23dc8f0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:49.432444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b1c80e0-fc59-4f61-927b-a41eb23dc8f0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:49.498703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8b1c80e0-fc59-4f61-927b-a41eb23dc8f0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:49.506964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8b1c80e0-fc59-4f61-927b-a41eb23dc8f0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.090137 Sep 01 05:24:49.507525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 718/1466] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:49 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:50.384468 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4a0f9649-1825-4c95-b2f3-a83cdb1045a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:50.386627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4a0f9649-1825-4c95-b2f3-a83cdb1045a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:50.393195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a0f9649-1825-4c95-b2f3-a83cdb1045a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:50.393672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a0f9649-1825-4c95-b2f3-a83cdb1045a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:50.394101 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a0f9649-1825-4c95-b2f3-a83cdb1045a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:50.394772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a0f9649-1825-4c95-b2f3-a83cdb1045a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:50.395213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a0f9649-1825-4c95-b2f3-a83cdb1045a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:50.395625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a0f9649-1825-4c95-b2f3-a83cdb1045a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:50.425987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4a0f9649-1825-4c95-b2f3-a83cdb1045a1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Sep 01 05:24:50.426534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 749/1467] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:50 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:50.532048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a0bb3035-ea3f-4261-8f58-15d01cdc4fa9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:50.532596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a0bb3035-ea3f-4261-8f58-15d01cdc4fa9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:50.539003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0bb3035-ea3f-4261-8f58-15d01cdc4fa9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:50.539487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0bb3035-ea3f-4261-8f58-15d01cdc4fa9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:50.539924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0bb3035-ea3f-4261-8f58-15d01cdc4fa9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:50.540612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0bb3035-ea3f-4261-8f58-15d01cdc4fa9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:50.541091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0bb3035-ea3f-4261-8f58-15d01cdc4fa9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:50.541517 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0bb3035-ea3f-4261-8f58-15d01cdc4fa9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:50.605551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a0bb3035-ea3f-4261-8f58-15d01cdc4fa9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:50.614082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a0bb3035-ea3f-4261-8f58-15d01cdc4fa9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086463 Sep 01 05:24:50.614648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 719/1468] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:50 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:51.438373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-444e9e81-ce38-4ed8-9399-f7ab7f3a422c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:51.440451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-444e9e81-ce38-4ed8-9399-f7ab7f3a422c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:51.447081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-444e9e81-ce38-4ed8-9399-f7ab7f3a422c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:51.447557 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-444e9e81-ce38-4ed8-9399-f7ab7f3a422c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:51.447988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-444e9e81-ce38-4ed8-9399-f7ab7f3a422c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:51.448661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-444e9e81-ce38-4ed8-9399-f7ab7f3a422c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:51.449210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-444e9e81-ce38-4ed8-9399-f7ab7f3a422c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:51.449625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-444e9e81-ce38-4ed8-9399-f7ab7f3a422c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:51.479688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-444e9e81-ce38-4ed8-9399-f7ab7f3a422c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045456 Sep 01 05:24:51.480236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 750/1469] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:51.633787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d77015dd-182c-421b-b1dd-11d47cc25c64 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:51.634436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d77015dd-182c-421b-b1dd-11d47cc25c64 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:51.641180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d77015dd-182c-421b-b1dd-11d47cc25c64 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:51.641659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d77015dd-182c-421b-b1dd-11d47cc25c64 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:51.642093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d77015dd-182c-421b-b1dd-11d47cc25c64 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:51.642832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d77015dd-182c-421b-b1dd-11d47cc25c64 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:51.643293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d77015dd-182c-421b-b1dd-11d47cc25c64 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:51.643712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d77015dd-182c-421b-b1dd-11d47cc25c64 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:51.706249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d77015dd-182c-421b-b1dd-11d47cc25c64 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:51.713911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d77015dd-182c-421b-b1dd-11d47cc25c64 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083942 Sep 01 05:24:51.714479 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 720/1470] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:51 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:52.492757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4ef80d57-94c8-4108-b026-1e370098de57 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:52.494903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4ef80d57-94c8-4108-b026-1e370098de57 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:52.502067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ef80d57-94c8-4108-b026-1e370098de57 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:52.502543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ef80d57-94c8-4108-b026-1e370098de57 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:52.502974 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ef80d57-94c8-4108-b026-1e370098de57 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:52.503649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ef80d57-94c8-4108-b026-1e370098de57 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:52.504092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ef80d57-94c8-4108-b026-1e370098de57 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:52.504503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ef80d57-94c8-4108-b026-1e370098de57 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:52.533048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4ef80d57-94c8-4108-b026-1e370098de57 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Sep 01 05:24:52.533597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 751/1471] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:52.736203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c471094c-eb03-486d-a6e0-1e69f10c9a6d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:52.736876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c471094c-eb03-486d-a6e0-1e69f10c9a6d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:52.743354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c471094c-eb03-486d-a6e0-1e69f10c9a6d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:52.743841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c471094c-eb03-486d-a6e0-1e69f10c9a6d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:52.744279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c471094c-eb03-486d-a6e0-1e69f10c9a6d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:52.744997 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c471094c-eb03-486d-a6e0-1e69f10c9a6d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:52.745455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c471094c-eb03-486d-a6e0-1e69f10c9a6d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:52.745879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c471094c-eb03-486d-a6e0-1e69f10c9a6d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:52.807192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c471094c-eb03-486d-a6e0-1e69f10c9a6d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:52.814931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c471094c-eb03-486d-a6e0-1e69f10c9a6d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083244 Sep 01 05:24:52.815493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 721/1472] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:52 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:53.546599 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-45b7a047-2a0b-41ec-ab29-baa165191da0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:53.548741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-45b7a047-2a0b-41ec-ab29-baa165191da0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:53.551108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=80 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:53.556271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b7a047-2a0b-41ec-ab29-baa165191da0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:53.556753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b7a047-2a0b-41ec-ab29-baa165191da0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:53.557214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b7a047-2a0b-41ec-ab29-baa165191da0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:53.557908 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b7a047-2a0b-41ec-ab29-baa165191da0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:53.558439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b7a047-2a0b-41ec-ab29-baa165191da0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:53.559134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45b7a047-2a0b-41ec-ab29-baa165191da0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:53.594558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-45b7a047-2a0b-41ec-ab29-baa165191da0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053059 Sep 01 05:24:53.595119 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 752/1473] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:53.839475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-727cffeb-a4f1-4399-a480-c34318ed19dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:53.840078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-727cffeb-a4f1-4399-a480-c34318ed19dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:53.847557 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-727cffeb-a4f1-4399-a480-c34318ed19dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:53.848700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-727cffeb-a4f1-4399-a480-c34318ed19dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:53.848700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-727cffeb-a4f1-4399-a480-c34318ed19dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:53.849287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-727cffeb-a4f1-4399-a480-c34318ed19dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:53.849625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-727cffeb-a4f1-4399-a480-c34318ed19dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:53.850057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-727cffeb-a4f1-4399-a480-c34318ed19dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:53.915709 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-727cffeb-a4f1-4399-a480-c34318ed19dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:53.923641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-727cffeb-a4f1-4399-a480-c34318ed19dd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088015 Sep 01 05:24:53.924544 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 722/1474] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:53 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:54.607235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1482876d-6f83-407f-8eef-6f74223bbaed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:54.609444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1482876d-6f83-407f-8eef-6f74223bbaed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:54.615856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1482876d-6f83-407f-8eef-6f74223bbaed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:54.616328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1482876d-6f83-407f-8eef-6f74223bbaed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:54.616755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1482876d-6f83-407f-8eef-6f74223bbaed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:54.617454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1482876d-6f83-407f-8eef-6f74223bbaed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:54.617898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1482876d-6f83-407f-8eef-6f74223bbaed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:54.618313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1482876d-6f83-407f-8eef-6f74223bbaed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:54.649214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1482876d-6f83-407f-8eef-6f74223bbaed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046121 Sep 01 05:24:54.649756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 753/1475] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:54.945008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7ba35ee3-1ea3-4092-bdc3-173205d951d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:54.945612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7ba35ee3-1ea3-4092-bdc3-173205d951d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:54.952375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7ba35ee3-1ea3-4092-bdc3-173205d951d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:54.952873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7ba35ee3-1ea3-4092-bdc3-173205d951d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:54.953301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7ba35ee3-1ea3-4092-bdc3-173205d951d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:54.953999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7ba35ee3-1ea3-4092-bdc3-173205d951d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:54.954441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7ba35ee3-1ea3-4092-bdc3-173205d951d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:54.954852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7ba35ee3-1ea3-4092-bdc3-173205d951d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:55.017429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7ba35ee3-1ea3-4092-bdc3-173205d951d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:55.025093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7ba35ee3-1ea3-4092-bdc3-173205d951d7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084277 Sep 01 05:24:55.025655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 723/1476] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:54 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:55.660901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5ef8603d-2db5-442a-a6b5-d870c0708a19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:55.663061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5ef8603d-2db5-442a-a6b5-d870c0708a19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:55.669850 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ef8603d-2db5-442a-a6b5-d870c0708a19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:55.670328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ef8603d-2db5-442a-a6b5-d870c0708a19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:55.670766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ef8603d-2db5-442a-a6b5-d870c0708a19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:55.671443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ef8603d-2db5-442a-a6b5-d870c0708a19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:55.671901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ef8603d-2db5-442a-a6b5-d870c0708a19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:55.672328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ef8603d-2db5-442a-a6b5-d870c0708a19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:55.702060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5ef8603d-2db5-442a-a6b5-d870c0708a19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Sep 01 05:24:55.702600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 754/1477] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:55 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:56.045661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8a557477-f15c-471e-b29c-3e22ff29c4a7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:56.046275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8a557477-f15c-471e-b29c-3e22ff29c4a7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:56.052707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a557477-f15c-471e-b29c-3e22ff29c4a7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:56.053239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a557477-f15c-471e-b29c-3e22ff29c4a7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:56.053669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a557477-f15c-471e-b29c-3e22ff29c4a7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:56.054349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a557477-f15c-471e-b29c-3e22ff29c4a7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:56.054797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a557477-f15c-471e-b29c-3e22ff29c4a7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:56.055215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a557477-f15c-471e-b29c-3e22ff29c4a7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:56.118495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8a557477-f15c-471e-b29c-3e22ff29c4a7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:56.126732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8a557477-f15c-471e-b29c-3e22ff29c4a7 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085163 Sep 01 05:24:56.127285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 724/1478] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:56 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:56.715850 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-87618e5c-1a2f-4bc0-884f-843d4ae52911 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:56.718571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-87618e5c-1a2f-4bc0-884f-843d4ae52911 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:56.725934 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-87618e5c-1a2f-4bc0-884f-843d4ae52911 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:56.726416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-87618e5c-1a2f-4bc0-884f-843d4ae52911 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:56.726848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-87618e5c-1a2f-4bc0-884f-843d4ae52911 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:56.727566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-87618e5c-1a2f-4bc0-884f-843d4ae52911 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:56.729071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-87618e5c-1a2f-4bc0-884f-843d4ae52911 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:56.729512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-87618e5c-1a2f-4bc0-884f-843d4ae52911 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:56.770022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-87618e5c-1a2f-4bc0-884f-843d4ae52911 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058418 Sep 01 05:24:56.770591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 755/1479] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:57.148012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dd33d627-a14a-4ce8-b131-ae401cd01177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:57.148622 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dd33d627-a14a-4ce8-b131-ae401cd01177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:57.155649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd33d627-a14a-4ce8-b131-ae401cd01177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:57.156119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd33d627-a14a-4ce8-b131-ae401cd01177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:57.156546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd33d627-a14a-4ce8-b131-ae401cd01177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:57.157245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd33d627-a14a-4ce8-b131-ae401cd01177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:57.157686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd33d627-a14a-4ce8-b131-ae401cd01177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:57.158097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd33d627-a14a-4ce8-b131-ae401cd01177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:57.160659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:57.220029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-dd33d627-a14a-4ce8-b131-ae401cd01177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:57.227920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dd33d627-a14a-4ce8-b131-ae401cd01177 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083835 Sep 01 05:24:57.228487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 725/1480] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:57 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:57.784256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-57dc862b-065e-4e01-948b-08e26ca712dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:57.786547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-57dc862b-065e-4e01-948b-08e26ca712dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:57.793014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-57dc862b-065e-4e01-948b-08e26ca712dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:57.793497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-57dc862b-065e-4e01-948b-08e26ca712dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:57.793930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-57dc862b-065e-4e01-948b-08e26ca712dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:57.795146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-57dc862b-065e-4e01-948b-08e26ca712dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:57.795590 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-57dc862b-065e-4e01-948b-08e26ca712dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:57.796012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-57dc862b-065e-4e01-948b-08e26ca712dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:57.825970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-57dc862b-065e-4e01-948b-08e26ca712dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Sep 01 05:24:57.826518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 756/1481] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:57 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:58.248804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4fd96674-77e5-4aae-ab57-f74ce14803e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:58.249354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4fd96674-77e5-4aae-ab57-f74ce14803e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:58.251317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:24:58.251445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c (ip 10.222.0.49) !!! Sep 01 05:24:58.258758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4fd96674-77e5-4aae-ab57-f74ce14803e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:58.259239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4fd96674-77e5-4aae-ab57-f74ce14803e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:58.259671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4fd96674-77e5-4aae-ab57-f74ce14803e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:58.260356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4fd96674-77e5-4aae-ab57-f74ce14803e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:58.260863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4fd96674-77e5-4aae-ab57-f74ce14803e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:58.261282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4fd96674-77e5-4aae-ab57-f74ce14803e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:58.325241 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4fd96674-77e5-4aae-ab57-f74ce14803e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:58.333373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4fd96674-77e5-4aae-ab57-f74ce14803e1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088899 Sep 01 05:24:58.333930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 726/1482] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:58 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:58.838467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b4efde92-dfe8-4403-9697-fbc19700345e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:58.840650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b4efde92-dfe8-4403-9697-fbc19700345e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:58.847528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4efde92-dfe8-4403-9697-fbc19700345e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:58.848007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4efde92-dfe8-4403-9697-fbc19700345e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:58.848444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4efde92-dfe8-4403-9697-fbc19700345e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:58.849156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4efde92-dfe8-4403-9697-fbc19700345e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:58.849606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4efde92-dfe8-4403-9697-fbc19700345e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:58.850025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4efde92-dfe8-4403-9697-fbc19700345e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:58.879227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b4efde92-dfe8-4403-9697-fbc19700345e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044795 Sep 01 05:24:58.880102 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 757/1483] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:58 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:59.354981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-21f4f9e7-2ee1-445b-843f-66e07c84543a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:59.355601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-21f4f9e7-2ee1-445b-843f-66e07c84543a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:59.363573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21f4f9e7-2ee1-445b-843f-66e07c84543a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.364082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21f4f9e7-2ee1-445b-843f-66e07c84543a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.364518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21f4f9e7-2ee1-445b-843f-66e07c84543a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:59.365235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21f4f9e7-2ee1-445b-843f-66e07c84543a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.365681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21f4f9e7-2ee1-445b-843f-66e07c84543a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.366098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21f4f9e7-2ee1-445b-843f-66e07c84543a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:59.432620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-21f4f9e7-2ee1-445b-843f-66e07c84543a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:59.441005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-21f4f9e7-2ee1-445b-843f-66e07c84543a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.090147 Sep 01 05:24:59.441570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 727/1484] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:59 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:59.551563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e0b3568b-76c4-4635-bf1b-f3ead49aa9e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:59.552078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e0b3568b-76c4-4635-bf1b-f3ead49aa9e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:59.557909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0b3568b-76c4-4635-bf1b-f3ead49aa9e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.558381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0b3568b-76c4-4635-bf1b-f3ead49aa9e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.558807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0b3568b-76c4-4635-bf1b-f3ead49aa9e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:59.559478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0b3568b-76c4-4635-bf1b-f3ead49aa9e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.559981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0b3568b-76c4-4635-bf1b-f3ead49aa9e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.560451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e0b3568b-76c4-4635-bf1b-f3ead49aa9e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:59.892061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-27394c97-dd99-4870-b645-92433d41d454 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:59.894270 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-27394c97-dd99-4870-b645-92433d41d454 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:59.900279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-27394c97-dd99-4870-b645-92433d41d454 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.900756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-27394c97-dd99-4870-b645-92433d41d454 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.901223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-27394c97-dd99-4870-b645-92433d41d454 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:59.901909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-27394c97-dd99-4870-b645-92433d41d454 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.902356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-27394c97-dd99-4870-b645-92433d41d454 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.902775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-27394c97-dd99-4870-b645-92433d41d454 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:59.932279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-27394c97-dd99-4870-b645-92433d41d454 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044856 Sep 01 05:24:59.932852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 728/1485] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:59 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:25:00.462668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c774362c-b58e-4b21-8d69-284adb36144a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:00.463357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c774362c-b58e-4b21-8d69-284adb36144a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:00.469766 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c774362c-b58e-4b21-8d69-284adb36144a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:00.470245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c774362c-b58e-4b21-8d69-284adb36144a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:00.470675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c774362c-b58e-4b21-8d69-284adb36144a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:00.471354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c774362c-b58e-4b21-8d69-284adb36144a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:00.471799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c774362c-b58e-4b21-8d69-284adb36144a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:00.472216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c774362c-b58e-4b21-8d69-284adb36144a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:00.535341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c774362c-b58e-4b21-8d69-284adb36144a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:00.543000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c774362c-b58e-4b21-8d69-284adb36144a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084251 Sep 01 05:25:00.543567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 729/1486] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:00 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:00.943896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8d5028e3-b2e1-465e-ba47-0aaafb565b27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:00.946016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8d5028e3-b2e1-465e-ba47-0aaafb565b27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:00.952515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d5028e3-b2e1-465e-ba47-0aaafb565b27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:00.953037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d5028e3-b2e1-465e-ba47-0aaafb565b27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:00.953454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d5028e3-b2e1-465e-ba47-0aaafb565b27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:00.954125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d5028e3-b2e1-465e-ba47-0aaafb565b27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:00.954562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d5028e3-b2e1-465e-ba47-0aaafb565b27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:00.954973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8d5028e3-b2e1-465e-ba47-0aaafb565b27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:00.983598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8d5028e3-b2e1-465e-ba47-0aaafb565b27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043985 Sep 01 05:25:00.984135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 730/1487] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:25:01.565539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d46342cb-8c54-466a-8ffa-68750fb12216 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:01.566181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d46342cb-8c54-466a-8ffa-68750fb12216 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:01.572749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d46342cb-8c54-466a-8ffa-68750fb12216 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:01.573250 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d46342cb-8c54-466a-8ffa-68750fb12216 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:01.573680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d46342cb-8c54-466a-8ffa-68750fb12216 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:01.574358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d46342cb-8c54-466a-8ffa-68750fb12216 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:01.574805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d46342cb-8c54-466a-8ffa-68750fb12216 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:01.575224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d46342cb-8c54-466a-8ffa-68750fb12216 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:01.639621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d46342cb-8c54-466a-8ffa-68750fb12216 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:01.647402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d46342cb-8c54-466a-8ffa-68750fb12216 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085728 Sep 01 05:25:01.647945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 731/1488] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:01 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:01.995844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9b70fc5f-0283-4e16-9589-d53a1e2fa480 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:01.998799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9b70fc5f-0283-4e16-9589-d53a1e2fa480 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:02.004707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b70fc5f-0283-4e16-9589-d53a1e2fa480 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.005214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b70fc5f-0283-4e16-9589-d53a1e2fa480 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.005641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b70fc5f-0283-4e16-9589-d53a1e2fa480 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.006317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b70fc5f-0283-4e16-9589-d53a1e2fa480 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.006760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b70fc5f-0283-4e16-9589-d53a1e2fa480 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.007172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b70fc5f-0283-4e16-9589-d53a1e2fa480 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.036267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9b70fc5f-0283-4e16-9589-d53a1e2fa480 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044536 Sep 01 05:25:02.036824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 732/1489] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:01 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:25:02.667634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5ea18596-f140-4308-9123-673c276f1ab0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:02.668254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5ea18596-f140-4308-9123-673c276f1ab0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:02.674697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ea18596-f140-4308-9123-673c276f1ab0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.675174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ea18596-f140-4308-9123-673c276f1ab0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.675607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ea18596-f140-4308-9123-673c276f1ab0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.676291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ea18596-f140-4308-9123-673c276f1ab0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.676740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ea18596-f140-4308-9123-673c276f1ab0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.677188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ea18596-f140-4308-9123-673c276f1ab0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.742104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5ea18596-f140-4308-9123-673c276f1ab0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:02.750329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5ea18596-f140-4308-9123-673c276f1ab0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086568 Sep 01 05:25:02.750894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 733/1490] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:02 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:03.048817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f067dadd-30b8-43da-999b-2fe772b10044 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:03.050885 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f067dadd-30b8-43da-999b-2fe772b10044 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:03.056860 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f067dadd-30b8-43da-999b-2fe772b10044 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:03.057334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f067dadd-30b8-43da-999b-2fe772b10044 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:03.057761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f067dadd-30b8-43da-999b-2fe772b10044 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:03.058455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f067dadd-30b8-43da-999b-2fe772b10044 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:03.058895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f067dadd-30b8-43da-999b-2fe772b10044 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:03.059307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f067dadd-30b8-43da-999b-2fe772b10044 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:03.089213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f067dadd-30b8-43da-999b-2fe772b10044 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Sep 01 05:25:03.089757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 734/1491] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:03 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:03.771378 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cdff8a65-2f6f-4321-af3d-ae1d4d4ac719 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:03.772028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cdff8a65-2f6f-4321-af3d-ae1d4d4ac719 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:03.778354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdff8a65-2f6f-4321-af3d-ae1d4d4ac719 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:03.779465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdff8a65-2f6f-4321-af3d-ae1d4d4ac719 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:03.779893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdff8a65-2f6f-4321-af3d-ae1d4d4ac719 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:03.780560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdff8a65-2f6f-4321-af3d-ae1d4d4ac719 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:03.781047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdff8a65-2f6f-4321-af3d-ae1d4d4ac719 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:03.781444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdff8a65-2f6f-4321-af3d-ae1d4d4ac719 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:03.845968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cdff8a65-2f6f-4321-af3d-ae1d4d4ac719 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:03.853697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cdff8a65-2f6f-4321-af3d-ae1d4d4ac719 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086172 Sep 01 05:25:03.854249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 735/1492] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:03 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:04.101487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d3905113-dc97-4d3a-86c2-657075452f43 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:04.103641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d3905113-dc97-4d3a-86c2-657075452f43 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:04.109690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3905113-dc97-4d3a-86c2-657075452f43 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:04.110163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3905113-dc97-4d3a-86c2-657075452f43 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:04.110591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3905113-dc97-4d3a-86c2-657075452f43 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:04.111263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3905113-dc97-4d3a-86c2-657075452f43 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:04.111706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3905113-dc97-4d3a-86c2-657075452f43 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:04.112122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3905113-dc97-4d3a-86c2-657075452f43 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:04.141577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d3905113-dc97-4d3a-86c2-657075452f43 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Sep 01 05:25:04.142116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 736/1493] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:25:04.874180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-67d6bc24-aeb4-4945-a1ba-7e76166caa4f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:04.874800 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-67d6bc24-aeb4-4945-a1ba-7e76166caa4f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:04.881201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67d6bc24-aeb4-4945-a1ba-7e76166caa4f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:04.881682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67d6bc24-aeb4-4945-a1ba-7e76166caa4f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:04.882108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67d6bc24-aeb4-4945-a1ba-7e76166caa4f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:04.882787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67d6bc24-aeb4-4945-a1ba-7e76166caa4f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:04.883232 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67d6bc24-aeb4-4945-a1ba-7e76166caa4f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:04.883650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67d6bc24-aeb4-4945-a1ba-7e76166caa4f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:04.953849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-67d6bc24-aeb4-4945-a1ba-7e76166caa4f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:04.961648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-67d6bc24-aeb4-4945-a1ba-7e76166caa4f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.091395 Sep 01 05:25:04.962218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 737/1494] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:04 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:05.153758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-795b8bf9-7faf-4c21-8c89-ace36adf63f3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:05.156644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-795b8bf9-7faf-4c21-8c89-ace36adf63f3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:05.162590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-795b8bf9-7faf-4c21-8c89-ace36adf63f3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:05.163063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-795b8bf9-7faf-4c21-8c89-ace36adf63f3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:05.163477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-795b8bf9-7faf-4c21-8c89-ace36adf63f3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:05.164147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-795b8bf9-7faf-4c21-8c89-ace36adf63f3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:05.164585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-795b8bf9-7faf-4c21-8c89-ace36adf63f3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:05.165024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-795b8bf9-7faf-4c21-8c89-ace36adf63f3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:05.194165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-795b8bf9-7faf-4c21-8c89-ace36adf63f3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044101 Sep 01 05:25:05.194707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 738/1495] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:05 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:25:05.983179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-eb28de6e-7b47-4792-9239-0eff7ed9dff6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:05.984683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-eb28de6e-7b47-4792-9239-0eff7ed9dff6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:05.990811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb28de6e-7b47-4792-9239-0eff7ed9dff6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:05.991293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb28de6e-7b47-4792-9239-0eff7ed9dff6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:05.991728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb28de6e-7b47-4792-9239-0eff7ed9dff6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:05.992415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb28de6e-7b47-4792-9239-0eff7ed9dff6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:05.992895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb28de6e-7b47-4792-9239-0eff7ed9dff6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:05.993318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb28de6e-7b47-4792-9239-0eff7ed9dff6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:06.054831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-eb28de6e-7b47-4792-9239-0eff7ed9dff6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:06.063195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-eb28de6e-7b47-4792-9239-0eff7ed9dff6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084019 Sep 01 05:25:06.063777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 739/1496] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:05 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:06.206308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-40045b28-b82d-476a-a115-273c835af46c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:06.208360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-40045b28-b82d-476a-a115-273c835af46c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:06.214218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40045b28-b82d-476a-a115-273c835af46c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:06.214696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40045b28-b82d-476a-a115-273c835af46c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:06.215129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40045b28-b82d-476a-a115-273c835af46c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:06.215814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40045b28-b82d-476a-a115-273c835af46c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:06.216260 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40045b28-b82d-476a-a115-273c835af46c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:06.216679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40045b28-b82d-476a-a115-273c835af46c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:06.245772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-40045b28-b82d-476a-a115-273c835af46c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043384 Sep 01 05:25:06.246328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 740/1497] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:06 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:25:07.083950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f2f56e60-c0e9-40f7-ae1e-56474b8ea107 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:07.084605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f2f56e60-c0e9-40f7-ae1e-56474b8ea107 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:07.090942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2f56e60-c0e9-40f7-ae1e-56474b8ea107 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:07.091418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2f56e60-c0e9-40f7-ae1e-56474b8ea107 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:07.091847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2f56e60-c0e9-40f7-ae1e-56474b8ea107 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:07.092525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2f56e60-c0e9-40f7-ae1e-56474b8ea107 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:07.093000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2f56e60-c0e9-40f7-ae1e-56474b8ea107 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:07.093446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2f56e60-c0e9-40f7-ae1e-56474b8ea107 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:07.155036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f2f56e60-c0e9-40f7-ae1e-56474b8ea107 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:07.157768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:07.164494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f2f56e60-c0e9-40f7-ae1e-56474b8ea107 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084503 Sep 01 05:25:07.165121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 741/1498] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:07 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:07.259297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8bfee860-e8c9-439d-9aca-2abce68e1a76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:07.261468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8bfee860-e8c9-439d-9aca-2abce68e1a76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:07.268122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8bfee860-e8c9-439d-9aca-2abce68e1a76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:07.268601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8bfee860-e8c9-439d-9aca-2abce68e1a76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:07.269070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8bfee860-e8c9-439d-9aca-2abce68e1a76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:07.269756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8bfee860-e8c9-439d-9aca-2abce68e1a76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:07.270204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8bfee860-e8c9-439d-9aca-2abce68e1a76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:07.270624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8bfee860-e8c9-439d-9aca-2abce68e1a76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:07.301770 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8bfee860-e8c9-439d-9aca-2abce68e1a76 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046453 Sep 01 05:25:07.302317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 742/1499] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:07 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:25:08.186354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-57100f05-c1f6-4b35-9176-5bd9f2dc1a66 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:08.186991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-57100f05-c1f6-4b35-9176-5bd9f2dc1a66 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:08.194237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-57100f05-c1f6-4b35-9176-5bd9f2dc1a66 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:08.194721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-57100f05-c1f6-4b35-9176-5bd9f2dc1a66 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:08.195154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-57100f05-c1f6-4b35-9176-5bd9f2dc1a66 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:08.195833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-57100f05-c1f6-4b35-9176-5bd9f2dc1a66 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:08.196278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-57100f05-c1f6-4b35-9176-5bd9f2dc1a66 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:08.196697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-57100f05-c1f6-4b35-9176-5bd9f2dc1a66 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:08.261603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-57100f05-c1f6-4b35-9176-5bd9f2dc1a66 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:08.269406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-57100f05-c1f6-4b35-9176-5bd9f2dc1a66 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086991 Sep 01 05:25:08.269971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 743/1500] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:08 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:08.314707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c0109d34-ce39-420b-8548-c33cbf2073cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:08.316854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c0109d34-ce39-420b-8548-c33cbf2073cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:08.322914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c0109d34-ce39-420b-8548-c33cbf2073cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:08.323388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c0109d34-ce39-420b-8548-c33cbf2073cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:08.323814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c0109d34-ce39-420b-8548-c33cbf2073cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:08.324487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c0109d34-ce39-420b-8548-c33cbf2073cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:08.324963 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c0109d34-ce39-420b-8548-c33cbf2073cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:08.325377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c0109d34-ce39-420b-8548-c33cbf2073cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:08.355160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c0109d34-ce39-420b-8548-c33cbf2073cc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045307 Sep 01 05:25:08.355697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 744/1501] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:08 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:25:09.290522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-acc97214-6c1c-4d42-9476-2a2d0195186a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:09.291159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-acc97214-6c1c-4d42-9476-2a2d0195186a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:09.297561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acc97214-6c1c-4d42-9476-2a2d0195186a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:09.298042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acc97214-6c1c-4d42-9476-2a2d0195186a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:09.298476 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acc97214-6c1c-4d42-9476-2a2d0195186a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:09.299156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acc97214-6c1c-4d42-9476-2a2d0195186a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:09.299607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acc97214-6c1c-4d42-9476-2a2d0195186a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:09.300028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acc97214-6c1c-4d42-9476-2a2d0195186a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:09.363617 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-acc97214-6c1c-4d42-9476-2a2d0195186a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:09.372152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-acc97214-6c1c-4d42-9476-2a2d0195186a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085764 Sep 01 05:25:09.372719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 745/1502] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:09 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:09.378037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ba8ef6bd-1114-47e9-89d2-999775181588 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:09.380127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ba8ef6bd-1114-47e9-89d2-999775181588 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:09.385669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ba8ef6bd-1114-47e9-89d2-999775181588 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:09.386146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ba8ef6bd-1114-47e9-89d2-999775181588 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:09.386577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ba8ef6bd-1114-47e9-89d2-999775181588 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:09.387255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ba8ef6bd-1114-47e9-89d2-999775181588 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:09.387707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ba8ef6bd-1114-47e9-89d2-999775181588 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:09.388124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ba8ef6bd-1114-47e9-89d2-999775181588 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:09.418027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ba8ef6bd-1114-47e9-89d2-999775181588 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044305 Sep 01 05:25:09.418573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 746/1503] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:09 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:09.555927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=13 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:09.578951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=77 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:10.393575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fc8c2a1f-ec3e-4987-9889-7d8142e19331 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:10.394225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fc8c2a1f-ec3e-4987-9889-7d8142e19331 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:10.400657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc8c2a1f-ec3e-4987-9889-7d8142e19331 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:10.401162 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc8c2a1f-ec3e-4987-9889-7d8142e19331 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:10.401591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc8c2a1f-ec3e-4987-9889-7d8142e19331 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:10.402267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc8c2a1f-ec3e-4987-9889-7d8142e19331 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:10.402718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc8c2a1f-ec3e-4987-9889-7d8142e19331 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:10.403167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc8c2a1f-ec3e-4987-9889-7d8142e19331 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:10.464546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fc8c2a1f-ec3e-4987-9889-7d8142e19331 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:10.472284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fc8c2a1f-ec3e-4987-9889-7d8142e19331 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082702 Sep 01 05:25:10.472857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 747/1504] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:10 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:10.477308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c4591234-346c-4167-8270-5f0037814bee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:10.479405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c4591234-346c-4167-8270-5f0037814bee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:10.485665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4591234-346c-4167-8270-5f0037814bee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:10.486146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4591234-346c-4167-8270-5f0037814bee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:10.486575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4591234-346c-4167-8270-5f0037814bee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:10.487257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4591234-346c-4167-8270-5f0037814bee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:10.487702 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4591234-346c-4167-8270-5f0037814bee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:10.488121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4591234-346c-4167-8270-5f0037814bee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:10.517286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c4591234-346c-4167-8270-5f0037814bee tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043382 Sep 01 05:25:10.517838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 748/1505] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:11.493804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-30fc7812-4bad-4ff4-99a9-e88536bd5517 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:11.494506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-30fc7812-4bad-4ff4-99a9-e88536bd5517 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:11.501714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30fc7812-4bad-4ff4-99a9-e88536bd5517 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:11.502185 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30fc7812-4bad-4ff4-99a9-e88536bd5517 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:11.502613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30fc7812-4bad-4ff4-99a9-e88536bd5517 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:11.503286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30fc7812-4bad-4ff4-99a9-e88536bd5517 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:11.503727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30fc7812-4bad-4ff4-99a9-e88536bd5517 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:11.504142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30fc7812-4bad-4ff4-99a9-e88536bd5517 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:11.564338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-30fc7812-4bad-4ff4-99a9-e88536bd5517 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:11.572363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-30fc7812-4bad-4ff4-99a9-e88536bd5517 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082399 Sep 01 05:25:11.572955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 749/1506] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:11 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:11.577435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f1b7e387-8f11-4297-8655-1d7ceb840180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:11.580387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f1b7e387-8f11-4297-8655-1d7ceb840180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:11.586051 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f1b7e387-8f11-4297-8655-1d7ceb840180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:11.586534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f1b7e387-8f11-4297-8655-1d7ceb840180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:11.586976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f1b7e387-8f11-4297-8655-1d7ceb840180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:11.587660 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f1b7e387-8f11-4297-8655-1d7ceb840180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:11.588115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f1b7e387-8f11-4297-8655-1d7ceb840180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:11.588541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f1b7e387-8f11-4297-8655-1d7ceb840180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:11.617211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f1b7e387-8f11-4297-8655-1d7ceb840180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043243 Sep 01 05:25:11.617758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 750/1507] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:11 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:12.596004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1f5f8d65-a6e9-4ae4-a4fd-c3a850a31bdf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:12.596666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1f5f8d65-a6e9-4ae4-a4fd-c3a850a31bdf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:12.603102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f5f8d65-a6e9-4ae4-a4fd-c3a850a31bdf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:12.603583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f5f8d65-a6e9-4ae4-a4fd-c3a850a31bdf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:12.604014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f5f8d65-a6e9-4ae4-a4fd-c3a850a31bdf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:12.604689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f5f8d65-a6e9-4ae4-a4fd-c3a850a31bdf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:12.605174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f5f8d65-a6e9-4ae4-a4fd-c3a850a31bdf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:12.605591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f5f8d65-a6e9-4ae4-a4fd-c3a850a31bdf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:12.669495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1f5f8d65-a6e9-4ae4-a4fd-c3a850a31bdf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:12.677574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1f5f8d65-a6e9-4ae4-a4fd-c3a850a31bdf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086766 Sep 01 05:25:12.678138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 751/1508] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:12 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:12.682577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f0fe5497-f15a-4f08-926e-c0c5451c501c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:12.684701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f0fe5497-f15a-4f08-926e-c0c5451c501c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:12.690703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0fe5497-f15a-4f08-926e-c0c5451c501c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:12.691208 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0fe5497-f15a-4f08-926e-c0c5451c501c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:12.691638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0fe5497-f15a-4f08-926e-c0c5451c501c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:12.692349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0fe5497-f15a-4f08-926e-c0c5451c501c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:12.692822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0fe5497-f15a-4f08-926e-c0c5451c501c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:12.693244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0fe5497-f15a-4f08-926e-c0c5451c501c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:12.724013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f0fe5497-f15a-4f08-926e-c0c5451c501c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Sep 01 05:25:12.724563 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 752/1509] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:12 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:13.698414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0de8f180-7f8b-40e8-93f9-41987a813055 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:13.699020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0de8f180-7f8b-40e8-93f9-41987a813055 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:13.706190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0de8f180-7f8b-40e8-93f9-41987a813055 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:13.706660 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0de8f180-7f8b-40e8-93f9-41987a813055 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:13.707087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0de8f180-7f8b-40e8-93f9-41987a813055 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:13.707763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0de8f180-7f8b-40e8-93f9-41987a813055 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:13.708202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0de8f180-7f8b-40e8-93f9-41987a813055 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:13.708614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0de8f180-7f8b-40e8-93f9-41987a813055 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:13.771533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0de8f180-7f8b-40e8-93f9-41987a813055 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:13.779163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0de8f180-7f8b-40e8-93f9-41987a813055 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084815 Sep 01 05:25:13.779733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 753/1510] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:13 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:13.784246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c61566c1-53ca-4954-8935-a27cb2c7fee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:13.786367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c61566c1-53ca-4954-8935-a27cb2c7fee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:13.791927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c61566c1-53ca-4954-8935-a27cb2c7fee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:13.792404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c61566c1-53ca-4954-8935-a27cb2c7fee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:13.792879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c61566c1-53ca-4954-8935-a27cb2c7fee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:13.793564 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c61566c1-53ca-4954-8935-a27cb2c7fee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:13.794017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c61566c1-53ca-4954-8935-a27cb2c7fee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:13.794439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c61566c1-53ca-4954-8935-a27cb2c7fee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:13.823777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c61566c1-53ca-4954-8935-a27cb2c7fee0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 Sep 01 05:25:13.824362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 754/1511] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:14.800231 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b5603363-f5b9-447d-801e-93f010502689 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:14.800891 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b5603363-f5b9-447d-801e-93f010502689 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:14.807350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5603363-f5b9-447d-801e-93f010502689 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:14.807820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5603363-f5b9-447d-801e-93f010502689 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:14.808247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5603363-f5b9-447d-801e-93f010502689 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:14.808950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5603363-f5b9-447d-801e-93f010502689 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:14.809395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5603363-f5b9-447d-801e-93f010502689 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:14.809808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5603363-f5b9-447d-801e-93f010502689 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:14.871216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b5603363-f5b9-447d-801e-93f010502689 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:14.879429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b5603363-f5b9-447d-801e-93f010502689 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083137 Sep 01 05:25:14.879990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 755/1512] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:14 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:14.884440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b0d9dacb-dfcb-4e2c-840b-be22c6b3d6a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:14.886570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b0d9dacb-dfcb-4e2c-840b-be22c6b3d6a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:14.892260 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0d9dacb-dfcb-4e2c-840b-be22c6b3d6a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:14.892740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0d9dacb-dfcb-4e2c-840b-be22c6b3d6a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:14.893205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0d9dacb-dfcb-4e2c-840b-be22c6b3d6a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:14.893894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0d9dacb-dfcb-4e2c-840b-be22c6b3d6a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:14.894344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0d9dacb-dfcb-4e2c-840b-be22c6b3d6a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:14.894765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0d9dacb-dfcb-4e2c-840b-be22c6b3d6a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:14.924198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b0d9dacb-dfcb-4e2c-840b-be22c6b3d6a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043189 Sep 01 05:25:14.924748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 756/1513] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:14 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:15.900491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e583fbe2-46ad-4b90-85ff-746c35c6542d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:15.901148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e583fbe2-46ad-4b90-85ff-746c35c6542d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:15.908149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e583fbe2-46ad-4b90-85ff-746c35c6542d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:15.908630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e583fbe2-46ad-4b90-85ff-746c35c6542d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:15.909098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e583fbe2-46ad-4b90-85ff-746c35c6542d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:15.909785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e583fbe2-46ad-4b90-85ff-746c35c6542d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:15.910234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e583fbe2-46ad-4b90-85ff-746c35c6542d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:15.910653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e583fbe2-46ad-4b90-85ff-746c35c6542d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:15.972751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e583fbe2-46ad-4b90-85ff-746c35c6542d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:15.980366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e583fbe2-46ad-4b90-85ff-746c35c6542d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083749 Sep 01 05:25:15.980958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 757/1514] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:15 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:15.986387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-16f14816-bfff-422e-8df6-1651efa95e98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:15.988498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-16f14816-bfff-422e-8df6-1651efa95e98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:15.994023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16f14816-bfff-422e-8df6-1651efa95e98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:15.994495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16f14816-bfff-422e-8df6-1651efa95e98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:15.994925 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16f14816-bfff-422e-8df6-1651efa95e98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:15.995609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16f14816-bfff-422e-8df6-1651efa95e98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:15.996057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16f14816-bfff-422e-8df6-1651efa95e98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:15.996484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-16f14816-bfff-422e-8df6-1651efa95e98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:16.009669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:16.025903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-16f14816-bfff-422e-8df6-1651efa95e98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Sep 01 05:25:16.026453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 758/1515] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:17.001601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-22b0e87a-eb78-4bd9-a6a2-0cb14ad1cb83 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:17.002262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-22b0e87a-eb78-4bd9-a6a2-0cb14ad1cb83 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:17.008558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22b0e87a-eb78-4bd9-a6a2-0cb14ad1cb83 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:17.009086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22b0e87a-eb78-4bd9-a6a2-0cb14ad1cb83 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:17.009510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22b0e87a-eb78-4bd9-a6a2-0cb14ad1cb83 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:17.010271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22b0e87a-eb78-4bd9-a6a2-0cb14ad1cb83 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:17.010722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22b0e87a-eb78-4bd9-a6a2-0cb14ad1cb83 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:17.011142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22b0e87a-eb78-4bd9-a6a2-0cb14ad1cb83 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:17.074802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-22b0e87a-eb78-4bd9-a6a2-0cb14ad1cb83 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:17.083270 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-22b0e87a-eb78-4bd9-a6a2-0cb14ad1cb83 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086136 Sep 01 05:25:17.083831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 759/1516] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:16 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:17.088330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-490a6926-ccd6-42f9-86ad-2befd2e3e5c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:17.090440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-490a6926-ccd6-42f9-86ad-2befd2e3e5c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:17.096316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-490a6926-ccd6-42f9-86ad-2befd2e3e5c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:17.096840 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-490a6926-ccd6-42f9-86ad-2befd2e3e5c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:17.097284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-490a6926-ccd6-42f9-86ad-2befd2e3e5c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:17.097976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-490a6926-ccd6-42f9-86ad-2befd2e3e5c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:17.098428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-490a6926-ccd6-42f9-86ad-2befd2e3e5c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:17.098880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-490a6926-ccd6-42f9-86ad-2befd2e3e5c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:17.129219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-490a6926-ccd6-42f9-86ad-2befd2e3e5c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Sep 01 05:25:17.129778 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 760/1517] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:17 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:18.104265 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7d6ccd72-85a7-4837-94b0-ba9121d6dbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:18.104914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7d6ccd72-85a7-4837-94b0-ba9121d6dbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:18.111583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d6ccd72-85a7-4837-94b0-ba9121d6dbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:18.112052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d6ccd72-85a7-4837-94b0-ba9121d6dbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:18.112484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d6ccd72-85a7-4837-94b0-ba9121d6dbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:18.113212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d6ccd72-85a7-4837-94b0-ba9121d6dbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:18.113657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d6ccd72-85a7-4837-94b0-ba9121d6dbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:18.114075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d6ccd72-85a7-4837-94b0-ba9121d6dbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:18.176536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7d6ccd72-85a7-4837-94b0-ba9121d6dbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:18.184239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7d6ccd72-85a7-4837-94b0-ba9121d6dbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083817 Sep 01 05:25:18.184808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 761/1518] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:18 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:18.189502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2e82bda7-7229-478d-8767-0d5689da956b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:18.191593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2e82bda7-7229-478d-8767-0d5689da956b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:18.197371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e82bda7-7229-478d-8767-0d5689da956b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:18.197852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e82bda7-7229-478d-8767-0d5689da956b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:18.198281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e82bda7-7229-478d-8767-0d5689da956b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:18.198961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e82bda7-7229-478d-8767-0d5689da956b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:18.199407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e82bda7-7229-478d-8767-0d5689da956b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:18.199828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e82bda7-7229-478d-8767-0d5689da956b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:18.229822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2e82bda7-7229-478d-8767-0d5689da956b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 Sep 01 05:25:18.230371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 762/1519] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:18 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:19.204443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2fdebddb-766f-4c60-909b-f312dbaf423b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:19.205154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2fdebddb-766f-4c60-909b-f312dbaf423b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:19.211495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fdebddb-766f-4c60-909b-f312dbaf423b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:19.211973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fdebddb-766f-4c60-909b-f312dbaf423b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:19.212404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fdebddb-766f-4c60-909b-f312dbaf423b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:19.213116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fdebddb-766f-4c60-909b-f312dbaf423b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:19.213566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fdebddb-766f-4c60-909b-f312dbaf423b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:19.213982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fdebddb-766f-4c60-909b-f312dbaf423b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:19.275254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2fdebddb-766f-4c60-909b-f312dbaf423b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:19.283796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2fdebddb-766f-4c60-909b-f312dbaf423b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083616 Sep 01 05:25:19.284357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 763/1520] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:19 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:19.288917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fc6a9b03-d94d-483e-8eea-ec1d2463d1de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:19.291025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fc6a9b03-d94d-483e-8eea-ec1d2463d1de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:19.292659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=94 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:19.299039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc6a9b03-d94d-483e-8eea-ec1d2463d1de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:19.299517 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc6a9b03-d94d-483e-8eea-ec1d2463d1de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:19.299944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc6a9b03-d94d-483e-8eea-ec1d2463d1de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:19.300622 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc6a9b03-d94d-483e-8eea-ec1d2463d1de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:19.301101 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc6a9b03-d94d-483e-8eea-ec1d2463d1de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:19.301520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc6a9b03-d94d-483e-8eea-ec1d2463d1de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:19.330794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fc6a9b03-d94d-483e-8eea-ec1d2463d1de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Sep 01 05:25:19.331341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 764/1521] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:19 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:20.304977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dd56fde2-11fa-471d-b47f-84b20e179123 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:20.305626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dd56fde2-11fa-471d-b47f-84b20e179123 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:20.311858 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd56fde2-11fa-471d-b47f-84b20e179123 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:20.312332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd56fde2-11fa-471d-b47f-84b20e179123 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:20.313525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd56fde2-11fa-471d-b47f-84b20e179123 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:20.314112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd56fde2-11fa-471d-b47f-84b20e179123 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:20.314559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd56fde2-11fa-471d-b47f-84b20e179123 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:20.314982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd56fde2-11fa-471d-b47f-84b20e179123 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:20.376475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-dd56fde2-11fa-471d-b47f-84b20e179123 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:20.384176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dd56fde2-11fa-471d-b47f-84b20e179123 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083165 Sep 01 05:25:20.384737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 765/1522] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:20 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:20.389290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bfb7da65-59fa-489b-943f-57ff22c3b09d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:20.391395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bfb7da65-59fa-489b-943f-57ff22c3b09d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:20.397091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfb7da65-59fa-489b-943f-57ff22c3b09d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:20.397620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfb7da65-59fa-489b-943f-57ff22c3b09d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:20.398047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfb7da65-59fa-489b-943f-57ff22c3b09d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:20.398727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfb7da65-59fa-489b-943f-57ff22c3b09d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:20.399200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfb7da65-59fa-489b-943f-57ff22c3b09d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:20.399615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfb7da65-59fa-489b-943f-57ff22c3b09d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:20.429111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bfb7da65-59fa-489b-943f-57ff22c3b09d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Sep 01 05:25:20.429661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 766/1523] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:20 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:21.404358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a33526fe-4dd4-4828-ab55-180f1f467b69 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:21.405085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a33526fe-4dd4-4828-ab55-180f1f467b69 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:21.411937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a33526fe-4dd4-4828-ab55-180f1f467b69 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:21.412440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a33526fe-4dd4-4828-ab55-180f1f467b69 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:21.412892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a33526fe-4dd4-4828-ab55-180f1f467b69 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:21.413574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a33526fe-4dd4-4828-ab55-180f1f467b69 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:21.414015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a33526fe-4dd4-4828-ab55-180f1f467b69 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:21.414426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a33526fe-4dd4-4828-ab55-180f1f467b69 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:21.480338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a33526fe-4dd4-4828-ab55-180f1f467b69 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:21.488709 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a33526fe-4dd4-4828-ab55-180f1f467b69 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088215 Sep 01 05:25:21.489289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 767/1524] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:21 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:21.493733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e7a10579-3889-46de-90aa-d51c0d576a9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:21.495854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e7a10579-3889-46de-90aa-d51c0d576a9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:21.501724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7a10579-3889-46de-90aa-d51c0d576a9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:21.502202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7a10579-3889-46de-90aa-d51c0d576a9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:21.502629 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7a10579-3889-46de-90aa-d51c0d576a9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:21.503304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7a10579-3889-46de-90aa-d51c0d576a9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:21.503751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7a10579-3889-46de-90aa-d51c0d576a9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:21.504172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7a10579-3889-46de-90aa-d51c0d576a9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:21.533087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e7a10579-3889-46de-90aa-d51c0d576a9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042796 Sep 01 05:25:21.533614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 768/1525] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:21 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:22.508835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6682ce51-b66c-49ed-b1e2-27d3ce7673fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:22.509515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6682ce51-b66c-49ed-b1e2-27d3ce7673fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:22.515802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6682ce51-b66c-49ed-b1e2-27d3ce7673fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:22.516809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6682ce51-b66c-49ed-b1e2-27d3ce7673fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:22.517247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6682ce51-b66c-49ed-b1e2-27d3ce7673fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:22.517920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6682ce51-b66c-49ed-b1e2-27d3ce7673fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:22.518360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6682ce51-b66c-49ed-b1e2-27d3ce7673fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:22.518772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6682ce51-b66c-49ed-b1e2-27d3ce7673fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:22.580595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6682ce51-b66c-49ed-b1e2-27d3ce7673fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:22.588070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6682ce51-b66c-49ed-b1e2-27d3ce7673fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083161 Sep 01 05:25:22.588627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 769/1526] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:22 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:22.593041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-03f3ed3d-d736-4d22-89d2-fbdadc556e40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:22.595841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-03f3ed3d-d736-4d22-89d2-fbdadc556e40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:22.601388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03f3ed3d-d736-4d22-89d2-fbdadc556e40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:22.601928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03f3ed3d-d736-4d22-89d2-fbdadc556e40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:22.602427 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03f3ed3d-d736-4d22-89d2-fbdadc556e40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:22.603107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03f3ed3d-d736-4d22-89d2-fbdadc556e40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:22.603549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03f3ed3d-d736-4d22-89d2-fbdadc556e40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:22.603964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-03f3ed3d-d736-4d22-89d2-fbdadc556e40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:22.632295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-03f3ed3d-d736-4d22-89d2-fbdadc556e40 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042673 Sep 01 05:25:22.632851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 770/1527] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:22 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:23.611140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-68ee6247-8758-462a-80c8-bd2fd1635303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:23.611885 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-68ee6247-8758-462a-80c8-bd2fd1635303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:23.618148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68ee6247-8758-462a-80c8-bd2fd1635303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:23.618621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68ee6247-8758-462a-80c8-bd2fd1635303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:23.619052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68ee6247-8758-462a-80c8-bd2fd1635303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:23.619725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68ee6247-8758-462a-80c8-bd2fd1635303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:23.620167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68ee6247-8758-462a-80c8-bd2fd1635303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:23.620583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68ee6247-8758-462a-80c8-bd2fd1635303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:23.681862 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-68ee6247-8758-462a-80c8-bd2fd1635303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:23.689541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-68ee6247-8758-462a-80c8-bd2fd1635303 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083257 Sep 01 05:25:23.690103 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 771/1528] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:23 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:23.694832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-25a1cef2-1256-4183-9f1c-6a56b97c1b29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:23.696990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-25a1cef2-1256-4183-9f1c-6a56b97c1b29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:23.702521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25a1cef2-1256-4183-9f1c-6a56b97c1b29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:23.702997 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25a1cef2-1256-4183-9f1c-6a56b97c1b29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:23.703430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25a1cef2-1256-4183-9f1c-6a56b97c1b29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:23.704117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25a1cef2-1256-4183-9f1c-6a56b97c1b29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:23.704564 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25a1cef2-1256-4183-9f1c-6a56b97c1b29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:23.705142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25a1cef2-1256-4183-9f1c-6a56b97c1b29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:23.733678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-25a1cef2-1256-4183-9f1c-6a56b97c1b29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042600 Sep 01 05:25:23.734222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 772/1529] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:23 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:24.710036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c834bda0-2132-47c1-8157-f83093092f3f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:24.710681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c834bda0-2132-47c1-8157-f83093092f3f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:24.717134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c834bda0-2132-47c1-8157-f83093092f3f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:24.717600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c834bda0-2132-47c1-8157-f83093092f3f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:24.718025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c834bda0-2132-47c1-8157-f83093092f3f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:24.718748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c834bda0-2132-47c1-8157-f83093092f3f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:24.719237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c834bda0-2132-47c1-8157-f83093092f3f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:24.719763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c834bda0-2132-47c1-8157-f83093092f3f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:24.782372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c834bda0-2132-47c1-8157-f83093092f3f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:24.790164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c834bda0-2132-47c1-8157-f83093092f3f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084002 Sep 01 05:25:24.790725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 773/1530] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:24 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:24.795130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3ccd8b75-e809-4a43-860c-1246ecb543e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:24.797337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3ccd8b75-e809-4a43-860c-1246ecb543e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:24.802909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ccd8b75-e809-4a43-860c-1246ecb543e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:24.803381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ccd8b75-e809-4a43-860c-1246ecb543e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:24.803810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ccd8b75-e809-4a43-860c-1246ecb543e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:24.804484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ccd8b75-e809-4a43-860c-1246ecb543e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:24.804964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ccd8b75-e809-4a43-860c-1246ecb543e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:24.805382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ccd8b75-e809-4a43-860c-1246ecb543e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:24.834993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3ccd8b75-e809-4a43-860c-1246ecb543e9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043297 Sep 01 05:25:24.835534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 774/1531] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:24 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:25.812035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c8f1fc8b-9bb8-47ac-861c-432ccbd4c0e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:25.812671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c8f1fc8b-9bb8-47ac-861c-432ccbd4c0e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:25.819821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c8f1fc8b-9bb8-47ac-861c-432ccbd4c0e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:25.820306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c8f1fc8b-9bb8-47ac-861c-432ccbd4c0e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:25.820737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c8f1fc8b-9bb8-47ac-861c-432ccbd4c0e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:25.821471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c8f1fc8b-9bb8-47ac-861c-432ccbd4c0e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:25.821919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c8f1fc8b-9bb8-47ac-861c-432ccbd4c0e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:25.822337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c8f1fc8b-9bb8-47ac-861c-432ccbd4c0e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:25.826349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:25.886540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c8f1fc8b-9bb8-47ac-861c-432ccbd4c0e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:25.895027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c8f1fc8b-9bb8-47ac-861c-432ccbd4c0e8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086832 Sep 01 05:25:25.895595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 775/1532] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:25 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:25.900143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-96d09193-9871-4af4-9896-dfa7ca4903b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:25.902237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-96d09193-9871-4af4-9896-dfa7ca4903b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:25.908079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-96d09193-9871-4af4-9896-dfa7ca4903b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:25.908549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-96d09193-9871-4af4-9896-dfa7ca4903b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:25.909014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-96d09193-9871-4af4-9896-dfa7ca4903b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:25.909687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-96d09193-9871-4af4-9896-dfa7ca4903b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:25.910127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-96d09193-9871-4af4-9896-dfa7ca4903b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:25.910541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-96d09193-9871-4af4-9896-dfa7ca4903b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:25.941347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-96d09193-9871-4af4-9896-dfa7ca4903b5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Sep 01 05:25:25.941894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 776/1533] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:25 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:26.915480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e7a26bd7-f99f-40bb-91f0-0e4381cf5916 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:26.916085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e7a26bd7-f99f-40bb-91f0-0e4381cf5916 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:26.923191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7a26bd7-f99f-40bb-91f0-0e4381cf5916 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:26.923687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7a26bd7-f99f-40bb-91f0-0e4381cf5916 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:26.924111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7a26bd7-f99f-40bb-91f0-0e4381cf5916 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:26.924798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7a26bd7-f99f-40bb-91f0-0e4381cf5916 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:26.925252 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7a26bd7-f99f-40bb-91f0-0e4381cf5916 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:26.925664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7a26bd7-f99f-40bb-91f0-0e4381cf5916 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:26.991396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e7a26bd7-f99f-40bb-91f0-0e4381cf5916 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:26.998944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e7a26bd7-f99f-40bb-91f0-0e4381cf5916 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087334 Sep 01 05:25:26.999521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 777/1534] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:26 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:27.004107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-92795c45-5dcc-4108-b74c-94684f928adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:27.006286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-92795c45-5dcc-4108-b74c-94684f928adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:27.012092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92795c45-5dcc-4108-b74c-94684f928adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:27.012568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92795c45-5dcc-4108-b74c-94684f928adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:27.013053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92795c45-5dcc-4108-b74c-94684f928adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:27.013733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92795c45-5dcc-4108-b74c-94684f928adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:27.014174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92795c45-5dcc-4108-b74c-94684f928adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:27.014588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-92795c45-5dcc-4108-b74c-94684f928adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:27.044222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-92795c45-5dcc-4108-b74c-94684f928adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043719 Sep 01 05:25:27.044787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 778/1535] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:26 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:28.019929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0a7e0e64-8c6d-4bf8-901f-010fa07d71de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:28.020543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0a7e0e64-8c6d-4bf8-901f-010fa07d71de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:28.027047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a7e0e64-8c6d-4bf8-901f-010fa07d71de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:28.027528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a7e0e64-8c6d-4bf8-901f-010fa07d71de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:28.027965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a7e0e64-8c6d-4bf8-901f-010fa07d71de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:28.028651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a7e0e64-8c6d-4bf8-901f-010fa07d71de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:28.029130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a7e0e64-8c6d-4bf8-901f-010fa07d71de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:28.029559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a7e0e64-8c6d-4bf8-901f-010fa07d71de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:28.092342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0a7e0e64-8c6d-4bf8-901f-010fa07d71de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:28.100011 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0a7e0e64-8c6d-4bf8-901f-010fa07d71de tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084161 Sep 01 05:25:28.100577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 779/1536] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:28 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:28.105214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ecce85b3-77b4-470a-b730-d8bdb24857b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:28.107363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ecce85b3-77b4-470a-b730-d8bdb24857b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:28.113071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecce85b3-77b4-470a-b730-d8bdb24857b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:28.113557 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecce85b3-77b4-470a-b730-d8bdb24857b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:28.114001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecce85b3-77b4-470a-b730-d8bdb24857b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:28.114688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecce85b3-77b4-470a-b730-d8bdb24857b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:28.115143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecce85b3-77b4-470a-b730-d8bdb24857b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:28.115569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecce85b3-77b4-470a-b730-d8bdb24857b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:28.145579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ecce85b3-77b4-470a-b730-d8bdb24857b6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043976 Sep 01 05:25:28.146133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 780/1537] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:28 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:29.121008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cb181ca9-3dba-46bd-be7e-7f5db2322653 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:29.121705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cb181ca9-3dba-46bd-be7e-7f5db2322653 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:29.128487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb181ca9-3dba-46bd-be7e-7f5db2322653 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:29.128998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb181ca9-3dba-46bd-be7e-7f5db2322653 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:29.129432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb181ca9-3dba-46bd-be7e-7f5db2322653 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:29.130119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb181ca9-3dba-46bd-be7e-7f5db2322653 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:29.130666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb181ca9-3dba-46bd-be7e-7f5db2322653 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:29.131085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb181ca9-3dba-46bd-be7e-7f5db2322653 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:29.192651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cb181ca9-3dba-46bd-be7e-7f5db2322653 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:29.201297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cb181ca9-3dba-46bd-be7e-7f5db2322653 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084166 Sep 01 05:25:29.201866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 781/1538] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:29 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:29.206984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a59f97c9-ddaf-4879-9973-1a5b307763d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:29.209158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a59f97c9-ddaf-4879-9973-1a5b307763d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:29.215155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a59f97c9-ddaf-4879-9973-1a5b307763d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:29.215633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a59f97c9-ddaf-4879-9973-1a5b307763d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:29.216106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a59f97c9-ddaf-4879-9973-1a5b307763d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:29.216822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a59f97c9-ddaf-4879-9973-1a5b307763d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:29.217295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a59f97c9-ddaf-4879-9973-1a5b307763d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:29.217711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a59f97c9-ddaf-4879-9973-1a5b307763d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:29.246881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a59f97c9-ddaf-4879-9973-1a5b307763d7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044040 Sep 01 05:25:29.247448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 782/1539] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:29 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:30.223227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b629793d-b17f-4f13-9d13-8a4d0eb1d587 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:30.223900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b629793d-b17f-4f13-9d13-8a4d0eb1d587 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:30.230316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b629793d-b17f-4f13-9d13-8a4d0eb1d587 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:30.230799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b629793d-b17f-4f13-9d13-8a4d0eb1d587 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:30.231233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b629793d-b17f-4f13-9d13-8a4d0eb1d587 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:30.231914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b629793d-b17f-4f13-9d13-8a4d0eb1d587 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:30.232363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b629793d-b17f-4f13-9d13-8a4d0eb1d587 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:30.232857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b629793d-b17f-4f13-9d13-8a4d0eb1d587 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:30.299427 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b629793d-b17f-4f13-9d13-8a4d0eb1d587 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:30.307172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b629793d-b17f-4f13-9d13-8a4d0eb1d587 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088482 Sep 01 05:25:30.307741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 783/1540] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:30 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:30.312181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d3ce7cbf-6267-4986-a79b-c05a795d6e97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:30.315138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d3ce7cbf-6267-4986-a79b-c05a795d6e97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:30.320959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3ce7cbf-6267-4986-a79b-c05a795d6e97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:30.321442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3ce7cbf-6267-4986-a79b-c05a795d6e97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:30.321881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3ce7cbf-6267-4986-a79b-c05a795d6e97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:30.322560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3ce7cbf-6267-4986-a79b-c05a795d6e97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:30.323013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3ce7cbf-6267-4986-a79b-c05a795d6e97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:30.323452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d3ce7cbf-6267-4986-a79b-c05a795d6e97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:30.353392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d3ce7cbf-6267-4986-a79b-c05a795d6e97 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Sep 01 05:25:30.353945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 784/1541] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:30 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:31.329468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3bef339e-18ac-4ea2-b38c-54669ca1c4c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:31.330154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3bef339e-18ac-4ea2-b38c-54669ca1c4c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:31.336533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3bef339e-18ac-4ea2-b38c-54669ca1c4c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:31.337038 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3bef339e-18ac-4ea2-b38c-54669ca1c4c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:31.337464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3bef339e-18ac-4ea2-b38c-54669ca1c4c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:31.338139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3bef339e-18ac-4ea2-b38c-54669ca1c4c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:31.338581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3bef339e-18ac-4ea2-b38c-54669ca1c4c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:31.338993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3bef339e-18ac-4ea2-b38c-54669ca1c4c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:31.402089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3bef339e-18ac-4ea2-b38c-54669ca1c4c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:31.410008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3bef339e-18ac-4ea2-b38c-54669ca1c4c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085194 Sep 01 05:25:31.410577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 785/1542] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:31 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:31.415032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8433f4fb-87cb-4fdf-91dc-61b7117a1a3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:31.417205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8433f4fb-87cb-4fdf-91dc-61b7117a1a3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:31.423382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8433f4fb-87cb-4fdf-91dc-61b7117a1a3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:31.423855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8433f4fb-87cb-4fdf-91dc-61b7117a1a3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:31.424283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8433f4fb-87cb-4fdf-91dc-61b7117a1a3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:31.424986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8433f4fb-87cb-4fdf-91dc-61b7117a1a3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:31.425431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8433f4fb-87cb-4fdf-91dc-61b7117a1a3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:31.425869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8433f4fb-87cb-4fdf-91dc-61b7117a1a3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:31.454976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8433f4fb-87cb-4fdf-91dc-61b7117a1a3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043426 Sep 01 05:25:31.455526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 786/1543] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:31 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:32.431546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-44eb29f5-ca36-4b95-8c4c-f9ab46454cc5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:32.432195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-44eb29f5-ca36-4b95-8c4c-f9ab46454cc5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:32.438598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44eb29f5-ca36-4b95-8c4c-f9ab46454cc5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:32.439077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44eb29f5-ca36-4b95-8c4c-f9ab46454cc5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:32.439515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44eb29f5-ca36-4b95-8c4c-f9ab46454cc5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:32.440199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44eb29f5-ca36-4b95-8c4c-f9ab46454cc5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:32.440650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44eb29f5-ca36-4b95-8c4c-f9ab46454cc5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:32.441106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44eb29f5-ca36-4b95-8c4c-f9ab46454cc5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:32.503989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-44eb29f5-ca36-4b95-8c4c-f9ab46454cc5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:32.511677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-44eb29f5-ca36-4b95-8c4c-f9ab46454cc5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084100 Sep 01 05:25:32.512242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 787/1544] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:32 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:32.517311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5a458b96-7c82-461e-9daa-ce8f3ff3fd7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:32.519428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5a458b96-7c82-461e-9daa-ce8f3ff3fd7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:32.525128 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a458b96-7c82-461e-9daa-ce8f3ff3fd7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:32.525612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a458b96-7c82-461e-9daa-ce8f3ff3fd7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:32.526052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a458b96-7c82-461e-9daa-ce8f3ff3fd7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:32.526739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a458b96-7c82-461e-9daa-ce8f3ff3fd7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:32.527188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a458b96-7c82-461e-9daa-ce8f3ff3fd7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:32.527610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a458b96-7c82-461e-9daa-ce8f3ff3fd7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:32.556448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5a458b96-7c82-461e-9daa-ce8f3ff3fd7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043221 Sep 01 05:25:32.557023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 788/1545] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:32 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:33.533044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d35ffe9d-3781-4112-86c1-b09083ae830c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:33.533706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d35ffe9d-3781-4112-86c1-b09083ae830c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:33.539968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d35ffe9d-3781-4112-86c1-b09083ae830c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:33.540441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d35ffe9d-3781-4112-86c1-b09083ae830c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:33.540892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d35ffe9d-3781-4112-86c1-b09083ae830c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:33.541570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d35ffe9d-3781-4112-86c1-b09083ae830c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:33.542012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d35ffe9d-3781-4112-86c1-b09083ae830c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:33.542430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d35ffe9d-3781-4112-86c1-b09083ae830c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:33.603206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d35ffe9d-3781-4112-86c1-b09083ae830c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:33.611331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d35ffe9d-3781-4112-86c1-b09083ae830c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082402 Sep 01 05:25:33.611897 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 789/1546] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:33 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:33.616302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-81d58e08-85d2-4ca7-97c5-e2320188361e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:33.618421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-81d58e08-85d2-4ca7-97c5-e2320188361e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:33.623893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81d58e08-85d2-4ca7-97c5-e2320188361e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:33.624371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81d58e08-85d2-4ca7-97c5-e2320188361e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:33.624894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81d58e08-85d2-4ca7-97c5-e2320188361e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:33.625579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81d58e08-85d2-4ca7-97c5-e2320188361e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:33.627565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81d58e08-85d2-4ca7-97c5-e2320188361e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:33.628014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81d58e08-85d2-4ca7-97c5-e2320188361e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:33.657254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-81d58e08-85d2-4ca7-97c5-e2320188361e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044221 Sep 01 05:25:33.657823 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 790/1547] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:34.632120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-518e4279-ce24-48fc-a30b-dcfd4714968a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:34.632741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-518e4279-ce24-48fc-a30b-dcfd4714968a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:34.639177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-518e4279-ce24-48fc-a30b-dcfd4714968a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:34.639655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-518e4279-ce24-48fc-a30b-dcfd4714968a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:34.640088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-518e4279-ce24-48fc-a30b-dcfd4714968a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:34.640789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-518e4279-ce24-48fc-a30b-dcfd4714968a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:34.641245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-518e4279-ce24-48fc-a30b-dcfd4714968a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:34.641663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-518e4279-ce24-48fc-a30b-dcfd4714968a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:34.706379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-518e4279-ce24-48fc-a30b-dcfd4714968a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:34.709410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:34.716468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-518e4279-ce24-48fc-a30b-dcfd4714968a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088216 Sep 01 05:25:34.717074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 791/1548] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:34 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:34.722188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f8048639-2a13-4c36-8427-d99f8dc20600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:34.724297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f8048639-2a13-4c36-8427-d99f8dc20600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:34.729934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8048639-2a13-4c36-8427-d99f8dc20600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:34.730409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8048639-2a13-4c36-8427-d99f8dc20600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:34.730844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8048639-2a13-4c36-8427-d99f8dc20600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:34.731527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8048639-2a13-4c36-8427-d99f8dc20600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:34.731980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8048639-2a13-4c36-8427-d99f8dc20600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:34.732402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f8048639-2a13-4c36-8427-d99f8dc20600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:34.761752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f8048639-2a13-4c36-8427-d99f8dc20600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043674 Sep 01 05:25:34.762313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 792/1549] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:35.737980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ab09dc56-f319-4cc7-9231-610ff68bf2d0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:35.738667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ab09dc56-f319-4cc7-9231-610ff68bf2d0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:35.745130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab09dc56-f319-4cc7-9231-610ff68bf2d0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:35.745618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab09dc56-f319-4cc7-9231-610ff68bf2d0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:35.746054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab09dc56-f319-4cc7-9231-610ff68bf2d0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:35.746791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab09dc56-f319-4cc7-9231-610ff68bf2d0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:35.747186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab09dc56-f319-4cc7-9231-610ff68bf2d0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:35.747613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab09dc56-f319-4cc7-9231-610ff68bf2d0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:35.811373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ab09dc56-f319-4cc7-9231-610ff68bf2d0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:35.819774 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ab09dc56-f319-4cc7-9231-610ff68bf2d0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086366 Sep 01 05:25:35.820610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 793/1550] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:35 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:35.825311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d968fca0-6e53-45aa-916d-90c21904cfdd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:35.827535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d968fca0-6e53-45aa-916d-90c21904cfdd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:35.833756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d968fca0-6e53-45aa-916d-90c21904cfdd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:35.834268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d968fca0-6e53-45aa-916d-90c21904cfdd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:35.834708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d968fca0-6e53-45aa-916d-90c21904cfdd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:35.835403 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d968fca0-6e53-45aa-916d-90c21904cfdd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:35.835856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d968fca0-6e53-45aa-916d-90c21904cfdd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:35.836278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d968fca0-6e53-45aa-916d-90c21904cfdd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:35.866356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d968fca0-6e53-45aa-916d-90c21904cfdd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044689 Sep 01 05:25:35.866964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 794/1551] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:35 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:36.840404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-369f3e41-73c7-436d-9ea1-f7a7e92d77ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:36.841125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-369f3e41-73c7-436d-9ea1-f7a7e92d77ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:36.848347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-369f3e41-73c7-436d-9ea1-f7a7e92d77ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:36.848833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-369f3e41-73c7-436d-9ea1-f7a7e92d77ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:36.849272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-369f3e41-73c7-436d-9ea1-f7a7e92d77ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:36.849947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-369f3e41-73c7-436d-9ea1-f7a7e92d77ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:36.850388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-369f3e41-73c7-436d-9ea1-f7a7e92d77ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:36.850802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-369f3e41-73c7-436d-9ea1-f7a7e92d77ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:36.911576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-369f3e41-73c7-436d-9ea1-f7a7e92d77ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:36.919448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-369f3e41-73c7-436d-9ea1-f7a7e92d77ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082876 Sep 01 05:25:36.920021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 795/1552] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:36 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:36.924518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a7e4c009-6aee-48e6-ae31-9d10ec826cb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:36.926847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a7e4c009-6aee-48e6-ae31-9d10ec826cb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:36.932566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7e4c009-6aee-48e6-ae31-9d10ec826cb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:36.933070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7e4c009-6aee-48e6-ae31-9d10ec826cb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:36.933501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7e4c009-6aee-48e6-ae31-9d10ec826cb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:36.934181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7e4c009-6aee-48e6-ae31-9d10ec826cb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:36.934625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7e4c009-6aee-48e6-ae31-9d10ec826cb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:36.935041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7e4c009-6aee-48e6-ae31-9d10ec826cb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:36.965065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a7e4c009-6aee-48e6-ae31-9d10ec826cb8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Sep 01 05:25:36.965619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 796/1553] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:25:36 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:37.940639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7f9069e1-d1e7-434d-b36f-5481f0e4a967 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:37.941267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7f9069e1-d1e7-434d-b36f-5481f0e4a967 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:37.947602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f9069e1-d1e7-434d-b36f-5481f0e4a967 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:37.948075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f9069e1-d1e7-434d-b36f-5481f0e4a967 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:37.948500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f9069e1-d1e7-434d-b36f-5481f0e4a967 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:37.949216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f9069e1-d1e7-434d-b36f-5481f0e4a967 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:37.949658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f9069e1-d1e7-434d-b36f-5481f0e4a967 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:37.950069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f9069e1-d1e7-434d-b36f-5481f0e4a967 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:38.010875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7f9069e1-d1e7-434d-b36f-5481f0e4a967 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:38.018603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7f9069e1-d1e7-434d-b36f-5481f0e4a967 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081974 Sep 01 05:25:38.019181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 797/1554] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:37 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:38.023643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-084f067e-d0b6-498f-9db9-44ab02cd4593 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:38.025776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-084f067e-d0b6-498f-9db9-44ab02cd4593 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:38.031430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-084f067e-d0b6-498f-9db9-44ab02cd4593 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:38.031914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-084f067e-d0b6-498f-9db9-44ab02cd4593 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:38.032352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-084f067e-d0b6-498f-9db9-44ab02cd4593 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:38.033103 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-084f067e-d0b6-498f-9db9-44ab02cd4593 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:38.034092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-084f067e-d0b6-498f-9db9-44ab02cd4593 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:38.034514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-084f067e-d0b6-498f-9db9-44ab02cd4593 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:38.113399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-084f067e-d0b6-498f-9db9-44ab02cd4593 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "POST /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/action" status: 200 len: 76293 microversion: 2.1 time: 0.092969 Sep 01 05:25:38.114038 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 798/1555] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:25:38 2022] POST /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72/action => generated 76293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:25:39.039810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bf8cf1b6-0cc1-4f12-aeb3-cbf001476e7d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:39.040506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bf8cf1b6-0cc1-4f12-aeb3-cbf001476e7d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:39.047510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf8cf1b6-0cc1-4f12-aeb3-cbf001476e7d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:39.047980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf8cf1b6-0cc1-4f12-aeb3-cbf001476e7d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:39.048405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf8cf1b6-0cc1-4f12-aeb3-cbf001476e7d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:39.049660 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf8cf1b6-0cc1-4f12-aeb3-cbf001476e7d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:39.050152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf8cf1b6-0cc1-4f12-aeb3-cbf001476e7d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:39.050569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf8cf1b6-0cc1-4f12-aeb3-cbf001476e7d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:39.119071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bf8cf1b6-0cc1-4f12-aeb3-cbf001476e7d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:39.127808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bf8cf1b6-0cc1-4f12-aeb3-cbf001476e7d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.091633 Sep 01 05:25:39.128505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 799/1556] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:39 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:40.148067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2fa27586-8ff5-46ec-9dc9-96d70dd7fc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:40.148756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2fa27586-8ff5-46ec-9dc9-96d70dd7fc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:40.155120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fa27586-8ff5-46ec-9dc9-96d70dd7fc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:40.156131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fa27586-8ff5-46ec-9dc9-96d70dd7fc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:40.156573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fa27586-8ff5-46ec-9dc9-96d70dd7fc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:40.157290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fa27586-8ff5-46ec-9dc9-96d70dd7fc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:40.157744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fa27586-8ff5-46ec-9dc9-96d70dd7fc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:40.158167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fa27586-8ff5-46ec-9dc9-96d70dd7fc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:40.218959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2fa27586-8ff5-46ec-9dc9-96d70dd7fc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:40.227177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2fa27586-8ff5-46ec-9dc9-96d70dd7fc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083073 Sep 01 05:25:40.227845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 800/1557] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:40 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:41.247484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b4562d9d-c9bd-48cb-8455-92fba17e6762 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:41.248105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b4562d9d-c9bd-48cb-8455-92fba17e6762 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:41.255143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b4562d9d-c9bd-48cb-8455-92fba17e6762 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:41.255622 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b4562d9d-c9bd-48cb-8455-92fba17e6762 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:41.256047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b4562d9d-c9bd-48cb-8455-92fba17e6762 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:41.256753 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b4562d9d-c9bd-48cb-8455-92fba17e6762 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:41.257223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b4562d9d-c9bd-48cb-8455-92fba17e6762 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:41.257638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b4562d9d-c9bd-48cb-8455-92fba17e6762 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:41.320193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b4562d9d-c9bd-48cb-8455-92fba17e6762 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:41.328075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b4562d9d-c9bd-48cb-8455-92fba17e6762 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084518 Sep 01 05:25:41.328639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 801/1558] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:41 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:42.348740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8e8a3ec3-5a08-4ce7-8c3e-9eff269a97ac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:42.349433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8e8a3ec3-5a08-4ce7-8c3e-9eff269a97ac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:42.355693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e8a3ec3-5a08-4ce7-8c3e-9eff269a97ac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:42.356166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e8a3ec3-5a08-4ce7-8c3e-9eff269a97ac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:42.356594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e8a3ec3-5a08-4ce7-8c3e-9eff269a97ac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:42.357297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e8a3ec3-5a08-4ce7-8c3e-9eff269a97ac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:42.357743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e8a3ec3-5a08-4ce7-8c3e-9eff269a97ac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:42.358158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e8a3ec3-5a08-4ce7-8c3e-9eff269a97ac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:42.418420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8e8a3ec3-5a08-4ce7-8c3e-9eff269a97ac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:42.426066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8e8a3ec3-5a08-4ce7-8c3e-9eff269a97ac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081276 Sep 01 05:25:42.426625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 802/1559] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:42 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:43.447397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c70d103c-6143-4137-bb20-3afbb1817ef9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:43.448065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c70d103c-6143-4137-bb20-3afbb1817ef9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:43.454353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c70d103c-6143-4137-bb20-3afbb1817ef9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:43.454825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c70d103c-6143-4137-bb20-3afbb1817ef9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:43.455247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c70d103c-6143-4137-bb20-3afbb1817ef9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:43.455947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c70d103c-6143-4137-bb20-3afbb1817ef9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:43.456386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c70d103c-6143-4137-bb20-3afbb1817ef9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:43.456817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c70d103c-6143-4137-bb20-3afbb1817ef9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:43.520435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c70d103c-6143-4137-bb20-3afbb1817ef9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:43.527987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c70d103c-6143-4137-bb20-3afbb1817ef9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084703 Sep 01 05:25:43.528545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 803/1560] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:43 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:44.548403 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4019ceae-774f-425c-ad90-134adcf45f45 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:44.549049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4019ceae-774f-425c-ad90-134adcf45f45 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:44.555284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4019ceae-774f-425c-ad90-134adcf45f45 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:44.555788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4019ceae-774f-425c-ad90-134adcf45f45 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:44.556214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4019ceae-774f-425c-ad90-134adcf45f45 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:44.556925 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4019ceae-774f-425c-ad90-134adcf45f45 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:44.557372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4019ceae-774f-425c-ad90-134adcf45f45 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:44.557788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4019ceae-774f-425c-ad90-134adcf45f45 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:44.618160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4019ceae-774f-425c-ad90-134adcf45f45 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:44.625627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4019ceae-774f-425c-ad90-134adcf45f45 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081228 Sep 01 05:25:44.626187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 804/1561] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:44 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:45.647464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-39456b4f-be6e-4804-ba3c-d915bc932d27 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:45.648070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-39456b4f-be6e-4804-ba3c-d915bc932d27 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:45.654421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-39456b4f-be6e-4804-ba3c-d915bc932d27 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:45.654902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-39456b4f-be6e-4804-ba3c-d915bc932d27 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:45.655363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-39456b4f-be6e-4804-ba3c-d915bc932d27 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:45.656044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-39456b4f-be6e-4804-ba3c-d915bc932d27 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:45.656495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-39456b4f-be6e-4804-ba3c-d915bc932d27 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:45.657019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-39456b4f-be6e-4804-ba3c-d915bc932d27 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:45.718543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-39456b4f-be6e-4804-ba3c-d915bc932d27 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:45.726225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-39456b4f-be6e-4804-ba3c-d915bc932d27 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083471 Sep 01 05:25:45.726786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 805/1562] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:45 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:46.747126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7524b498-eb52-4d5d-96f3-635d76edf1fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:46.747813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7524b498-eb52-4d5d-96f3-635d76edf1fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:46.754020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7524b498-eb52-4d5d-96f3-635d76edf1fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:46.754497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7524b498-eb52-4d5d-96f3-635d76edf1fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:46.754929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7524b498-eb52-4d5d-96f3-635d76edf1fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:46.755614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7524b498-eb52-4d5d-96f3-635d76edf1fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:46.756063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7524b498-eb52-4d5d-96f3-635d76edf1fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:46.756494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7524b498-eb52-4d5d-96f3-635d76edf1fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:46.771966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-e0b3568b-76c4-4635-bf1b-f3ead49aa9e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lazy-loading 'services' on Instance uuid 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:25:46.832641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7524b498-eb52-4d5d-96f3-635d76edf1fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:46.840587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7524b498-eb52-4d5d-96f3-635d76edf1fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.097433 Sep 01 05:25:46.841507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 806/1563] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:46 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:47.861661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2c5ba0d9-b0f2-457b-b040-89aba493aa1e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:47.864500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2c5ba0d9-b0f2-457b-b040-89aba493aa1e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:47.870966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c5ba0d9-b0f2-457b-b040-89aba493aa1e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:47.871438 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c5ba0d9-b0f2-457b-b040-89aba493aa1e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:47.871863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c5ba0d9-b0f2-457b-b040-89aba493aa1e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:47.872536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c5ba0d9-b0f2-457b-b040-89aba493aa1e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:47.873015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c5ba0d9-b0f2-457b-b040-89aba493aa1e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:47.873431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c5ba0d9-b0f2-457b-b040-89aba493aa1e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:47.938047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2c5ba0d9-b0f2-457b-b040-89aba493aa1e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:47.946710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2c5ba0d9-b0f2-457b-b040-89aba493aa1e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088887 Sep 01 05:25:47.947268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 807/1564] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:47 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:48.968062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-33609c78-c105-440e-9527-cb541d80c090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:48.968698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-33609c78-c105-440e-9527-cb541d80c090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:48.976405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33609c78-c105-440e-9527-cb541d80c090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:48.976911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33609c78-c105-440e-9527-cb541d80c090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:48.977343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33609c78-c105-440e-9527-cb541d80c090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:48.978020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33609c78-c105-440e-9527-cb541d80c090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:48.978470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33609c78-c105-440e-9527-cb541d80c090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:48.978916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33609c78-c105-440e-9527-cb541d80c090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:49.046469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-33609c78-c105-440e-9527-cb541d80c090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:49.048790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:49.056672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-33609c78-c105-440e-9527-cb541d80c090 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.092452 Sep 01 05:25:49.057288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 808/1565] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:48 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:50.076724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6ec9ce0c-971f-4fbf-bc53-cf9d249f2a8d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:50.077366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6ec9ce0c-971f-4fbf-bc53-cf9d249f2a8d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:50.079666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=90 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:50.085936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ec9ce0c-971f-4fbf-bc53-cf9d249f2a8d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:50.086411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ec9ce0c-971f-4fbf-bc53-cf9d249f2a8d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:50.086845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ec9ce0c-971f-4fbf-bc53-cf9d249f2a8d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:50.087526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ec9ce0c-971f-4fbf-bc53-cf9d249f2a8d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:50.087976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ec9ce0c-971f-4fbf-bc53-cf9d249f2a8d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:50.088395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ec9ce0c-971f-4fbf-bc53-cf9d249f2a8d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:50.151343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ec9ce0c-971f-4fbf-bc53-cf9d249f2a8d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:50.159017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6ec9ce0c-971f-4fbf-bc53-cf9d249f2a8d tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086323 Sep 01 05:25:50.160456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 809/1566] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:50 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:51.180257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d83c3a00-bff8-49d6-a132-5bfe7adc2a73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:51.180940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d83c3a00-bff8-49d6-a132-5bfe7adc2a73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:51.187181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d83c3a00-bff8-49d6-a132-5bfe7adc2a73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:51.187693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d83c3a00-bff8-49d6-a132-5bfe7adc2a73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:51.188217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d83c3a00-bff8-49d6-a132-5bfe7adc2a73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:51.188967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d83c3a00-bff8-49d6-a132-5bfe7adc2a73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:51.189498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d83c3a00-bff8-49d6-a132-5bfe7adc2a73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:51.189923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d83c3a00-bff8-49d6-a132-5bfe7adc2a73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:51.250991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d83c3a00-bff8-49d6-a132-5bfe7adc2a73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:51.258839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d83c3a00-bff8-49d6-a132-5bfe7adc2a73 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083204 Sep 01 05:25:51.259408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 810/1567] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:51 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:52.279508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-68c98262-1aa8-44eb-8a71-170e56425407 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:52.280181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-68c98262-1aa8-44eb-8a71-170e56425407 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:52.287502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68c98262-1aa8-44eb-8a71-170e56425407 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:52.287987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68c98262-1aa8-44eb-8a71-170e56425407 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:52.288423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68c98262-1aa8-44eb-8a71-170e56425407 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:52.289146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68c98262-1aa8-44eb-8a71-170e56425407 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:52.289597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68c98262-1aa8-44eb-8a71-170e56425407 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:52.290016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68c98262-1aa8-44eb-8a71-170e56425407 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:52.356920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-68c98262-1aa8-44eb-8a71-170e56425407 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:52.364590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-68c98262-1aa8-44eb-8a71-170e56425407 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088953 Sep 01 05:25:52.365177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 811/1568] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:52 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:53.385607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-749bba89-836c-4a78-bbe7-93a2455f20bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:53.386257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-749bba89-836c-4a78-bbe7-93a2455f20bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:53.392634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-749bba89-836c-4a78-bbe7-93a2455f20bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:53.393150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-749bba89-836c-4a78-bbe7-93a2455f20bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:53.393588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-749bba89-836c-4a78-bbe7-93a2455f20bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:53.394278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-749bba89-836c-4a78-bbe7-93a2455f20bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:53.394728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-749bba89-836c-4a78-bbe7-93a2455f20bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:53.395152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-749bba89-836c-4a78-bbe7-93a2455f20bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:53.455297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-749bba89-836c-4a78-bbe7-93a2455f20bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:53.463064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-749bba89-836c-4a78-bbe7-93a2455f20bd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081349 Sep 01 05:25:53.463632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 812/1569] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:53 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:54.483554 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-002a0b3d-2296-41e6-8c6f-83720b625747 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:54.484238 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-002a0b3d-2296-41e6-8c6f-83720b625747 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:54.491182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-002a0b3d-2296-41e6-8c6f-83720b625747 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:54.491652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-002a0b3d-2296-41e6-8c6f-83720b625747 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:54.492073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-002a0b3d-2296-41e6-8c6f-83720b625747 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:54.492745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-002a0b3d-2296-41e6-8c6f-83720b625747 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:54.493211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-002a0b3d-2296-41e6-8c6f-83720b625747 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:54.493625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-002a0b3d-2296-41e6-8c6f-83720b625747 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:54.554553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-002a0b3d-2296-41e6-8c6f-83720b625747 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:54.562435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-002a0b3d-2296-41e6-8c6f-83720b625747 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082364 Sep 01 05:25:54.563069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 813/1570] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:54 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:55.584604 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-941f17cb-4e04-43d5-a346-f38290f51f10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:55.585658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-941f17cb-4e04-43d5-a346-f38290f51f10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:55.591758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-941f17cb-4e04-43d5-a346-f38290f51f10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:55.592226 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-941f17cb-4e04-43d5-a346-f38290f51f10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:55.592650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-941f17cb-4e04-43d5-a346-f38290f51f10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:55.593358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-941f17cb-4e04-43d5-a346-f38290f51f10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:55.593787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-941f17cb-4e04-43d5-a346-f38290f51f10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:55.594201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-941f17cb-4e04-43d5-a346-f38290f51f10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:55.664043 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-941f17cb-4e04-43d5-a346-f38290f51f10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:55.671891 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-941f17cb-4e04-43d5-a346-f38290f51f10 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.092205 Sep 01 05:25:55.672450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 814/1571] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:55 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:56.692587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ab974240-4e35-4e44-a52b-42d2b6d0ebbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:56.693298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ab974240-4e35-4e44-a52b-42d2b6d0ebbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:56.700055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab974240-4e35-4e44-a52b-42d2b6d0ebbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:56.700528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab974240-4e35-4e44-a52b-42d2b6d0ebbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:56.700998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab974240-4e35-4e44-a52b-42d2b6d0ebbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:56.701671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab974240-4e35-4e44-a52b-42d2b6d0ebbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:56.702115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab974240-4e35-4e44-a52b-42d2b6d0ebbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:56.702528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ab974240-4e35-4e44-a52b-42d2b6d0ebbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:56.765468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ab974240-4e35-4e44-a52b-42d2b6d0ebbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:56.773507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ab974240-4e35-4e44-a52b-42d2b6d0ebbe tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084996 Sep 01 05:25:56.774074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 815/1572] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:56 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:56.783772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=4 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:57.794121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f06b4530-d3bc-4d47-8ee0-36c600274eae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:57.794733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f06b4530-d3bc-4d47-8ee0-36c600274eae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:57.801663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f06b4530-d3bc-4d47-8ee0-36c600274eae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:57.802135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f06b4530-d3bc-4d47-8ee0-36c600274eae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:57.802563 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f06b4530-d3bc-4d47-8ee0-36c600274eae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:57.803275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f06b4530-d3bc-4d47-8ee0-36c600274eae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:57.803718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f06b4530-d3bc-4d47-8ee0-36c600274eae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:57.804134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f06b4530-d3bc-4d47-8ee0-36c600274eae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:57.864988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f06b4530-d3bc-4d47-8ee0-36c600274eae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:57.872678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f06b4530-d3bc-4d47-8ee0-36c600274eae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082455 Sep 01 05:25:57.873273 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 816/1573] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:57 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:58.894391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d72cc5fc-5be4-4c8f-93c3-0b8623ace10b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:58.895668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d72cc5fc-5be4-4c8f-93c3-0b8623ace10b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:58.902987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d72cc5fc-5be4-4c8f-93c3-0b8623ace10b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:58.903468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d72cc5fc-5be4-4c8f-93c3-0b8623ace10b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:58.903898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d72cc5fc-5be4-4c8f-93c3-0b8623ace10b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:58.904590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d72cc5fc-5be4-4c8f-93c3-0b8623ace10b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:58.905077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d72cc5fc-5be4-4c8f-93c3-0b8623ace10b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:58.905498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d72cc5fc-5be4-4c8f-93c3-0b8623ace10b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:58.980077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d72cc5fc-5be4-4c8f-93c3-0b8623ace10b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:58.987845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d72cc5fc-5be4-4c8f-93c3-0b8623ace10b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.097381 Sep 01 05:25:58.988472 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 817/1574] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:58 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:59.613444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:59.614582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:59.620476 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:59.620981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:59.621408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:59.622078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:59.622517 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:59.622928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:08.165641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:26:08.166191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:26:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd (ip 10.222.0.49) !!! Sep 01 05:26:09.618758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=19 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:09.640075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=59 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:18.735012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:26:18.735569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:26:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd (ip 10.222.0.49) !!! Sep 01 05:26:35.669180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:26:35.669906 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:26:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd (ip 10.222.0.49) !!! Sep 01 05:26:59.722587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e0b3568b-76c4-4635-bf1b-f3ead49aa9e4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd" status: 202 len: 0 microversion: 2.1 time: 120.174708 Sep 01 05:26:59.723606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 758/1575] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 05:24:59 2022] DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd => generated 0 bytes in 120177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:26:59.731135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9255595e-ed10-4f13-9d21-75f506a27731 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:59.731822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9255595e-ed10-4f13-9d21-75f506a27731 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:59.738083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9255595e-ed10-4f13-9d21-75f506a27731 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:59.738648 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9255595e-ed10-4f13-9d21-75f506a27731 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:59.739080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9255595e-ed10-4f13-9d21-75f506a27731 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:59.739770 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9255595e-ed10-4f13-9d21-75f506a27731 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:59.740449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9255595e-ed10-4f13-9d21-75f506a27731 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:59.740846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9255595e-ed10-4f13-9d21-75f506a27731 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:59.809723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9255595e-ed10-4f13-9d21-75f506a27731 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:59.817550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9255595e-ed10-4f13-9d21-75f506a27731 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.092803 Sep 01 05:26:59.818219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 759/1576] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:59 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:59.823405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:59.823765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:59.830951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:59.831499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:59.831999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:59.832751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:59.833285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:59.833712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:59.897557 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lazy-loading 'services' on Instance uuid 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:27:09.828318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=4 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:09.854474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:09.910830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=4 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:46.971873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lazy-loading 'services' on Instance uuid 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:27:47.002105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-230baf71-0a3d-4df3-89d9-1169b643aafc) Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Request method failure captured: Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd HTTP/1.1 Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjEEA-0zvNVK73-ALKeJr_5BlD7gBwFkeCmpRZuQ2-FbFfpQaBXn38V988IsG8t3AIT_schfErIuaP_I61pz-ciNdxJrFqSVAVyd96EVscv5ER27TitSYRkM5CcsHoNtTwSV2TQLi4EEvkq-cfQi5IxMb799EA2wy4y5xPtO-Bvj-bNEk Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: b5cc7e7b1b9f43a18651ab25d5c2b4ae Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:27:47.004395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:27:47.006209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5cc7e7b1b9f43a18651ab25d5c2b4ae", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}] Sep 01 05:27:47.006209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:27:47.006209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: b5cc7e7b1b9f43a18651ab25d5c2b4ae Sep 01 05:27:47.006209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:27:47.006209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-VolumesSnapshotTestJSON-1059052017-project Sep 01 05:27:47.006209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:27:47.006209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:27:47.006209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 109c732f418442a9bf997fba70669fad Sep 01 05:27:47.006209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-VolumesSnapshotTestJSON-1059052017-project Sep 01 05:27:47.006209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-230baf71-0a3d-4df3-89d9-1169b643aafc) Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'server_id': '9ad1a0f8-dc03-4662-8e60-d9b7995d1f73', 'id': 'f57f61f5-2ba8-4f7c-a117-f58bf54b91cd'} Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 01 05:27:47.007186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-230baf71-0a3d-4df3-89d9-1169b643aafc) Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:27:47.008686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-230baf71-0a3d-4df3-89d9-1169b643aafc) Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:47.010218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-230baf71-0a3d-4df3-89d9-1169b643aafc) Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:47.011477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-230baf71-0a3d-4df3-89d9-1169b643aafc) Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-230baf71-0a3d-4df3-89d9-1169b643aafc) Sep 01 05:27:47.012908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:47.016057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-230baf71-0a3d-4df3-89d9-1169b643aafc) {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:27:47.016939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d78e42e3-1621-4b29-895b-361960ce1bea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd" status: 400 len: 269 microversion: 2.1 time: 107.407517 Sep 01 05:27:47.017707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 818/1577] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 05:25:59 2022] DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd => generated 269 bytes in 107409 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 05:27:47.022811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2635d921-5db9-48de-bf0e-cdf7fda52b69 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:47.023374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2635d921-5db9-48de-bf0e-cdf7fda52b69 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:47.029773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2635d921-5db9-48de-bf0e-cdf7fda52b69 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:47.030261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2635d921-5db9-48de-bf0e-cdf7fda52b69 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:47.030699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2635d921-5db9-48de-bf0e-cdf7fda52b69 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:47.031534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2635d921-5db9-48de-bf0e-cdf7fda52b69 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:47.031991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2635d921-5db9-48de-bf0e-cdf7fda52b69 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:47.032414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2635d921-5db9-48de-bf0e-cdf7fda52b69 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:47.065000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2635d921-5db9-48de-bf0e-cdf7fda52b69 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:27:47.125744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2635d921-5db9-48de-bf0e-cdf7fda52b69 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [5faab12b-a48f-41d4-8b61-b36139cc13bb] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:27:48.132483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [None req-2635d921-5db9-48de-bf0e-cdf7fda52b69 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [5faab12b-a48f-41d4-8b61-b36139cc13bb] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 32808. Sep 01 05:27:48.151966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2635d921-5db9-48de-bf0e-cdf7fda52b69 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 204 len: 0 microversion: 2.1 time: 1.133367 Sep 01 05:27:48.152626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 819/1578] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:27:47 2022] DELETE /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:27:48.158965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-67793cee-c39e-40f1-915e-27a30088c336 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:48.159541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-67793cee-c39e-40f1-915e-27a30088c336 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:48.166293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67793cee-c39e-40f1-915e-27a30088c336 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:48.166764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67793cee-c39e-40f1-915e-27a30088c336 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:48.167188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67793cee-c39e-40f1-915e-27a30088c336 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:48.167868 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67793cee-c39e-40f1-915e-27a30088c336 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:48.168323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67793cee-c39e-40f1-915e-27a30088c336 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:48.168720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67793cee-c39e-40f1-915e-27a30088c336 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:48.193848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-67793cee-c39e-40f1-915e-27a30088c336 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:27:48.239734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.compute.api [None req-67793cee-c39e-40f1-915e-27a30088c336 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Instance is already in deleting state, ignoring this request Sep 01 05:27:48.240540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-67793cee-c39e-40f1-915e-27a30088c336 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 204 len: 0 microversion: 2.1 time: 0.086631 Sep 01 05:27:48.241129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 820/1579] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:27:48 2022] DELETE /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:27:48.245490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5c81b361-d462-47a9-b529-f1420e8dabb4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:48.246088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5c81b361-d462-47a9-b529-f1420e8dabb4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:48.252115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c81b361-d462-47a9-b529-f1420e8dabb4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:48.252586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c81b361-d462-47a9-b529-f1420e8dabb4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:48.253041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c81b361-d462-47a9-b529-f1420e8dabb4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:48.253713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c81b361-d462-47a9-b529-f1420e8dabb4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:48.254363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c81b361-d462-47a9-b529-f1420e8dabb4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:48.254780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c81b361-d462-47a9-b529-f1420e8dabb4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:48.391099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5c81b361-d462-47a9-b529-f1420e8dabb4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:48.398746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5c81b361-d462-47a9-b529-f1420e8dabb4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1670 microversion: 2.1 time: 0.156685 Sep 01 05:27:48.399320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 821/1580] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:48 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:48.403652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f4d696b4-6fa7-43dd-b606-a0358416dd3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:48.404846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f4d696b4-6fa7-43dd-b606-a0358416dd3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:48.410354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4d696b4-6fa7-43dd-b606-a0358416dd3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:48.411041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4d696b4-6fa7-43dd-b606-a0358416dd3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:48.411486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4d696b4-6fa7-43dd-b606-a0358416dd3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:48.412173 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4d696b4-6fa7-43dd-b606-a0358416dd3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:48.412625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4d696b4-6fa7-43dd-b606-a0358416dd3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:48.413091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4d696b4-6fa7-43dd-b606-a0358416dd3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:48.473551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f4d696b4-6fa7-43dd-b606-a0358416dd3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:48.481224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f4d696b4-6fa7-43dd-b606-a0358416dd3c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.080930 Sep 01 05:27:48.481789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 822/1581] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:48 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:49.403164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:27:49.405815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:27:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.49) !!! Sep 01 05:27:49.467369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-ab6324c8-1a3d-4eeb-a7f0-b56b37315369 req-17f9d906-4207-482b-a8f3-77ef943d5da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc80648-73e9-4ce0-9161-2a82c5634104", "name": "network-vif-deleted", "tag": "e2267d61-043c-4be7-90fa-6dce08aea3bd"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:27:49.477511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-ab6324c8-1a3d-4eeb-a7f0-b56b37315369 req-17f9d906-4207-482b-a8f3-77ef943d5da7 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:49.478223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-ab6324c8-1a3d-4eeb-a7f0-b56b37315369 req-17f9d906-4207-482b-a8f3-77ef943d5da7 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:49.478831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-ab6324c8-1a3d-4eeb-a7f0-b56b37315369 req-17f9d906-4207-482b-a8f3-77ef943d5da7 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:49.499992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-ab6324c8-1a3d-4eeb-a7f0-b56b37315369 req-17f9d906-4207-482b-a8f3-77ef943d5da7 service nova] Creating event network-vif-deleted:e2267d61-043c-4be7-90fa-6dce08aea3bd for instance dbc80648-73e9-4ce0-9161-2a82c5634104 on hv-cinder-85391 Sep 01 05:27:49.506016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-ab6324c8-1a3d-4eeb-a7f0-b56b37315369 req-17f9d906-4207-482b-a8f3-77ef943d5da7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107843 Sep 01 05:27:49.506798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 823/1582] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:27:49.512706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:49.515102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:49.528487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:49.529419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:49.530149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:49.531122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:49.531806 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:49.532543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:49.571429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:49.571995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:49.572432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:49.572916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lazy-loading 'fault' on Instance uuid dbc80648-73e9-4ce0-9161-2a82c5634104 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:27:49.625079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f90807029244ecb6ad7cf6e4d2ad80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c302f5c44be49e5ae6e7e6b8b1f6c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:49.634230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-05b222a2-7b7c-436e-8a41-684aa5dc9104 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 200 len: 1325 microversion: 2.1 time: 0.125941 Sep 01 05:27:49.634809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 824/1583] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:49 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 1325 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:49.639816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-32a247c4-c2e9-4dee-b9a6-3b6eea6cd187 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:49.640638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-32a247c4-c2e9-4dee-b9a6-3b6eea6cd187 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:49.647559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32a247c4-c2e9-4dee-b9a6-3b6eea6cd187 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:49.647989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32a247c4-c2e9-4dee-b9a6-3b6eea6cd187 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:49.648372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32a247c4-c2e9-4dee-b9a6-3b6eea6cd187 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:49.649104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32a247c4-c2e9-4dee-b9a6-3b6eea6cd187 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:49.649556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32a247c4-c2e9-4dee-b9a6-3b6eea6cd187 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:49.650067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32a247c4-c2e9-4dee-b9a6-3b6eea6cd187 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:49.721471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-32a247c4-c2e9-4dee-b9a6-3b6eea6cd187 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:49.729761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-32a247c4-c2e9-4dee-b9a6-3b6eea6cd187 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.093746 Sep 01 05:27:49.736918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 825/1584] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:49 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:50.656158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e91b902e-0c1b-4e71-8c57-94b14c7c1dfd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:50.656853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e91b902e-0c1b-4e71-8c57-94b14c7c1dfd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:50.663189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e91b902e-0c1b-4e71-8c57-94b14c7c1dfd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:50.663657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e91b902e-0c1b-4e71-8c57-94b14c7c1dfd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:50.664082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e91b902e-0c1b-4e71-8c57-94b14c7c1dfd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:50.664753 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e91b902e-0c1b-4e71-8c57-94b14c7c1dfd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:50.665224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e91b902e-0c1b-4e71-8c57-94b14c7c1dfd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:50.665637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e91b902e-0c1b-4e71-8c57-94b14c7c1dfd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:50.678915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-e91b902e-0c1b-4e71-8c57-94b14c7c1dfd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] HTTP exception thrown: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e91b902e-0c1b-4e71-8c57-94b14c7c1dfd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Request method failure captured: Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 HTTP/1.1 Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED-1ohArlcqyRQ3GM507mA8OeXhOwsTxgdizBpUNvCXmYXtRJMNdNMgvI2W73Djx5cuX-C6AuLvmhil688UiqvfZJECg1ycfiaSmD_FKvrkAwJR5Xs7U03aCnPlyNSCUltTGf9uM8U0IVZaVqbGURDD7lAhQ22x2H6IZ5nnsuIOeX5w Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 6c302f5c44be49e5ae6e7e6b8b1f6c1c Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:27:50.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:27:50.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6c302f5c44be49e5ae6e7e6b8b1f6c1c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}] Sep 01 05:27:50.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:27:50.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 6c302f5c44be49e5ae6e7e6b8b1f6c1c Sep 01 05:27:50.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:27:50.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeTestJSON-846640785-project Sep 01 05:27:50.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:27:50.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:27:50.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 11f90807029244ecb6ad7cf6e4d2ad80 Sep 01 05:27:50.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeTestJSON-846640785-project Sep 01 05:27:50.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:27:50.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:27:50.682147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': 'dbc80648-73e9-4ce0-9161-2a82c5634104'} Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:27:50.683413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:27:50.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:27:50.686927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e91b902e-0c1b-4e71-8c57-94b14c7c1dfd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Returning 404 to user: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:27:50.686927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e91b902e-0c1b-4e71-8c57-94b14c7c1dfd tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 404 len: 111 microversion: 2.1 time: 0.030395 Sep 01 05:27:50.686927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 826/1585] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:50 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:27:50.690693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b252775c-107c-4685-a5de-b411a3ce3f3d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '.version_select at 0x7f96284ab0d0>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:50.714403 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b252775c-107c-4685-a5de-b411a3ce3f3d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-941541203" status: 202 len: 0 microversion: 2.1 time: 0.027122 Sep 01 05:27:50.714944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 827/1586] 10.222.0.49 () {58 vars in 1218 bytes} [Thu Sep 1 05:27:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-941541203 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:27:50.752077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ee4a7ea7-3abf-4290-b047-eee3a71f00a2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:50.752715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ee4a7ea7-3abf-4290-b047-eee3a71f00a2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:50.759450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee4a7ea7-3abf-4290-b047-eee3a71f00a2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:50.759924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee4a7ea7-3abf-4290-b047-eee3a71f00a2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:50.760350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee4a7ea7-3abf-4290-b047-eee3a71f00a2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:50.761045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee4a7ea7-3abf-4290-b047-eee3a71f00a2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:50.761498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee4a7ea7-3abf-4290-b047-eee3a71f00a2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:50.761907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee4a7ea7-3abf-4290-b047-eee3a71f00a2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:50.837534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ee4a7ea7-3abf-4290-b047-eee3a71f00a2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:50.845398 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ee4a7ea7-3abf-4290-b047-eee3a71f00a2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.097740 Sep 01 05:27:50.845972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 828/1587] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:50 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:27:51.867119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-35bce9e2-97ac-4898-a253-4df549989a98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:51.867760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-35bce9e2-97ac-4898-a253-4df549989a98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:51.874572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35bce9e2-97ac-4898-a253-4df549989a98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:51.875046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35bce9e2-97ac-4898-a253-4df549989a98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:51.875477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35bce9e2-97ac-4898-a253-4df549989a98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:51.876158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35bce9e2-97ac-4898-a253-4df549989a98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:51.876605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35bce9e2-97ac-4898-a253-4df549989a98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:51.877051 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35bce9e2-97ac-4898-a253-4df549989a98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:51.942803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-35bce9e2-97ac-4898-a253-4df549989a98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:51.950521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-35bce9e2-97ac-4898-a253-4df549989a98 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087288 Sep 01 05:27:51.952077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 829/1588] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:51 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:27:52.973147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9e718ea9-5b56-4ea3-8121-08a149ef71e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:52.973744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9e718ea9-5b56-4ea3-8121-08a149ef71e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:52.980190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9e718ea9-5b56-4ea3-8121-08a149ef71e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:52.980703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9e718ea9-5b56-4ea3-8121-08a149ef71e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:52.981187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9e718ea9-5b56-4ea3-8121-08a149ef71e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:52.981973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9e718ea9-5b56-4ea3-8121-08a149ef71e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:52.983302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9e718ea9-5b56-4ea3-8121-08a149ef71e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:52.983514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9e718ea9-5b56-4ea3-8121-08a149ef71e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:53.046794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9e718ea9-5b56-4ea3-8121-08a149ef71e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:53.054339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9e718ea9-5b56-4ea3-8121-08a149ef71e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085004 Sep 01 05:27:53.054897 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 830/1589] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:52 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:27:54.075370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e4f65872-7e74-4e02-bb84-f9b64b7d36ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:54.076824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e4f65872-7e74-4e02-bb84-f9b64b7d36ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:54.083334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e4f65872-7e74-4e02-bb84-f9b64b7d36ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:54.083808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e4f65872-7e74-4e02-bb84-f9b64b7d36ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:54.084232 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e4f65872-7e74-4e02-bb84-f9b64b7d36ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:54.084944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e4f65872-7e74-4e02-bb84-f9b64b7d36ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:54.085386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e4f65872-7e74-4e02-bb84-f9b64b7d36ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:54.085796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e4f65872-7e74-4e02-bb84-f9b64b7d36ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:54.145934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e4f65872-7e74-4e02-bb84-f9b64b7d36ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:54.153576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e4f65872-7e74-4e02-bb84-f9b64b7d36ba tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082265 Sep 01 05:27:54.154895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 831/1590] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:54 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:27:55.175000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8a5d5a40-1daf-48f6-91e6-b2eac55bab1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:55.175648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8a5d5a40-1daf-48f6-91e6-b2eac55bab1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:55.181920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a5d5a40-1daf-48f6-91e6-b2eac55bab1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:55.182399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a5d5a40-1daf-48f6-91e6-b2eac55bab1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:55.182830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a5d5a40-1daf-48f6-91e6-b2eac55bab1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:55.183510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a5d5a40-1daf-48f6-91e6-b2eac55bab1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:55.183959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a5d5a40-1daf-48f6-91e6-b2eac55bab1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:55.184377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a5d5a40-1daf-48f6-91e6-b2eac55bab1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:55.245644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8a5d5a40-1daf-48f6-91e6-b2eac55bab1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:55.253389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8a5d5a40-1daf-48f6-91e6-b2eac55bab1c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082516 Sep 01 05:27:55.253952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 832/1591] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:55 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:27:56.274593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3c987964-2b82-46da-8882-3d1b414fa287 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:56.275268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3c987964-2b82-46da-8882-3d1b414fa287 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:56.281763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3c987964-2b82-46da-8882-3d1b414fa287 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:56.282233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3c987964-2b82-46da-8882-3d1b414fa287 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:56.282658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3c987964-2b82-46da-8882-3d1b414fa287 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:56.283326 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3c987964-2b82-46da-8882-3d1b414fa287 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:56.283765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3c987964-2b82-46da-8882-3d1b414fa287 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:56.284178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3c987964-2b82-46da-8882-3d1b414fa287 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:56.344173 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3c987964-2b82-46da-8882-3d1b414fa287 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:56.351862 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3c987964-2b82-46da-8882-3d1b414fa287 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081153 Sep 01 05:27:56.352419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 833/1592] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:56 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:27:56.975768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=4 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:57.373018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0ef0067b-f57f-4d55-995c-70e51a34c071 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:57.373689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0ef0067b-f57f-4d55-995c-70e51a34c071 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:57.379855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ef0067b-f57f-4d55-995c-70e51a34c071 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:57.380336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ef0067b-f57f-4d55-995c-70e51a34c071 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:57.380769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ef0067b-f57f-4d55-995c-70e51a34c071 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:57.381472 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ef0067b-f57f-4d55-995c-70e51a34c071 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:57.381926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ef0067b-f57f-4d55-995c-70e51a34c071 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:57.382341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ef0067b-f57f-4d55-995c-70e51a34c071 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:57.400243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:57.447254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0ef0067b-f57f-4d55-995c-70e51a34c071 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:57.455965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0ef0067b-f57f-4d55-995c-70e51a34c071 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086935 Sep 01 05:27:57.456524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 834/1593] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:57 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:27:58.477266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-df5d51f8-027c-455e-adc7-d446040e6dae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:58.477967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-df5d51f8-027c-455e-adc7-d446040e6dae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:58.484291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df5d51f8-027c-455e-adc7-d446040e6dae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:58.484759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df5d51f8-027c-455e-adc7-d446040e6dae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:58.485210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df5d51f8-027c-455e-adc7-d446040e6dae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:58.485881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df5d51f8-027c-455e-adc7-d446040e6dae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:58.486321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df5d51f8-027c-455e-adc7-d446040e6dae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:58.486732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df5d51f8-027c-455e-adc7-d446040e6dae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:58.552672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-df5d51f8-027c-455e-adc7-d446040e6dae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:58.561551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-df5d51f8-027c-455e-adc7-d446040e6dae tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088111 Sep 01 05:27:58.562125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 835/1594] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:58 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:27:59.583695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9f121e92-14f2-46bd-a9bd-cbfde9116246 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:59.584358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9f121e92-14f2-46bd-a9bd-cbfde9116246 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:59.590797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f121e92-14f2-46bd-a9bd-cbfde9116246 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:59.591276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f121e92-14f2-46bd-a9bd-cbfde9116246 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:59.592415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f121e92-14f2-46bd-a9bd-cbfde9116246 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:59.593146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f121e92-14f2-46bd-a9bd-cbfde9116246 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:59.593596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f121e92-14f2-46bd-a9bd-cbfde9116246 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:59.594016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f121e92-14f2-46bd-a9bd-cbfde9116246 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:59.655027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9f121e92-14f2-46bd-a9bd-cbfde9116246 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:59.662788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9f121e92-14f2-46bd-a9bd-cbfde9116246 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083000 Sep 01 05:27:59.663344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 836/1595] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:59 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:27:59.715969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:59.716402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:59.722153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:59.722633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:59.723064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:59.723746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:59.724194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:59.724613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:09.719674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:09.744698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=18 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:00.121672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58f7e1f2-b210-44dd-8917-a6d87e5232ad) Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Request method failure captured: Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd HTTP/1.1 Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEA-0zvNVK73-ALKeJr_5BlD7gBwFkeCmpRZuQ2-FbFfpQaBXn38V988IsG8t3AIT_schfErIuaP_I61pz-ciNdxJrFqSVAVyd96EVscv5ER27TitSYRkM5CcsHoNtTwSV2TQLi4EEvkq-cfQi5IxMb799EA2wy4y5xPtO-Bvj-bNEk Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: b5cc7e7b1b9f43a18651ab25d5c2b4ae Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:29:00.124221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:29:00.125828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5cc7e7b1b9f43a18651ab25d5c2b4ae", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}] Sep 01 05:29:00.125828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:29:00.125828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: b5cc7e7b1b9f43a18651ab25d5c2b4ae Sep 01 05:29:00.125828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:29:00.125828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-VolumesSnapshotTestJSON-1059052017-project Sep 01 05:29:00.125828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:29:00.125828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:29:00.125828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 109c732f418442a9bf997fba70669fad Sep 01 05:29:00.125828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-VolumesSnapshotTestJSON-1059052017-project Sep 01 05:29:00.125828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58f7e1f2-b210-44dd-8917-a6d87e5232ad) Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'server_id': '9ad1a0f8-dc03-4662-8e60-d9b7995d1f73', 'id': 'f57f61f5-2ba8-4f7c-a117-f58bf54b91cd'} Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 01 05:29:00.126580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58f7e1f2-b210-44dd-8917-a6d87e5232ad) Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:00.127694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58f7e1f2-b210-44dd-8917-a6d87e5232ad) Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:00.128961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58f7e1f2-b210-44dd-8917-a6d87e5232ad) Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:00.130038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58f7e1f2-b210-44dd-8917-a6d87e5232ad) Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58f7e1f2-b210-44dd-8917-a6d87e5232ad) Sep 01 05:29:00.131164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:00.132525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58f7e1f2-b210-44dd-8917-a6d87e5232ad) {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:29:00.132525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-49782d3d-1dea-4a47-ae32-08e6bda61af5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd" status: 400 len: 269 microversion: 2.1 time: 120.306412 Sep 01 05:29:00.132525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 760/1596] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 05:26:59 2022] DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd => generated 269 bytes in 120307 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:29:00.300116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lazy-loading 'services' on Instance uuid 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:29:00.337494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-39124d58-3fbd-436d-936f-6ff797b3f174 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:00.338114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-39124d58-3fbd-436d-936f-6ff797b3f174 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:00.345279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39124d58-3fbd-436d-936f-6ff797b3f174 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:00.345793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39124d58-3fbd-436d-936f-6ff797b3f174 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:00.346223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39124d58-3fbd-436d-936f-6ff797b3f174 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:00.346907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39124d58-3fbd-436d-936f-6ff797b3f174 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:00.347354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39124d58-3fbd-436d-936f-6ff797b3f174 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:00.347772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39124d58-3fbd-436d-936f-6ff797b3f174 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:00.415329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-39124d58-3fbd-436d-936f-6ff797b3f174 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:00.423832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-39124d58-3fbd-436d-936f-6ff797b3f174 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.296623 Sep 01 05:29:00.424397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 761/1597] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:00 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:00.429060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:00.429740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:00.435603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:00.436090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:00.436519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:00.438209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:00.438664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:00.439088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:10.312365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=4 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:10.433469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=4 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:10.458988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=10 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:28.174976 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:29:28.175832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:29:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd (ip 10.222.0.49) !!! Sep 01 05:29:38.744637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:29:38.745407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:29:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd (ip 10.222.0.49) !!! Sep 01 05:29:47.259475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d01cddc-a3b6-426d-a89a-d28ee53ee836) Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Request method failure captured: Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd HTTP/1.1 Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjEEA-0zvNVK73-ALKeJr_5BlD7gBwFkeCmpRZuQ2-FbFfpQaBXn38V988IsG8t3AIT_schfErIuaP_I61pz-ciNdxJrFqSVAVyd96EVscv5ER27TitSYRkM5CcsHoNtTwSV2TQLi4EEvkq-cfQi5IxMb799EA2wy4y5xPtO-Bvj-bNEk Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: b5cc7e7b1b9f43a18651ab25d5c2b4ae Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:29:47.261708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:29:47.263471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5cc7e7b1b9f43a18651ab25d5c2b4ae", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}] Sep 01 05:29:47.263471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:29:47.263471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: b5cc7e7b1b9f43a18651ab25d5c2b4ae Sep 01 05:29:47.263471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:29:47.263471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-VolumesSnapshotTestJSON-1059052017-project Sep 01 05:29:47.263471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:29:47.263471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:29:47.263471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 109c732f418442a9bf997fba70669fad Sep 01 05:29:47.263471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-VolumesSnapshotTestJSON-1059052017-project Sep 01 05:29:47.263471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d01cddc-a3b6-426d-a89a-d28ee53ee836) Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'server_id': '9ad1a0f8-dc03-4662-8e60-d9b7995d1f73', 'id': 'f57f61f5-2ba8-4f7c-a117-f58bf54b91cd'} Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 01 05:29:47.264545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d01cddc-a3b6-426d-a89a-d28ee53ee836) Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:47.265913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d01cddc-a3b6-426d-a89a-d28ee53ee836) Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:47.267939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d01cddc-a3b6-426d-a89a-d28ee53ee836) Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:47.269507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d01cddc-a3b6-426d-a89a-d28ee53ee836) Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d01cddc-a3b6-426d-a89a-d28ee53ee836) Sep 01 05:29:47.272305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.273590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d01cddc-a3b6-426d-a89a-d28ee53ee836) {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:29:47.273590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-07c106bc-bd21-4497-8f01-99ce6c14fbe6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd" status: 400 len: 269 microversion: 2.1 time: 107.551020 Sep 01 05:29:47.273590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 837/1598] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 05:27:59 2022] DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd => generated 269 bytes in 107552 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 05:29:47.273590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f30a477c-8580-4a6d-8215-3859a942eda4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:47.273961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f30a477c-8580-4a6d-8215-3859a942eda4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:47.276007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f30a477c-8580-4a6d-8215-3859a942eda4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:47.276487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f30a477c-8580-4a6d-8215-3859a942eda4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:47.276955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f30a477c-8580-4a6d-8215-3859a942eda4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:47.277640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f30a477c-8580-4a6d-8215-3859a942eda4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:47.278168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f30a477c-8580-4a6d-8215-3859a942eda4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:47.278503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f30a477c-8580-4a6d-8215-3859a942eda4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:47.340972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f30a477c-8580-4a6d-8215-3859a942eda4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:47.350234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f30a477c-8580-4a6d-8215-3859a942eda4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085347 Sep 01 05:29:47.350818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 838/1599] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:47 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:47.399136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lazy-loading 'services' on Instance uuid 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:29:47.731156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e834fe3d-df96-4182-a33a-5835ac6ba592) Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Request method failure captured: Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd HTTP/1.1 Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEA-0zvNVK73-ALKeJr_5BlD7gBwFkeCmpRZuQ2-FbFfpQaBXn38V988IsG8t3AIT_schfErIuaP_I61pz-ciNdxJrFqSVAVyd96EVscv5ER27TitSYRkM5CcsHoNtTwSV2TQLi4EEvkq-cfQi5IxMb799EA2wy4y5xPtO-Bvj-bNEk Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: b5cc7e7b1b9f43a18651ab25d5c2b4ae Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:29:47.733338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:29:47.735005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5cc7e7b1b9f43a18651ab25d5c2b4ae", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5cc7e7b1b9f43a18651ab25d5c2b4ae"}]}] Sep 01 05:29:47.735005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:29:47.735005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: b5cc7e7b1b9f43a18651ab25d5c2b4ae Sep 01 05:29:47.735005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1059052017 Sep 01 05:29:47.735005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-VolumesSnapshotTestJSON-1059052017-project Sep 01 05:29:47.735005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:29:47.735005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:29:47.735005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 109c732f418442a9bf997fba70669fad Sep 01 05:29:47.735005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-VolumesSnapshotTestJSON-1059052017-project Sep 01 05:29:47.735005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e834fe3d-df96-4182-a33a-5835ac6ba592) Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'server_id': '9ad1a0f8-dc03-4662-8e60-d9b7995d1f73', 'id': 'f57f61f5-2ba8-4f7c-a117-f58bf54b91cd'} Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 01 05:29:47.736114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e834fe3d-df96-4182-a33a-5835ac6ba592) Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:47.738444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e834fe3d-df96-4182-a33a-5835ac6ba592) Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:47.739857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e834fe3d-df96-4182-a33a-5835ac6ba592) Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:47.742595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e834fe3d-df96-4182-a33a-5835ac6ba592) Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e834fe3d-df96-4182-a33a-5835ac6ba592) Sep 01 05:29:47.745010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:29:47.747181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e834fe3d-df96-4182-a33a-5835ac6ba592) {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:29:47.747181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f63c13a5-0bd6-4a4f-b78b-4e9ad8d0ff37 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd" status: 400 len: 269 microversion: 2.1 time: 47.309389 Sep 01 05:29:47.747181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 762/1600] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 05:29:00 2022] DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73/os-volume_attachments/f57f61f5-2ba8-4f7c-a117-f58bf54b91cd => generated 269 bytes in 47310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:29:48.371388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d2c7ed95-3b78-4eaf-a9f0-ea43f92d1dbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:48.371911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d2c7ed95-3b78-4eaf-a9f0-ea43f92d1dbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:48.378820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2c7ed95-3b78-4eaf-a9f0-ea43f92d1dbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:48.379290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2c7ed95-3b78-4eaf-a9f0-ea43f92d1dbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:48.379715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2c7ed95-3b78-4eaf-a9f0-ea43f92d1dbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:48.380386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2c7ed95-3b78-4eaf-a9f0-ea43f92d1dbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:48.380849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2c7ed95-3b78-4eaf-a9f0-ea43f92d1dbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:48.381260 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2c7ed95-3b78-4eaf-a9f0-ea43f92d1dbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:48.446498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d2c7ed95-3b78-4eaf-a9f0-ea43f92d1dbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:48.454291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d2c7ed95-3b78-4eaf-a9f0-ea43f92d1dbf tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086898 Sep 01 05:29:48.455482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 839/1601] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:48 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:49.476516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ca1a063f-35d4-474b-aebf-f8bdc2ac9f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:49.477145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ca1a063f-35d4-474b-aebf-f8bdc2ac9f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:49.483682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca1a063f-35d4-474b-aebf-f8bdc2ac9f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:49.484155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca1a063f-35d4-474b-aebf-f8bdc2ac9f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:49.484580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca1a063f-35d4-474b-aebf-f8bdc2ac9f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:49.485285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca1a063f-35d4-474b-aebf-f8bdc2ac9f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:49.485879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca1a063f-35d4-474b-aebf-f8bdc2ac9f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:49.486290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca1a063f-35d4-474b-aebf-f8bdc2ac9f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:49.546347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ca1a063f-35d4-474b-aebf-f8bdc2ac9f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:49.554080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ca1a063f-35d4-474b-aebf-f8bdc2ac9f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081929 Sep 01 05:29:49.554639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 763/1602] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:49 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:50.574516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d987727c-4fb4-48cb-852f-5d38f17e19ed tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:50.575137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d987727c-4fb4-48cb-852f-5d38f17e19ed tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:50.581807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d987727c-4fb4-48cb-852f-5d38f17e19ed tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:50.582288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d987727c-4fb4-48cb-852f-5d38f17e19ed tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:50.582723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d987727c-4fb4-48cb-852f-5d38f17e19ed tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:50.583402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d987727c-4fb4-48cb-852f-5d38f17e19ed tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:50.583851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d987727c-4fb4-48cb-852f-5d38f17e19ed tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:50.584271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d987727c-4fb4-48cb-852f-5d38f17e19ed tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:50.645677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d987727c-4fb4-48cb-852f-5d38f17e19ed tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:50.653295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d987727c-4fb4-48cb-852f-5d38f17e19ed tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082825 Sep 01 05:29:50.653885 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 840/1603] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:50 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:51.674471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6db6a396-b28a-4b66-af92-59db25f37d22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:51.675079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6db6a396-b28a-4b66-af92-59db25f37d22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:51.681385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6db6a396-b28a-4b66-af92-59db25f37d22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:51.681864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6db6a396-b28a-4b66-af92-59db25f37d22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:51.682290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6db6a396-b28a-4b66-af92-59db25f37d22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:51.682961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6db6a396-b28a-4b66-af92-59db25f37d22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:51.683403 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6db6a396-b28a-4b66-af92-59db25f37d22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:51.683817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6db6a396-b28a-4b66-af92-59db25f37d22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:51.746123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6db6a396-b28a-4b66-af92-59db25f37d22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:51.754791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6db6a396-b28a-4b66-af92-59db25f37d22 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084996 Sep 01 05:29:51.755348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 764/1604] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:51 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:52.775929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3cf25da8-e63f-4166-8b25-c94e80f0c9ca tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:52.776543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3cf25da8-e63f-4166-8b25-c94e80f0c9ca tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:52.783497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3cf25da8-e63f-4166-8b25-c94e80f0c9ca tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:52.783971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3cf25da8-e63f-4166-8b25-c94e80f0c9ca tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:52.784404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3cf25da8-e63f-4166-8b25-c94e80f0c9ca tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:52.785112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3cf25da8-e63f-4166-8b25-c94e80f0c9ca tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:52.785560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3cf25da8-e63f-4166-8b25-c94e80f0c9ca tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:52.785977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3cf25da8-e63f-4166-8b25-c94e80f0c9ca tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:52.847589 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3cf25da8-e63f-4166-8b25-c94e80f0c9ca tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:52.855275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3cf25da8-e63f-4166-8b25-c94e80f0c9ca tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083168 Sep 01 05:29:52.855838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 841/1605] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:52 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:53.876367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-33efa8d4-bf8d-408e-bdde-7f820edc1082 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:53.877021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-33efa8d4-bf8d-408e-bdde-7f820edc1082 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:53.883836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-33efa8d4-bf8d-408e-bdde-7f820edc1082 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:53.884154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-33efa8d4-bf8d-408e-bdde-7f820edc1082 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:53.884503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-33efa8d4-bf8d-408e-bdde-7f820edc1082 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:53.885176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-33efa8d4-bf8d-408e-bdde-7f820edc1082 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:53.885624 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-33efa8d4-bf8d-408e-bdde-7f820edc1082 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:53.886068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-33efa8d4-bf8d-408e-bdde-7f820edc1082 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:53.953379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-33efa8d4-bf8d-408e-bdde-7f820edc1082 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:53.962075 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-33efa8d4-bf8d-408e-bdde-7f820edc1082 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.090445 Sep 01 05:29:53.962769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 765/1606] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:53 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:54.982528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4b112035-f8f8-41da-a5fa-5e326b72cb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:54.983143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4b112035-f8f8-41da-a5fa-5e326b72cb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:54.990453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b112035-f8f8-41da-a5fa-5e326b72cb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:54.990933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b112035-f8f8-41da-a5fa-5e326b72cb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:54.991369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b112035-f8f8-41da-a5fa-5e326b72cb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:54.992054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b112035-f8f8-41da-a5fa-5e326b72cb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:54.992536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b112035-f8f8-41da-a5fa-5e326b72cb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:54.992988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b112035-f8f8-41da-a5fa-5e326b72cb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:55.053786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4b112035-f8f8-41da-a5fa-5e326b72cb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:55.061396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4b112035-f8f8-41da-a5fa-5e326b72cb55 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082729 Sep 01 05:29:55.061953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 842/1607] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:54 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:56.082964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7fdb6153-dd8e-4104-9a92-494894f1932c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:56.083513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7fdb6153-dd8e-4104-9a92-494894f1932c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:56.085891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:29:56.086032 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:29:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c (ip 10.222.0.49) !!! Sep 01 05:29:56.093122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fdb6153-dd8e-4104-9a92-494894f1932c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:56.093608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fdb6153-dd8e-4104-9a92-494894f1932c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:56.094681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fdb6153-dd8e-4104-9a92-494894f1932c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:56.095600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fdb6153-dd8e-4104-9a92-494894f1932c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:56.096057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fdb6153-dd8e-4104-9a92-494894f1932c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:56.096483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7fdb6153-dd8e-4104-9a92-494894f1932c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:56.159348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7fdb6153-dd8e-4104-9a92-494894f1932c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:56.167013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7fdb6153-dd8e-4104-9a92-494894f1932c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088401 Sep 01 05:29:56.167601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 766/1608] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:56 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:57.189274 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-809c9af5-355b-495c-9693-33a14850b062 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:57.189825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-809c9af5-355b-495c-9693-33a14850b062 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:57.196138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-809c9af5-355b-495c-9693-33a14850b062 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:57.196615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-809c9af5-355b-495c-9693-33a14850b062 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:57.197072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-809c9af5-355b-495c-9693-33a14850b062 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:57.197751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-809c9af5-355b-495c-9693-33a14850b062 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:57.198197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-809c9af5-355b-495c-9693-33a14850b062 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:57.198614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-809c9af5-355b-495c-9693-33a14850b062 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:57.259796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-809c9af5-355b-495c-9693-33a14850b062 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:57.268324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-809c9af5-355b-495c-9693-33a14850b062 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084263 Sep 01 05:29:57.268915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 843/1609] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:57 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:58.289729 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d00d2898-c5a4-41de-8b88-956ccad7b7d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:58.290320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d00d2898-c5a4-41de-8b88-956ccad7b7d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:58.297391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d00d2898-c5a4-41de-8b88-956ccad7b7d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:58.297869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d00d2898-c5a4-41de-8b88-956ccad7b7d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:58.298293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d00d2898-c5a4-41de-8b88-956ccad7b7d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:58.298966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d00d2898-c5a4-41de-8b88-956ccad7b7d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:58.299410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d00d2898-c5a4-41de-8b88-956ccad7b7d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:58.299823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d00d2898-c5a4-41de-8b88-956ccad7b7d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:58.360170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d00d2898-c5a4-41de-8b88-956ccad7b7d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:58.367916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d00d2898-c5a4-41de-8b88-956ccad7b7d6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082097 Sep 01 05:29:58.368475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 767/1610] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:58 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:59.388285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-18ba6a6f-971a-4e2e-a63a-8c7ddb3d0eb8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:59.388954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-18ba6a6f-971a-4e2e-a63a-8c7ddb3d0eb8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:59.391882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:29:59.392030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c (ip 10.222.0.49) !!! Sep 01 05:29:59.400825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-18ba6a6f-971a-4e2e-a63a-8c7ddb3d0eb8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:59.401306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-18ba6a6f-971a-4e2e-a63a-8c7ddb3d0eb8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:59.401733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-18ba6a6f-971a-4e2e-a63a-8c7ddb3d0eb8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:59.402410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-18ba6a6f-971a-4e2e-a63a-8c7ddb3d0eb8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:59.402852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-18ba6a6f-971a-4e2e-a63a-8c7ddb3d0eb8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:59.403266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-18ba6a6f-971a-4e2e-a63a-8c7ddb3d0eb8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:59.466120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-18ba6a6f-971a-4e2e-a63a-8c7ddb3d0eb8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:59.474591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-18ba6a6f-971a-4e2e-a63a-8c7ddb3d0eb8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.090482 Sep 01 05:29:59.475154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 844/1611] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:59 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:00.495443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-86ad1b58-0bda-4dd1-8f9f-c4906b125649 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:00.496066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-86ad1b58-0bda-4dd1-8f9f-c4906b125649 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:00.502609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86ad1b58-0bda-4dd1-8f9f-c4906b125649 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:00.503089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86ad1b58-0bda-4dd1-8f9f-c4906b125649 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:00.503534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86ad1b58-0bda-4dd1-8f9f-c4906b125649 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:00.504222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86ad1b58-0bda-4dd1-8f9f-c4906b125649 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:00.504678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86ad1b58-0bda-4dd1-8f9f-c4906b125649 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:00.505127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-86ad1b58-0bda-4dd1-8f9f-c4906b125649 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:00.569865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-86ad1b58-0bda-4dd1-8f9f-c4906b125649 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:00.577944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-86ad1b58-0bda-4dd1-8f9f-c4906b125649 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086365 Sep 01 05:30:00.578517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 768/1612] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:00 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:01.599156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2d4595a8-8ac1-4b87-8ef4-e8f4c1421033 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:01.599751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2d4595a8-8ac1-4b87-8ef4-e8f4c1421033 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:01.606124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d4595a8-8ac1-4b87-8ef4-e8f4c1421033 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:01.606591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d4595a8-8ac1-4b87-8ef4-e8f4c1421033 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:01.607015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d4595a8-8ac1-4b87-8ef4-e8f4c1421033 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:01.607685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d4595a8-8ac1-4b87-8ef4-e8f4c1421033 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:01.608631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d4595a8-8ac1-4b87-8ef4-e8f4c1421033 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:01.609083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d4595a8-8ac1-4b87-8ef4-e8f4c1421033 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:01.672044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2d4595a8-8ac1-4b87-8ef4-e8f4c1421033 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:01.679599 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2d4595a8-8ac1-4b87-8ef4-e8f4c1421033 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084311 Sep 01 05:30:01.680155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 845/1613] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:01 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:02.702307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-71e13e66-dfb1-4f24-aa62-7d862f072ceb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:02.703064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-71e13e66-dfb1-4f24-aa62-7d862f072ceb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:02.709674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71e13e66-dfb1-4f24-aa62-7d862f072ceb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:02.710148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71e13e66-dfb1-4f24-aa62-7d862f072ceb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:02.710573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71e13e66-dfb1-4f24-aa62-7d862f072ceb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:02.711244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71e13e66-dfb1-4f24-aa62-7d862f072ceb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:02.711683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71e13e66-dfb1-4f24-aa62-7d862f072ceb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:02.712096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71e13e66-dfb1-4f24-aa62-7d862f072ceb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:02.774315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-71e13e66-dfb1-4f24-aa62-7d862f072ceb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:02.782088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-71e13e66-dfb1-4f24-aa62-7d862f072ceb tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085048 Sep 01 05:30:02.782658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 769/1614] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:02 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:03.802670 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9b640ad8-ac90-4379-962c-6a835e78c704 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:03.803289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9b640ad8-ac90-4379-962c-6a835e78c704 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:03.809694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b640ad8-ac90-4379-962c-6a835e78c704 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:03.810176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b640ad8-ac90-4379-962c-6a835e78c704 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:03.810614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b640ad8-ac90-4379-962c-6a835e78c704 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:03.811940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b640ad8-ac90-4379-962c-6a835e78c704 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:03.812362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b640ad8-ac90-4379-962c-6a835e78c704 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:03.812795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b640ad8-ac90-4379-962c-6a835e78c704 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:03.874815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9b640ad8-ac90-4379-962c-6a835e78c704 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:03.882370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9b640ad8-ac90-4379-962c-6a835e78c704 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083447 Sep 01 05:30:03.882927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 846/1615] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:03 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:04.903263 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9749da39-d85c-4b33-9e70-d6bedc806d8b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:04.903872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9749da39-d85c-4b33-9e70-d6bedc806d8b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:04.910562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9749da39-d85c-4b33-9e70-d6bedc806d8b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:04.911034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9749da39-d85c-4b33-9e70-d6bedc806d8b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:04.911461 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9749da39-d85c-4b33-9e70-d6bedc806d8b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:04.912134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9749da39-d85c-4b33-9e70-d6bedc806d8b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:04.912581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9749da39-d85c-4b33-9e70-d6bedc806d8b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:04.913029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9749da39-d85c-4b33-9e70-d6bedc806d8b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:04.974168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9749da39-d85c-4b33-9e70-d6bedc806d8b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:04.981665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9749da39-d85c-4b33-9e70-d6bedc806d8b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082278 Sep 01 05:30:04.982222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 770/1616] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:04 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:06.002870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d91afa23-9d32-497e-8ce5-b288f11785b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:06.003521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d91afa23-9d32-497e-8ce5-b288f11785b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:06.010032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d91afa23-9d32-497e-8ce5-b288f11785b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:06.010505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d91afa23-9d32-497e-8ce5-b288f11785b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:06.010934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d91afa23-9d32-497e-8ce5-b288f11785b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:06.011609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d91afa23-9d32-497e-8ce5-b288f11785b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:06.012054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d91afa23-9d32-497e-8ce5-b288f11785b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:06.012467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d91afa23-9d32-497e-8ce5-b288f11785b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:06.072755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d91afa23-9d32-497e-8ce5-b288f11785b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:06.081364 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d91afa23-9d32-497e-8ce5-b288f11785b6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082324 Sep 01 05:30:06.081926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 847/1617] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:05 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:07.102316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-567d63f6-a87f-42d8-9b16-f217fee1395b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:07.102927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-567d63f6-a87f-42d8-9b16-f217fee1395b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:07.110460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-567d63f6-a87f-42d8-9b16-f217fee1395b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:07.110940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-567d63f6-a87f-42d8-9b16-f217fee1395b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:07.111372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-567d63f6-a87f-42d8-9b16-f217fee1395b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:07.112058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-567d63f6-a87f-42d8-9b16-f217fee1395b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:07.112509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-567d63f6-a87f-42d8-9b16-f217fee1395b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:07.112958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-567d63f6-a87f-42d8-9b16-f217fee1395b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:07.174295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-567d63f6-a87f-42d8-9b16-f217fee1395b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:07.181986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-567d63f6-a87f-42d8-9b16-f217fee1395b tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083536 Sep 01 05:30:07.182542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 771/1618] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:07 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:08.203259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-54789fe3-ad6f-4396-9c0d-46080b144e74 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:08.203868 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-54789fe3-ad6f-4396-9c0d-46080b144e74 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:08.209771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54789fe3-ad6f-4396-9c0d-46080b144e74 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:08.210245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54789fe3-ad6f-4396-9c0d-46080b144e74 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:08.210671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54789fe3-ad6f-4396-9c0d-46080b144e74 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:08.211352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54789fe3-ad6f-4396-9c0d-46080b144e74 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:08.211797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54789fe3-ad6f-4396-9c0d-46080b144e74 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:08.212214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54789fe3-ad6f-4396-9c0d-46080b144e74 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:08.274738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-54789fe3-ad6f-4396-9c0d-46080b144e74 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:08.282580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-54789fe3-ad6f-4396-9c0d-46080b144e74 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083434 Sep 01 05:30:08.283133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 848/1619] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:08 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:09.303953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-aa0e1abf-6b5b-469a-a638-b574b6ce3f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:09.304510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-aa0e1abf-6b5b-469a-a638-b574b6ce3f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:09.311731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa0e1abf-6b5b-469a-a638-b574b6ce3f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:09.312213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa0e1abf-6b5b-469a-a638-b574b6ce3f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:09.312645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa0e1abf-6b5b-469a-a638-b574b6ce3f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:09.313352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa0e1abf-6b5b-469a-a638-b574b6ce3f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:09.313804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa0e1abf-6b5b-469a-a638-b574b6ce3f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:09.314221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa0e1abf-6b5b-469a-a638-b574b6ce3f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:09.374593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-aa0e1abf-6b5b-469a-a638-b574b6ce3f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:09.382273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-aa0e1abf-6b5b-469a-a638-b574b6ce3f24 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082319 Sep 01 05:30:09.382836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 772/1620] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:09 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:10.403765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6968ac1a-9c6b-4611-904f-55e5df60ec99 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:10.404300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6968ac1a-9c6b-4611-904f-55e5df60ec99 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:10.406747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=23 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:10.412111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6968ac1a-9c6b-4611-904f-55e5df60ec99 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:10.412592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6968ac1a-9c6b-4611-904f-55e5df60ec99 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:10.413096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6968ac1a-9c6b-4611-904f-55e5df60ec99 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:10.413791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6968ac1a-9c6b-4611-904f-55e5df60ec99 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:10.414233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6968ac1a-9c6b-4611-904f-55e5df60ec99 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:10.414646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6968ac1a-9c6b-4611-904f-55e5df60ec99 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:10.417424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=67 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:10.479239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6968ac1a-9c6b-4611-904f-55e5df60ec99 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:10.487524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6968ac1a-9c6b-4611-904f-55e5df60ec99 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087822 Sep 01 05:30:10.488091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 849/1621] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:10 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:11.508993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-84e42b40-9b78-48ce-aa7c-cc7949f9734f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:11.509594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-84e42b40-9b78-48ce-aa7c-cc7949f9734f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:11.511856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=21 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:11.517181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84e42b40-9b78-48ce-aa7c-cc7949f9734f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:11.517658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84e42b40-9b78-48ce-aa7c-cc7949f9734f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:11.518083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84e42b40-9b78-48ce-aa7c-cc7949f9734f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:11.518761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84e42b40-9b78-48ce-aa7c-cc7949f9734f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:11.519201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84e42b40-9b78-48ce-aa7c-cc7949f9734f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:11.519613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84e42b40-9b78-48ce-aa7c-cc7949f9734f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:11.522346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=65 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:11.583364 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-84e42b40-9b78-48ce-aa7c-cc7949f9734f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:11.591523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-84e42b40-9b78-48ce-aa7c-cc7949f9734f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086468 Sep 01 05:30:11.592077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 773/1622] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:11 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:12.611888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-734c2ae3-65b0-4f3a-9652-b570eb38e813 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:12.612523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-734c2ae3-65b0-4f3a-9652-b570eb38e813 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:12.618940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-734c2ae3-65b0-4f3a-9652-b570eb38e813 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:12.619410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-734c2ae3-65b0-4f3a-9652-b570eb38e813 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:12.619834 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-734c2ae3-65b0-4f3a-9652-b570eb38e813 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:12.620504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-734c2ae3-65b0-4f3a-9652-b570eb38e813 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:12.620976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-734c2ae3-65b0-4f3a-9652-b570eb38e813 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:12.621932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-734c2ae3-65b0-4f3a-9652-b570eb38e813 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:12.682588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-734c2ae3-65b0-4f3a-9652-b570eb38e813 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:12.691691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-734c2ae3-65b0-4f3a-9652-b570eb38e813 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083608 Sep 01 05:30:12.692255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 850/1623] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:12 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:13.712990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cd324788-873a-4cb1-9c2b-2d04a43c4fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:13.713615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cd324788-873a-4cb1-9c2b-2d04a43c4fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:13.719714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd324788-873a-4cb1-9c2b-2d04a43c4fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:13.720195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd324788-873a-4cb1-9c2b-2d04a43c4fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:13.720624 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd324788-873a-4cb1-9c2b-2d04a43c4fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:13.721344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd324788-873a-4cb1-9c2b-2d04a43c4fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:13.721790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd324788-873a-4cb1-9c2b-2d04a43c4fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:13.722205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd324788-873a-4cb1-9c2b-2d04a43c4fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:13.783597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cd324788-873a-4cb1-9c2b-2d04a43c4fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:13.791173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cd324788-873a-4cb1-9c2b-2d04a43c4fd1 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082304 Sep 01 05:30:13.791724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 774/1624] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:13 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:14.813315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-867f6ccc-a37c-4bf9-8230-d5ebe82bbc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:14.813946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-867f6ccc-a37c-4bf9-8230-d5ebe82bbc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:14.820631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-867f6ccc-a37c-4bf9-8230-d5ebe82bbc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:14.821149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-867f6ccc-a37c-4bf9-8230-d5ebe82bbc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:14.821585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-867f6ccc-a37c-4bf9-8230-d5ebe82bbc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:14.822539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-867f6ccc-a37c-4bf9-8230-d5ebe82bbc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:14.822988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-867f6ccc-a37c-4bf9-8230-d5ebe82bbc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:14.823408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-867f6ccc-a37c-4bf9-8230-d5ebe82bbc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:14.887256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-867f6ccc-a37c-4bf9-8230-d5ebe82bbc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:14.895677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-867f6ccc-a37c-4bf9-8230-d5ebe82bbc33 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085708 Sep 01 05:30:14.895809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 851/1625] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:14 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:15.920888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4006e409-bcb8-4257-987c-940119e5a9e6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:15.920888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4006e409-bcb8-4257-987c-940119e5a9e6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:15.924601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4006e409-bcb8-4257-987c-940119e5a9e6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:15.925138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4006e409-bcb8-4257-987c-940119e5a9e6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:15.925576 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4006e409-bcb8-4257-987c-940119e5a9e6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:15.926281 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4006e409-bcb8-4257-987c-940119e5a9e6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:15.931831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4006e409-bcb8-4257-987c-940119e5a9e6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:15.932313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4006e409-bcb8-4257-987c-940119e5a9e6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:15.999280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4006e409-bcb8-4257-987c-940119e5a9e6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:16.007095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4006e409-bcb8-4257-987c-940119e5a9e6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.094370 Sep 01 05:30:16.007660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 775/1626] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:15 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:17.029200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-db398414-0bdc-4886-9186-515338390d96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:17.029795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-db398414-0bdc-4886-9186-515338390d96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:17.036194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db398414-0bdc-4886-9186-515338390d96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:17.036665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db398414-0bdc-4886-9186-515338390d96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:17.037123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db398414-0bdc-4886-9186-515338390d96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:17.037799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db398414-0bdc-4886-9186-515338390d96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:17.038243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db398414-0bdc-4886-9186-515338390d96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:17.038657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db398414-0bdc-4886-9186-515338390d96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:17.103830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-db398414-0bdc-4886-9186-515338390d96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:17.111791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-db398414-0bdc-4886-9186-515338390d96 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086645 Sep 01 05:30:17.112352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 852/1627] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:17 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:18.133225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1a94649b-d337-43e2-99cf-0bbe9e740d41 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:18.133840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1a94649b-d337-43e2-99cf-0bbe9e740d41 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:18.140742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a94649b-d337-43e2-99cf-0bbe9e740d41 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:18.141259 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a94649b-d337-43e2-99cf-0bbe9e740d41 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:18.141692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a94649b-d337-43e2-99cf-0bbe9e740d41 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:18.142383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a94649b-d337-43e2-99cf-0bbe9e740d41 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:18.142854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a94649b-d337-43e2-99cf-0bbe9e740d41 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:18.143282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1a94649b-d337-43e2-99cf-0bbe9e740d41 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:18.204127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1a94649b-d337-43e2-99cf-0bbe9e740d41 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:18.211845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1a94649b-d337-43e2-99cf-0bbe9e740d41 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082500 Sep 01 05:30:18.212417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 776/1628] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:18 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:19.233817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ae431648-d3d9-42d7-b955-503d142fc0b9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:19.234430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ae431648-d3d9-42d7-b955-503d142fc0b9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:19.240850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae431648-d3d9-42d7-b955-503d142fc0b9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:19.241329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae431648-d3d9-42d7-b955-503d142fc0b9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:19.241768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae431648-d3d9-42d7-b955-503d142fc0b9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:19.242450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae431648-d3d9-42d7-b955-503d142fc0b9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:19.242899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae431648-d3d9-42d7-b955-503d142fc0b9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:19.243320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae431648-d3d9-42d7-b955-503d142fc0b9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:19.304442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ae431648-d3d9-42d7-b955-503d142fc0b9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:19.312367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ae431648-d3d9-42d7-b955-503d142fc0b9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083155 Sep 01 05:30:19.312964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 853/1629] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:19 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:20.333744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9e72425c-79af-4004-bf4e-18c6eb788e39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:20.334354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9e72425c-79af-4004-bf4e-18c6eb788e39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:20.341172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e72425c-79af-4004-bf4e-18c6eb788e39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:20.341648 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e72425c-79af-4004-bf4e-18c6eb788e39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:20.342079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e72425c-79af-4004-bf4e-18c6eb788e39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:20.342754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e72425c-79af-4004-bf4e-18c6eb788e39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:20.343204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e72425c-79af-4004-bf4e-18c6eb788e39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:20.343625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e72425c-79af-4004-bf4e-18c6eb788e39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:20.409894 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9e72425c-79af-4004-bf4e-18c6eb788e39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:20.418677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9e72425c-79af-4004-bf4e-18c6eb788e39 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088788 Sep 01 05:30:20.419239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 777/1630] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:20 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:21.439694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-241fa8da-3777-4f52-aef0-be133800500f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:21.440311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-241fa8da-3777-4f52-aef0-be133800500f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:21.447068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-241fa8da-3777-4f52-aef0-be133800500f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:21.447550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-241fa8da-3777-4f52-aef0-be133800500f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:21.447991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-241fa8da-3777-4f52-aef0-be133800500f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:21.449503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-241fa8da-3777-4f52-aef0-be133800500f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:21.449958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-241fa8da-3777-4f52-aef0-be133800500f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:21.450384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-241fa8da-3777-4f52-aef0-be133800500f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:21.512181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-241fa8da-3777-4f52-aef0-be133800500f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:21.519876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-241fa8da-3777-4f52-aef0-be133800500f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084040 Sep 01 05:30:21.520435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 854/1631] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:21 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:22.540560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1c77c508-fcc8-4b0d-8067-712ceeee8a5f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:22.541195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1c77c508-fcc8-4b0d-8067-712ceeee8a5f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:22.547837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c77c508-fcc8-4b0d-8067-712ceeee8a5f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:22.548315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c77c508-fcc8-4b0d-8067-712ceeee8a5f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:22.548748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c77c508-fcc8-4b0d-8067-712ceeee8a5f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:22.549450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c77c508-fcc8-4b0d-8067-712ceeee8a5f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:22.549903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c77c508-fcc8-4b0d-8067-712ceeee8a5f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:22.550323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1c77c508-fcc8-4b0d-8067-712ceeee8a5f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:22.611728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1c77c508-fcc8-4b0d-8067-712ceeee8a5f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:22.619284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1c77c508-fcc8-4b0d-8067-712ceeee8a5f tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082643 Sep 01 05:30:22.619886 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 778/1632] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:22 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:23.640236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-81e39974-1f64-481d-b3cd-dfae65e4bbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:23.640880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-81e39974-1f64-481d-b3cd-dfae65e4bbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:23.647340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81e39974-1f64-481d-b3cd-dfae65e4bbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:23.647806 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81e39974-1f64-481d-b3cd-dfae65e4bbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:23.648230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81e39974-1f64-481d-b3cd-dfae65e4bbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:23.648939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81e39974-1f64-481d-b3cd-dfae65e4bbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:23.649383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81e39974-1f64-481d-b3cd-dfae65e4bbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:23.649797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81e39974-1f64-481d-b3cd-dfae65e4bbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:23.711047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-81e39974-1f64-481d-b3cd-dfae65e4bbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:23.718844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-81e39974-1f64-481d-b3cd-dfae65e4bbe5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083257 Sep 01 05:30:23.719402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 855/1633] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:23 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:24.738874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4a05be1e-44e0-4a30-94ea-32fa48537130 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:24.739486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4a05be1e-44e0-4a30-94ea-32fa48537130 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:24.746314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a05be1e-44e0-4a30-94ea-32fa48537130 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:24.746800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a05be1e-44e0-4a30-94ea-32fa48537130 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:24.747233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a05be1e-44e0-4a30-94ea-32fa48537130 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:24.747955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a05be1e-44e0-4a30-94ea-32fa48537130 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:24.748413 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a05be1e-44e0-4a30-94ea-32fa48537130 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:24.748865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a05be1e-44e0-4a30-94ea-32fa48537130 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:24.809763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4a05be1e-44e0-4a30-94ea-32fa48537130 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:24.817483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4a05be1e-44e0-4a30-94ea-32fa48537130 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082509 Sep 01 05:30:24.818032 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 779/1634] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:24 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:25.840363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9ac0efed-3a6f-492c-ba49-1f041021071e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:25.841029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9ac0efed-3a6f-492c-ba49-1f041021071e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:25.847455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ac0efed-3a6f-492c-ba49-1f041021071e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:25.847929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ac0efed-3a6f-492c-ba49-1f041021071e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:25.848358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ac0efed-3a6f-492c-ba49-1f041021071e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:25.849074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ac0efed-3a6f-492c-ba49-1f041021071e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:25.849518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ac0efed-3a6f-492c-ba49-1f041021071e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:25.849929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ac0efed-3a6f-492c-ba49-1f041021071e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:25.913833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ac0efed-3a6f-492c-ba49-1f041021071e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:25.922413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9ac0efed-3a6f-492c-ba49-1f041021071e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086834 Sep 01 05:30:25.922979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 856/1635] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:25 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:26.943454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1bd5da0d-8a10-4da6-bd19-1a738a9389c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:26.944062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1bd5da0d-8a10-4da6-bd19-1a738a9389c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:26.951849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1bd5da0d-8a10-4da6-bd19-1a738a9389c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:26.952327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1bd5da0d-8a10-4da6-bd19-1a738a9389c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:26.952756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1bd5da0d-8a10-4da6-bd19-1a738a9389c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:26.953458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1bd5da0d-8a10-4da6-bd19-1a738a9389c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:26.953907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1bd5da0d-8a10-4da6-bd19-1a738a9389c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:26.954323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1bd5da0d-8a10-4da6-bd19-1a738a9389c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:27.015249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1bd5da0d-8a10-4da6-bd19-1a738a9389c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:27.022881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1bd5da0d-8a10-4da6-bd19-1a738a9389c2 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083293 Sep 01 05:30:27.023442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 780/1636] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:26 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:28.043611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1331c137-b4cf-4bbc-8502-3829fe7f96d4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:28.044221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1331c137-b4cf-4bbc-8502-3829fe7f96d4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:28.050690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1331c137-b4cf-4bbc-8502-3829fe7f96d4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:28.051162 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1331c137-b4cf-4bbc-8502-3829fe7f96d4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:28.051589 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1331c137-b4cf-4bbc-8502-3829fe7f96d4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:28.052270 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1331c137-b4cf-4bbc-8502-3829fe7f96d4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:28.052711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1331c137-b4cf-4bbc-8502-3829fe7f96d4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:28.053151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1331c137-b4cf-4bbc-8502-3829fe7f96d4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:28.115052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1331c137-b4cf-4bbc-8502-3829fe7f96d4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:28.123463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1331c137-b4cf-4bbc-8502-3829fe7f96d4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083889 Sep 01 05:30:28.124016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 857/1637] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:28 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:29.144450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f1dcb0c9-da93-42ca-8267-366b0d38bef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:29.145091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f1dcb0c9-da93-42ca-8267-366b0d38bef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:29.152322 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f1dcb0c9-da93-42ca-8267-366b0d38bef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:29.152717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f1dcb0c9-da93-42ca-8267-366b0d38bef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:29.153180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f1dcb0c9-da93-42ca-8267-366b0d38bef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:29.153868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f1dcb0c9-da93-42ca-8267-366b0d38bef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:29.154317 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f1dcb0c9-da93-42ca-8267-366b0d38bef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:29.154739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f1dcb0c9-da93-42ca-8267-366b0d38bef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:29.220283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f1dcb0c9-da93-42ca-8267-366b0d38bef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:29.228562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f1dcb0c9-da93-42ca-8267-366b0d38bef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087463 Sep 01 05:30:29.229166 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 781/1638] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:29 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:30.249854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-08f3fb9b-f0aa-452a-a1c5-29a078a9a8e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:30.250489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-08f3fb9b-f0aa-452a-a1c5-29a078a9a8e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:30.256982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08f3fb9b-f0aa-452a-a1c5-29a078a9a8e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:30.257456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08f3fb9b-f0aa-452a-a1c5-29a078a9a8e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:30.257881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08f3fb9b-f0aa-452a-a1c5-29a078a9a8e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:30.258558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08f3fb9b-f0aa-452a-a1c5-29a078a9a8e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:30.259733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08f3fb9b-f0aa-452a-a1c5-29a078a9a8e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:30.260156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08f3fb9b-f0aa-452a-a1c5-29a078a9a8e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:30.327768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-08f3fb9b-f0aa-452a-a1c5-29a078a9a8e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:30.335561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-08f3fb9b-f0aa-452a-a1c5-29a078a9a8e9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.089528 Sep 01 05:30:30.336126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 858/1639] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:30 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:31.356268 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-24e0a18c-3305-42bd-a867-d1692a8562c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:31.356894 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-24e0a18c-3305-42bd-a867-d1692a8562c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:31.363446 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24e0a18c-3305-42bd-a867-d1692a8562c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:31.363934 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24e0a18c-3305-42bd-a867-d1692a8562c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:31.364369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24e0a18c-3305-42bd-a867-d1692a8562c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:31.365086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24e0a18c-3305-42bd-a867-d1692a8562c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:31.365535 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24e0a18c-3305-42bd-a867-d1692a8562c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:31.365949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-24e0a18c-3305-42bd-a867-d1692a8562c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:31.433171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-24e0a18c-3305-42bd-a867-d1692a8562c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:31.441463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-24e0a18c-3305-42bd-a867-d1692a8562c8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.089720 Sep 01 05:30:31.442236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 782/1640] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:31 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:32.462986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9eb8be43-d59f-4a75-a7fe-6e648ce94bf0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:32.463598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9eb8be43-d59f-4a75-a7fe-6e648ce94bf0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:32.470204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9eb8be43-d59f-4a75-a7fe-6e648ce94bf0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:32.470673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9eb8be43-d59f-4a75-a7fe-6e648ce94bf0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:32.471122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9eb8be43-d59f-4a75-a7fe-6e648ce94bf0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:32.471799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9eb8be43-d59f-4a75-a7fe-6e648ce94bf0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:32.472360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9eb8be43-d59f-4a75-a7fe-6e648ce94bf0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:32.472843 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9eb8be43-d59f-4a75-a7fe-6e648ce94bf0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:32.536031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9eb8be43-d59f-4a75-a7fe-6e648ce94bf0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:32.544679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9eb8be43-d59f-4a75-a7fe-6e648ce94bf0 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085776 Sep 01 05:30:32.545532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 859/1641] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:32 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:33.566443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-90bfbab6-85d3-404a-ae4f-8ec19944c0a9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:33.567048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-90bfbab6-85d3-404a-ae4f-8ec19944c0a9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:33.574533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90bfbab6-85d3-404a-ae4f-8ec19944c0a9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:33.575009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90bfbab6-85d3-404a-ae4f-8ec19944c0a9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:33.575436 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90bfbab6-85d3-404a-ae4f-8ec19944c0a9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:33.576125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90bfbab6-85d3-404a-ae4f-8ec19944c0a9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:33.576574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90bfbab6-85d3-404a-ae4f-8ec19944c0a9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:33.577025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90bfbab6-85d3-404a-ae4f-8ec19944c0a9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:33.641327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-90bfbab6-85d3-404a-ae4f-8ec19944c0a9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:33.649328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-90bfbab6-85d3-404a-ae4f-8ec19944c0a9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087070 Sep 01 05:30:33.649895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 783/1642] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:33 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:34.670859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b5b79a8e-65cb-40dd-878a-ff7453177ef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:34.671471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b5b79a8e-65cb-40dd-878a-ff7453177ef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:34.678220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5b79a8e-65cb-40dd-878a-ff7453177ef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:34.678716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5b79a8e-65cb-40dd-878a-ff7453177ef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:34.679149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5b79a8e-65cb-40dd-878a-ff7453177ef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:34.679845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5b79a8e-65cb-40dd-878a-ff7453177ef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:34.681268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5b79a8e-65cb-40dd-878a-ff7453177ef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:34.681700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5b79a8e-65cb-40dd-878a-ff7453177ef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:34.748824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b5b79a8e-65cb-40dd-878a-ff7453177ef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:34.757012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b5b79a8e-65cb-40dd-878a-ff7453177ef6 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.089911 Sep 01 05:30:34.757746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 860/1643] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:34 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:35.779241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a5f057d7-3d23-423e-ad41-a8a3ef50e51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:35.780567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a5f057d7-3d23-423e-ad41-a8a3ef50e51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:35.786096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5f057d7-3d23-423e-ad41-a8a3ef50e51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:35.786587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5f057d7-3d23-423e-ad41-a8a3ef50e51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:35.787027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5f057d7-3d23-423e-ad41-a8a3ef50e51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:35.787723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5f057d7-3d23-423e-ad41-a8a3ef50e51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:35.788175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5f057d7-3d23-423e-ad41-a8a3ef50e51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:35.788598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5f057d7-3d23-423e-ad41-a8a3ef50e51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:35.853999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a5f057d7-3d23-423e-ad41-a8a3ef50e51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:35.861819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a5f057d7-3d23-423e-ad41-a8a3ef50e51c tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087690 Sep 01 05:30:35.862386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 784/1644] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:35 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:36.883548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c32b8692-0a3c-4e71-a623-386adf305cea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:36.884169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c32b8692-0a3c-4e71-a623-386adf305cea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:36.890756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c32b8692-0a3c-4e71-a623-386adf305cea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:36.891242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c32b8692-0a3c-4e71-a623-386adf305cea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:36.891680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c32b8692-0a3c-4e71-a623-386adf305cea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:36.892379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c32b8692-0a3c-4e71-a623-386adf305cea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:36.892861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c32b8692-0a3c-4e71-a623-386adf305cea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:36.893286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c32b8692-0a3c-4e71-a623-386adf305cea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:36.954365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c32b8692-0a3c-4e71-a623-386adf305cea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:36.962129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c32b8692-0a3c-4e71-a623-386adf305cea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082585 Sep 01 05:30:36.962700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 861/1645] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:36 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:37.983036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-89fa4ddb-3927-483d-8178-4d78fad9a4c5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:37.983648 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-89fa4ddb-3927-483d-8178-4d78fad9a4c5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:37.990171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89fa4ddb-3927-483d-8178-4d78fad9a4c5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:37.990652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89fa4ddb-3927-483d-8178-4d78fad9a4c5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:37.991086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89fa4ddb-3927-483d-8178-4d78fad9a4c5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:37.991766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89fa4ddb-3927-483d-8178-4d78fad9a4c5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:37.992217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89fa4ddb-3927-483d-8178-4d78fad9a4c5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:37.992633 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89fa4ddb-3927-483d-8178-4d78fad9a4c5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:38.056970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-89fa4ddb-3927-483d-8178-4d78fad9a4c5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:38.066145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-89fa4ddb-3927-483d-8178-4d78fad9a4c5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087280 Sep 01 05:30:38.066649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 785/1646] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:37 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:39.087098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1026e7c7-08b4-45c6-ad78-9d2cf26cd55a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:39.087821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1026e7c7-08b4-45c6-ad78-9d2cf26cd55a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:39.094784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1026e7c7-08b4-45c6-ad78-9d2cf26cd55a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:39.095339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1026e7c7-08b4-45c6-ad78-9d2cf26cd55a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:39.095840 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1026e7c7-08b4-45c6-ad78-9d2cf26cd55a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:39.096531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1026e7c7-08b4-45c6-ad78-9d2cf26cd55a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:39.097009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1026e7c7-08b4-45c6-ad78-9d2cf26cd55a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:39.097429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1026e7c7-08b4-45c6-ad78-9d2cf26cd55a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:39.158910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1026e7c7-08b4-45c6-ad78-9d2cf26cd55a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:39.167592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1026e7c7-08b4-45c6-ad78-9d2cf26cd55a tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084261 Sep 01 05:30:39.168382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 862/1647] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:39 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:40.187630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-020e8662-cb88-4881-b95c-173549ac5933 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:40.188187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-020e8662-cb88-4881-b95c-173549ac5933 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:40.195044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-020e8662-cb88-4881-b95c-173549ac5933 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:40.195528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-020e8662-cb88-4881-b95c-173549ac5933 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:40.195962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-020e8662-cb88-4881-b95c-173549ac5933 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:40.196646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-020e8662-cb88-4881-b95c-173549ac5933 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:40.197127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-020e8662-cb88-4881-b95c-173549ac5933 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:40.197551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-020e8662-cb88-4881-b95c-173549ac5933 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:40.258205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-020e8662-cb88-4881-b95c-173549ac5933 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:40.265858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-020e8662-cb88-4881-b95c-173549ac5933 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082150 Sep 01 05:30:40.266421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 786/1648] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:40 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:41.287733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-38014644-a941-45c5-a6df-afb20fa9b708 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:41.288630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-38014644-a941-45c5-a6df-afb20fa9b708 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:41.290989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=28 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:41.297258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38014644-a941-45c5-a6df-afb20fa9b708 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:41.297731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38014644-a941-45c5-a6df-afb20fa9b708 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:41.298157 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38014644-a941-45c5-a6df-afb20fa9b708 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:41.298829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38014644-a941-45c5-a6df-afb20fa9b708 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:41.299270 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38014644-a941-45c5-a6df-afb20fa9b708 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:41.299684 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38014644-a941-45c5-a6df-afb20fa9b708 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:41.303681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=84 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:41.362777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-38014644-a941-45c5-a6df-afb20fa9b708 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:41.371299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-38014644-a941-45c5-a6df-afb20fa9b708 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087729 Sep 01 05:30:41.371869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 863/1649] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:41 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:42.392330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-155bc85c-7afd-429e-a67e-acd039b07eea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:42.392988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-155bc85c-7afd-429e-a67e-acd039b07eea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:42.395291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=28 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:42.400987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-155bc85c-7afd-429e-a67e-acd039b07eea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:42.401473 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-155bc85c-7afd-429e-a67e-acd039b07eea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:42.401905 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-155bc85c-7afd-429e-a67e-acd039b07eea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:42.402594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-155bc85c-7afd-429e-a67e-acd039b07eea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:42.403044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-155bc85c-7afd-429e-a67e-acd039b07eea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:42.403469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-155bc85c-7afd-429e-a67e-acd039b07eea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:42.406244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=84 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:42.467016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-155bc85c-7afd-429e-a67e-acd039b07eea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:42.474528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-155bc85c-7afd-429e-a67e-acd039b07eea tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086474 Sep 01 05:30:42.475096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 787/1650] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:42 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:43.496008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bf43df8c-bc56-4815-9609-687e22bb2f19 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:43.496645 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bf43df8c-bc56-4815-9609-687e22bb2f19 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:43.503207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf43df8c-bc56-4815-9609-687e22bb2f19 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:43.503678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf43df8c-bc56-4815-9609-687e22bb2f19 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:43.504107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf43df8c-bc56-4815-9609-687e22bb2f19 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:43.504791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf43df8c-bc56-4815-9609-687e22bb2f19 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:43.505249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf43df8c-bc56-4815-9609-687e22bb2f19 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:43.505666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf43df8c-bc56-4815-9609-687e22bb2f19 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:43.568649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bf43df8c-bc56-4815-9609-687e22bb2f19 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:43.577059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bf43df8c-bc56-4815-9609-687e22bb2f19 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.085325 Sep 01 05:30:43.577622 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 864/1651] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:43 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:44.599052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-97197a1a-1c1f-4260-9c99-a8adbc679dbd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:44.599609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-97197a1a-1c1f-4260-9c99-a8adbc679dbd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:44.605917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97197a1a-1c1f-4260-9c99-a8adbc679dbd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:44.606403 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97197a1a-1c1f-4260-9c99-a8adbc679dbd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:44.606842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97197a1a-1c1f-4260-9c99-a8adbc679dbd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:44.607530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97197a1a-1c1f-4260-9c99-a8adbc679dbd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:44.607981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97197a1a-1c1f-4260-9c99-a8adbc679dbd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:44.608410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97197a1a-1c1f-4260-9c99-a8adbc679dbd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:44.673659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-97197a1a-1c1f-4260-9c99-a8adbc679dbd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:44.681888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-97197a1a-1c1f-4260-9c99-a8adbc679dbd tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086452 Sep 01 05:30:44.682456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 788/1652] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:44 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:45.703235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-73824be8-ed90-4ad2-92e4-49ad2e137df3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:45.703822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-73824be8-ed90-4ad2-92e4-49ad2e137df3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:45.710227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73824be8-ed90-4ad2-92e4-49ad2e137df3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:45.710702 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73824be8-ed90-4ad2-92e4-49ad2e137df3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:45.711125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73824be8-ed90-4ad2-92e4-49ad2e137df3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:45.711795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73824be8-ed90-4ad2-92e4-49ad2e137df3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:45.712894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73824be8-ed90-4ad2-92e4-49ad2e137df3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:45.713334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73824be8-ed90-4ad2-92e4-49ad2e137df3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:45.780548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-73824be8-ed90-4ad2-92e4-49ad2e137df3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:45.788089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-73824be8-ed90-4ad2-92e4-49ad2e137df3 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.088696 Sep 01 05:30:45.788641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 865/1653] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:45 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:46.808657 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ea4ec025-27a8-45d6-bc47-ffec450442fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:46.809271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ea4ec025-27a8-45d6-bc47-ffec450442fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:46.816115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ea4ec025-27a8-45d6-bc47-ffec450442fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:46.816589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ea4ec025-27a8-45d6-bc47-ffec450442fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:46.817041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ea4ec025-27a8-45d6-bc47-ffec450442fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:46.817717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ea4ec025-27a8-45d6-bc47-ffec450442fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:46.818157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ea4ec025-27a8-45d6-bc47-ffec450442fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:46.818568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ea4ec025-27a8-45d6-bc47-ffec450442fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:46.878870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ea4ec025-27a8-45d6-bc47-ffec450442fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:46.886671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ea4ec025-27a8-45d6-bc47-ffec450442fa tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081849 Sep 01 05:30:46.887308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 789/1654] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:46 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:47.907601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-44e84691-851a-48e9-a2e6-da69dbd49713 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:47.908211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-44e84691-851a-48e9-a2e6-da69dbd49713 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:47.914668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44e84691-851a-48e9-a2e6-da69dbd49713 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:47.915859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44e84691-851a-48e9-a2e6-da69dbd49713 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:47.916292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44e84691-851a-48e9-a2e6-da69dbd49713 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:47.916999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44e84691-851a-48e9-a2e6-da69dbd49713 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:47.917445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44e84691-851a-48e9-a2e6-da69dbd49713 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:47.917859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-44e84691-851a-48e9-a2e6-da69dbd49713 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:47.983650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-44e84691-851a-48e9-a2e6-da69dbd49713 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:47.991212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-44e84691-851a-48e9-a2e6-da69dbd49713 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087426 Sep 01 05:30:47.991769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 866/1655] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:47 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:49.012978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1eb893f2-93d4-44dd-abec-99f3e760edf9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:49.013594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1eb893f2-93d4-44dd-abec-99f3e760edf9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:49.020091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1eb893f2-93d4-44dd-abec-99f3e760edf9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:49.020606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1eb893f2-93d4-44dd-abec-99f3e760edf9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:49.021076 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1eb893f2-93d4-44dd-abec-99f3e760edf9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:49.021802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1eb893f2-93d4-44dd-abec-99f3e760edf9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:49.022257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1eb893f2-93d4-44dd-abec-99f3e760edf9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:49.022682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1eb893f2-93d4-44dd-abec-99f3e760edf9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:49.085378 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1eb893f2-93d4-44dd-abec-99f3e760edf9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:49.093178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1eb893f2-93d4-44dd-abec-99f3e760edf9 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084446 Sep 01 05:30:49.093746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 790/1656] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:49 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:50.114000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-129755ce-6065-426c-821f-f4189b8c7c54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:50.114530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-129755ce-6065-426c-821f-f4189b8c7c54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:50.121315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-129755ce-6065-426c-821f-f4189b8c7c54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:50.121792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-129755ce-6065-426c-821f-f4189b8c7c54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:50.122215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-129755ce-6065-426c-821f-f4189b8c7c54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:50.122890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-129755ce-6065-426c-821f-f4189b8c7c54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:50.123516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-129755ce-6065-426c-821f-f4189b8c7c54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:50.123936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-129755ce-6065-426c-821f-f4189b8c7c54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:50.185542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-129755ce-6065-426c-821f-f4189b8c7c54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:50.193689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-129755ce-6065-426c-821f-f4189b8c7c54 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.083371 Sep 01 05:30:50.194259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 867/1657] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:50 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:51.216338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-535072c3-2f8c-4001-aeb6-aa49240f4db4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:51.217346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-535072c3-2f8c-4001-aeb6-aa49240f4db4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:51.223569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-535072c3-2f8c-4001-aeb6-aa49240f4db4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:51.224051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-535072c3-2f8c-4001-aeb6-aa49240f4db4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:51.224482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-535072c3-2f8c-4001-aeb6-aa49240f4db4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:51.225221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-535072c3-2f8c-4001-aeb6-aa49240f4db4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:51.225674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-535072c3-2f8c-4001-aeb6-aa49240f4db4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:51.226092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-535072c3-2f8c-4001-aeb6-aa49240f4db4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:51.287522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-535072c3-2f8c-4001-aeb6-aa49240f4db4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:51.296059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-535072c3-2f8c-4001-aeb6-aa49240f4db4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084970 Sep 01 05:30:51.296625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 791/1658] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:51 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:52.317774 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6e1d8330-d90e-4068-ba01-c811d6de8cb4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:52.318362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6e1d8330-d90e-4068-ba01-c811d6de8cb4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:52.325389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6e1d8330-d90e-4068-ba01-c811d6de8cb4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:52.325898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6e1d8330-d90e-4068-ba01-c811d6de8cb4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:52.326658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6e1d8330-d90e-4068-ba01-c811d6de8cb4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:52.326959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6e1d8330-d90e-4068-ba01-c811d6de8cb4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:52.327400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6e1d8330-d90e-4068-ba01-c811d6de8cb4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:52.327817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6e1d8330-d90e-4068-ba01-c811d6de8cb4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:52.393376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6e1d8330-d90e-4068-ba01-c811d6de8cb4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:52.401069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6e1d8330-d90e-4068-ba01-c811d6de8cb4 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.087375 Sep 01 05:30:52.401629 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 868/1659] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:52 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:53.422238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-60c6c38e-2c73-43a4-973d-2239c0d0dbf8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:53.422842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-60c6c38e-2c73-43a4-973d-2239c0d0dbf8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:53.429198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60c6c38e-2c73-43a4-973d-2239c0d0dbf8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:53.430355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60c6c38e-2c73-43a4-973d-2239c0d0dbf8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:53.430959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60c6c38e-2c73-43a4-973d-2239c0d0dbf8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:53.431641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60c6c38e-2c73-43a4-973d-2239c0d0dbf8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:53.432083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60c6c38e-2c73-43a4-973d-2239c0d0dbf8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:53.432494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60c6c38e-2c73-43a4-973d-2239c0d0dbf8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:53.496742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-60c6c38e-2c73-43a4-973d-2239c0d0dbf8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:53.504489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-60c6c38e-2c73-43a4-973d-2239c0d0dbf8 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.086076 Sep 01 05:30:53.505121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 792/1660] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:53 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:54.527023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-77d2f9c1-b16a-456a-9133-8173c1495309 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:54.527631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-77d2f9c1-b16a-456a-9133-8173c1495309 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:54.534034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77d2f9c1-b16a-456a-9133-8173c1495309 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:54.534508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77d2f9c1-b16a-456a-9133-8173c1495309 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:54.534931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77d2f9c1-b16a-456a-9133-8173c1495309 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:54.535605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77d2f9c1-b16a-456a-9133-8173c1495309 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:54.536047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77d2f9c1-b16a-456a-9133-8173c1495309 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:54.536459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77d2f9c1-b16a-456a-9133-8173c1495309 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:54.611759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-77d2f9c1-b16a-456a-9133-8173c1495309 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:54.619280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-77d2f9c1-b16a-456a-9133-8173c1495309 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.096738 Sep 01 05:30:54.619840 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 869/1661] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:54 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:55.640539 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b2c00601-c1e4-4fe7-8467-5e93b3812f0e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:55.641182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b2c00601-c1e4-4fe7-8467-5e93b3812f0e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:55.647614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2c00601-c1e4-4fe7-8467-5e93b3812f0e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:55.648302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2c00601-c1e4-4fe7-8467-5e93b3812f0e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:55.648733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2c00601-c1e4-4fe7-8467-5e93b3812f0e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:55.649441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2c00601-c1e4-4fe7-8467-5e93b3812f0e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:55.649892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2c00601-c1e4-4fe7-8467-5e93b3812f0e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:55.650316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2c00601-c1e4-4fe7-8467-5e93b3812f0e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:55.711712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b2c00601-c1e4-4fe7-8467-5e93b3812f0e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:55.719377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b2c00601-c1e4-4fe7-8467-5e93b3812f0e tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082684 Sep 01 05:30:55.719935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 793/1662] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:55 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:56.740192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d844a6fd-1aed-4752-8a1d-d9e4177cb9bc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:56.740814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d844a6fd-1aed-4752-8a1d-d9e4177cb9bc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:56.748286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d844a6fd-1aed-4752-8a1d-d9e4177cb9bc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:56.748764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d844a6fd-1aed-4752-8a1d-d9e4177cb9bc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:56.749225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d844a6fd-1aed-4752-8a1d-d9e4177cb9bc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:56.749907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d844a6fd-1aed-4752-8a1d-d9e4177cb9bc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:56.750354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d844a6fd-1aed-4752-8a1d-d9e4177cb9bc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:56.750773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d844a6fd-1aed-4752-8a1d-d9e4177cb9bc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:56.812383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d844a6fd-1aed-4752-8a1d-d9e4177cb9bc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:56.820543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d844a6fd-1aed-4752-8a1d-d9e4177cb9bc tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.084210 Sep 01 05:30:56.821163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 870/1663] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:56 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:57.841811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-43b8feb4-fa0d-4784-8701-168e5bba10ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:57.842429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-43b8feb4-fa0d-4784-8701-168e5bba10ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:57.848915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43b8feb4-fa0d-4784-8701-168e5bba10ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:57.849390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43b8feb4-fa0d-4784-8701-168e5bba10ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:57.849815 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43b8feb4-fa0d-4784-8701-168e5bba10ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:57.850502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43b8feb4-fa0d-4784-8701-168e5bba10ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:57.850957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43b8feb4-fa0d-4784-8701-168e5bba10ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:57.851367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43b8feb4-fa0d-4784-8701-168e5bba10ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:57.911834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-43b8feb4-fa0d-4784-8701-168e5bba10ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:57.919962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-43b8feb4-fa0d-4784-8701-168e5bba10ef tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.081967 Sep 01 05:30:57.920523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 794/1664] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:57 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:58.942340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6a4c3e1b-17cb-4f8b-9de7-fc743b6d3bac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:58.942984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6a4c3e1b-17cb-4f8b-9de7-fc743b6d3bac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:58.949839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6a4c3e1b-17cb-4f8b-9de7-fc743b6d3bac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:58.950312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6a4c3e1b-17cb-4f8b-9de7-fc743b6d3bac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:58.950748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6a4c3e1b-17cb-4f8b-9de7-fc743b6d3bac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:58.951427 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6a4c3e1b-17cb-4f8b-9de7-fc743b6d3bac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:58.951871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6a4c3e1b-17cb-4f8b-9de7-fc743b6d3bac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:58.952288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6a4c3e1b-17cb-4f8b-9de7-fc743b6d3bac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:59.013121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6a4c3e1b-17cb-4f8b-9de7-fc743b6d3bac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:59.020716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6a4c3e1b-17cb-4f8b-9de7-fc743b6d3bac tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.082550 Sep 01 05:30:59.021315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 871/1665] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:58 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:00.043483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cd4f021d-b12f-4218-8197-a693f1346c81 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:00.044436 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cd4f021d-b12f-4218-8197-a693f1346c81 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:00.052013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd4f021d-b12f-4218-8197-a693f1346c81 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:00.052730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd4f021d-b12f-4218-8197-a693f1346c81 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:00.053441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd4f021d-b12f-4218-8197-a693f1346c81 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:00.054402 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd4f021d-b12f-4218-8197-a693f1346c81 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:00.055057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd4f021d-b12f-4218-8197-a693f1346c81 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:00.055691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd4f021d-b12f-4218-8197-a693f1346c81 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:00.122176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cd4f021d-b12f-4218-8197-a693f1346c81 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73516e6aed494ab597cb824180a617a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83248d1861c4e6cbb480e5af9733575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:00.129876 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cd4f021d-b12f-4218-8197-a693f1346c81 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 200 len: 1225 microversion: 2.1 time: 0.091305 Sep 01 05:31:00.130444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 795/1666] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:00 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:00.870569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a862f6b7-3c60-4944-a89a-b4144c99254d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:00.871086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a862f6b7-3c60-4944-a89a-b4144c99254d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:00.877391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a862f6b7-3c60-4944-a89a-b4144c99254d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:00.877857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a862f6b7-3c60-4944-a89a-b4144c99254d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:00.878346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a862f6b7-3c60-4944-a89a-b4144c99254d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:00.879026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a862f6b7-3c60-4944-a89a-b4144c99254d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:00.879465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a862f6b7-3c60-4944-a89a-b4144c99254d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:00.879873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a862f6b7-3c60-4944-a89a-b4144c99254d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:00.907019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a862f6b7-3c60-4944-a89a-b4144c99254d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:31:01.151568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b6d470fa-c137-4d87-b1ba-5f0e7d4081e5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:01.153255 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b6d470fa-c137-4d87-b1ba-5f0e7d4081e5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] [instance: d673fb27-cefb-470e-85e8-9189c59d1c5c] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:01.155644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a862f6b7-3c60-4944-a89a-b4144c99254d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 204 len: 0 microversion: 2.20 time: 0.288590 Sep 01 05:31:01.156272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 872/1667] 10.222.0.49 () {60 vars in 1280 bytes} [Thu Sep 1 05:31:00 2022] DELETE /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:31:01.161750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6d470fa-c137-4d87-b1ba-5f0e7d4081e5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:01.162230 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6d470fa-c137-4d87-b1ba-5f0e7d4081e5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:01.162669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6d470fa-c137-4d87-b1ba-5f0e7d4081e5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.163364 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6d470fa-c137-4d87-b1ba-5f0e7d4081e5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:01.163809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6d470fa-c137-4d87-b1ba-5f0e7d4081e5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:01.164228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6d470fa-c137-4d87-b1ba-5f0e7d4081e5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.165953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5a56ded7-b537-46ef-bd87-f59b79238cbd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:01.166650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5a56ded7-b537-46ef-bd87-f59b79238cbd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:01.172378 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a56ded7-b537-46ef-bd87-f59b79238cbd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:01.172888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a56ded7-b537-46ef-bd87-f59b79238cbd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:01.173321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a56ded7-b537-46ef-bd87-f59b79238cbd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.174006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a56ded7-b537-46ef-bd87-f59b79238cbd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:01.174454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a56ded7-b537-46ef-bd87-f59b79238cbd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:01.174875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5a56ded7-b537-46ef-bd87-f59b79238cbd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.178595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-b6d470fa-c137-4d87-b1ba-5f0e7d4081e5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] HTTP exception thrown: Instance d673fb27-cefb-470e-85e8-9189c59d1c5c could not be found. Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b6d470fa-c137-4d87-b1ba-5f0e7d4081e5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Request method failure captured: Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c HTTP/1.1 Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEECSlJ4Rq3sTILxLPQ4lLBx0ta5viyhFDCWR42mTyHzHooDHuI5SfCY_DaJxa0wcGbVodrm9Ymfv1_zxZ2N8KFzFj0Nfs-MW4tNnTrtK8K2-ntFY1kSYOk3CEsj5CAjQmUIAv5v2VPtRnthO3i3g2scD_wlSx_PymFlqZwe_KY8D6iE Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: f83248d1861c4e6cbb480e5af9733575 Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-TestVolumeBootPattern-1989447752 Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:31:01.180210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:31:01.181711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f83248d1861c4e6cbb480e5af9733575", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f83248d1861c4e6cbb480e5af9733575"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f83248d1861c4e6cbb480e5af9733575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f83248d1861c4e6cbb480e5af9733575"}]}] Sep 01 05:31:01.181711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-TestVolumeBootPattern-1989447752 Sep 01 05:31:01.181711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: f83248d1861c4e6cbb480e5af9733575 Sep 01 05:31:01.181711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-TestVolumeBootPattern-1989447752 Sep 01 05:31:01.181711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-TestVolumeBootPattern-1989447752-project Sep 01 05:31:01.181711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:31:01.181711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:31:01.181711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 73516e6aed494ab597cb824180a617a3 Sep 01 05:31:01.181711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-TestVolumeBootPattern-1989447752-project Sep 01 05:31:01.181711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:31:01.181711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance d673fb27-cefb-470e-85e8-9189c59d1c5c could not be found. Sep 01 05:31:01.181711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': 'd673fb27-cefb-470e-85e8-9189c59d1c5c'} Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d673fb27-cefb-470e-85e8-9189c59d1c5c could not be found. Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:31:01.182508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d673fb27-cefb-470e-85e8-9189c59d1c5c could not be found. Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d673fb27-cefb-470e-85e8-9189c59d1c5c could not be found. Sep 01 05:31:01.183924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:31:01.185126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b6d470fa-c137-4d87-b1ba-5f0e7d4081e5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Returning 404 to user: Instance d673fb27-cefb-470e-85e8-9189c59d1c5c could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:31:01.185126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b6d470fa-c137-4d87-b1ba-5f0e7d4081e5 tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c" status: 404 len: 111 microversion: 2.1 time: 0.034314 Sep 01 05:31:01.185126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 796/1668] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:01 2022] GET /compute/v2.1/servers/d673fb27-cefb-470e-85e8-9189c59d1c5c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:31:01.310706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5a56ded7-b537-46ef-bd87-f59b79238cbd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:01.320250 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5a56ded7-b537-46ef-bd87-f59b79238cbd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:01.321711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5a56ded7-b537-46ef-bd87-f59b79238cbd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:01.322862 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5a56ded7-b537-46ef-bd87-f59b79238cbd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1801 microversion: 2.20 time: 0.161369 Sep 01 05:31:01.323407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 873/1669] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:02.351801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fb84d51e-9672-4ea8-9961-20e5565abaa2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:02.352520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fb84d51e-9672-4ea8-9961-20e5565abaa2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:02.359958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb84d51e-9672-4ea8-9961-20e5565abaa2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:02.360667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb84d51e-9672-4ea8-9961-20e5565abaa2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:02.361255 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb84d51e-9672-4ea8-9961-20e5565abaa2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:02.361951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb84d51e-9672-4ea8-9961-20e5565abaa2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:02.362398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb84d51e-9672-4ea8-9961-20e5565abaa2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:02.362816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb84d51e-9672-4ea8-9961-20e5565abaa2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:02.472361 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fb84d51e-9672-4ea8-9961-20e5565abaa2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:02.481522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fb84d51e-9672-4ea8-9961-20e5565abaa2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:02.482986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fb84d51e-9672-4ea8-9961-20e5565abaa2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:02.484140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fb84d51e-9672-4ea8-9961-20e5565abaa2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1733 microversion: 2.20 time: 0.136897 Sep 01 05:31:02.484706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 797/1670] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1733 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:02.715731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-29e29793-d55c-4166-b03f-340bcae0f158 req-97787925-9ebf-43d3-999b-25dad1d8664e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a582556-d184-4047-ac19-285c0edd2fdf", "name": "network-vif-deleted", "tag": "6e571bd8-c64a-432f-894b-026d58cce109"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:02.727362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-29e29793-d55c-4166-b03f-340bcae0f158 req-97787925-9ebf-43d3-999b-25dad1d8664e service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:02.727855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-29e29793-d55c-4166-b03f-340bcae0f158 req-97787925-9ebf-43d3-999b-25dad1d8664e service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:02.728283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-29e29793-d55c-4166-b03f-340bcae0f158 req-97787925-9ebf-43d3-999b-25dad1d8664e service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:02.754986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-29e29793-d55c-4166-b03f-340bcae0f158 req-97787925-9ebf-43d3-999b-25dad1d8664e service nova] Creating event network-vif-deleted:6e571bd8-c64a-432f-894b-026d58cce109 for instance 2a582556-d184-4047-ac19-285c0edd2fdf on hv-cinder-85391 Sep 01 05:31:02.762854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-29e29793-d55c-4166-b03f-340bcae0f158 req-97787925-9ebf-43d3-999b-25dad1d8664e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050408 Sep 01 05:31:02.763228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 874/1671] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:31:03.507494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-62b94c47-f69a-4aa1-82f7-d237720a3d9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:03.508101 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-62b94c47-f69a-4aa1-82f7-d237720a3d9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:03.514545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-62b94c47-f69a-4aa1-82f7-d237720a3d9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:03.515070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-62b94c47-f69a-4aa1-82f7-d237720a3d9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:03.515505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-62b94c47-f69a-4aa1-82f7-d237720a3d9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:03.516198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-62b94c47-f69a-4aa1-82f7-d237720a3d9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:03.516651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-62b94c47-f69a-4aa1-82f7-d237720a3d9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:03.517105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-62b94c47-f69a-4aa1-82f7-d237720a3d9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:03.586720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-62b94c47-f69a-4aa1-82f7-d237720a3d9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:03.595552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-62b94c47-f69a-4aa1-82f7-d237720a3d9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:03.597028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-62b94c47-f69a-4aa1-82f7-d237720a3d9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:03.598176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-62b94c47-f69a-4aa1-82f7-d237720a3d9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.094649 Sep 01 05:31:03.598723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 798/1672] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:04.622015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d2ccb66f-9cde-46a0-855d-9bdaa20d7b8f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:04.622629 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d2ccb66f-9cde-46a0-855d-9bdaa20d7b8f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:04.628761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2ccb66f-9cde-46a0-855d-9bdaa20d7b8f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:04.629266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2ccb66f-9cde-46a0-855d-9bdaa20d7b8f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:04.629700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2ccb66f-9cde-46a0-855d-9bdaa20d7b8f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:04.630381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2ccb66f-9cde-46a0-855d-9bdaa20d7b8f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:04.631320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2ccb66f-9cde-46a0-855d-9bdaa20d7b8f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:04.631741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2ccb66f-9cde-46a0-855d-9bdaa20d7b8f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:04.693835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d2ccb66f-9cde-46a0-855d-9bdaa20d7b8f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:04.702903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d2ccb66f-9cde-46a0-855d-9bdaa20d7b8f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:04.704335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d2ccb66f-9cde-46a0-855d-9bdaa20d7b8f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:04.705523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d2ccb66f-9cde-46a0-855d-9bdaa20d7b8f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088467 Sep 01 05:31:04.706079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 875/1673] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:05.729625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6d95585d-ff97-4dac-a9ee-261021eab6ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:05.730215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6d95585d-ff97-4dac-a9ee-261021eab6ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:05.736559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d95585d-ff97-4dac-a9ee-261021eab6ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:05.737074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d95585d-ff97-4dac-a9ee-261021eab6ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:05.737500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d95585d-ff97-4dac-a9ee-261021eab6ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:05.738173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d95585d-ff97-4dac-a9ee-261021eab6ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:05.738616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d95585d-ff97-4dac-a9ee-261021eab6ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:05.739030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d95585d-ff97-4dac-a9ee-261021eab6ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:05.799501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6d95585d-ff97-4dac-a9ee-261021eab6ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:05.808142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6d95585d-ff97-4dac-a9ee-261021eab6ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:05.809590 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6d95585d-ff97-4dac-a9ee-261021eab6ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:05.810712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6d95585d-ff97-4dac-a9ee-261021eab6ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086919 Sep 01 05:31:05.811267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 799/1674] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:06.834120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6f1b1a0c-edea-4c5c-8372-9d3cdacdd309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:06.834731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6f1b1a0c-edea-4c5c-8372-9d3cdacdd309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:06.841288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f1b1a0c-edea-4c5c-8372-9d3cdacdd309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:06.841761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f1b1a0c-edea-4c5c-8372-9d3cdacdd309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:06.842191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f1b1a0c-edea-4c5c-8372-9d3cdacdd309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:06.842901 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f1b1a0c-edea-4c5c-8372-9d3cdacdd309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:06.843344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f1b1a0c-edea-4c5c-8372-9d3cdacdd309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:06.843761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f1b1a0c-edea-4c5c-8372-9d3cdacdd309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:06.903794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6f1b1a0c-edea-4c5c-8372-9d3cdacdd309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:06.913307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6f1b1a0c-edea-4c5c-8372-9d3cdacdd309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:06.914746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6f1b1a0c-edea-4c5c-8372-9d3cdacdd309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:06.915916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6f1b1a0c-edea-4c5c-8372-9d3cdacdd309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085755 Sep 01 05:31:06.916496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 876/1675] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:07.939612 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a29597bd-83db-4e2a-bdca-335200951076 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:07.940209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a29597bd-83db-4e2a-bdca-335200951076 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:07.948044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a29597bd-83db-4e2a-bdca-335200951076 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.948528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a29597bd-83db-4e2a-bdca-335200951076 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.949003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a29597bd-83db-4e2a-bdca-335200951076 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:07.949690 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a29597bd-83db-4e2a-bdca-335200951076 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.950160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a29597bd-83db-4e2a-bdca-335200951076 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.950578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a29597bd-83db-4e2a-bdca-335200951076 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:08.011955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a29597bd-83db-4e2a-bdca-335200951076 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:08.020422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a29597bd-83db-4e2a-bdca-335200951076 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:08.022044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a29597bd-83db-4e2a-bdca-335200951076 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:08.023180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a29597bd-83db-4e2a-bdca-335200951076 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087695 Sep 01 05:31:08.023731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 800/1676] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:07 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:09.046317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cc3bd33d-dabf-41f6-bb0a-0e1f07415d67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:09.046928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cc3bd33d-dabf-41f6-bb0a-0e1f07415d67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:09.054253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc3bd33d-dabf-41f6-bb0a-0e1f07415d67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:09.054732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc3bd33d-dabf-41f6-bb0a-0e1f07415d67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:09.055166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc3bd33d-dabf-41f6-bb0a-0e1f07415d67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:09.055853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc3bd33d-dabf-41f6-bb0a-0e1f07415d67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:09.056303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc3bd33d-dabf-41f6-bb0a-0e1f07415d67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:09.056720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc3bd33d-dabf-41f6-bb0a-0e1f07415d67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:09.118602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cc3bd33d-dabf-41f6-bb0a-0e1f07415d67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:09.128595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cc3bd33d-dabf-41f6-bb0a-0e1f07415d67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:09.130257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cc3bd33d-dabf-41f6-bb0a-0e1f07415d67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:09.131441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cc3bd33d-dabf-41f6-bb0a-0e1f07415d67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089178 Sep 01 05:31:09.131989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 877/1677] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:09 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:10.154206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0a8b5d68-6cfa-4470-8952-3aad7966a92c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:10.154848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0a8b5d68-6cfa-4470-8952-3aad7966a92c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:10.162221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a8b5d68-6cfa-4470-8952-3aad7966a92c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.162695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a8b5d68-6cfa-4470-8952-3aad7966a92c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.163125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a8b5d68-6cfa-4470-8952-3aad7966a92c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.163806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a8b5d68-6cfa-4470-8952-3aad7966a92c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.164255 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a8b5d68-6cfa-4470-8952-3aad7966a92c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.164675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a8b5d68-6cfa-4470-8952-3aad7966a92c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.226869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0a8b5d68-6cfa-4470-8952-3aad7966a92c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:10.235963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0a8b5d68-6cfa-4470-8952-3aad7966a92c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:10.237430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0a8b5d68-6cfa-4470-8952-3aad7966a92c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:10.238566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0a8b5d68-6cfa-4470-8952-3aad7966a92c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088320 Sep 01 05:31:10.240278 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 801/1678] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:10 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:11.261990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dace0bc6-e641-4019-8c6a-67df58383870 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:11.262545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dace0bc6-e641-4019-8c6a-67df58383870 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:11.264579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:31:11.264726 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:31:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf (ip 10.222.0.49) !!! Sep 01 05:31:11.272903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dace0bc6-e641-4019-8c6a-67df58383870 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:11.273383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dace0bc6-e641-4019-8c6a-67df58383870 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:11.273818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dace0bc6-e641-4019-8c6a-67df58383870 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.274503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dace0bc6-e641-4019-8c6a-67df58383870 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:11.274950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dace0bc6-e641-4019-8c6a-67df58383870 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:11.275381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dace0bc6-e641-4019-8c6a-67df58383870 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.342331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-dace0bc6-e641-4019-8c6a-67df58383870 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:11.344479 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:11.352360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-dace0bc6-e641-4019-8c6a-67df58383870 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:11.353844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-dace0bc6-e641-4019-8c6a-67df58383870 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:11.355010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dace0bc6-e641-4019-8c6a-67df58383870 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.097040 Sep 01 05:31:11.355556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 878/1679] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:12.377761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-17450113-5051-44e8-ac20-52a6bcfb92a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:12.378345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-17450113-5051-44e8-ac20-52a6bcfb92a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:12.384867 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-17450113-5051-44e8-ac20-52a6bcfb92a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.385344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-17450113-5051-44e8-ac20-52a6bcfb92a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.385772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-17450113-5051-44e8-ac20-52a6bcfb92a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.386447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-17450113-5051-44e8-ac20-52a6bcfb92a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.386888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-17450113-5051-44e8-ac20-52a6bcfb92a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.387302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-17450113-5051-44e8-ac20-52a6bcfb92a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.452326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-17450113-5051-44e8-ac20-52a6bcfb92a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:12.454504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=90 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:12.462754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-17450113-5051-44e8-ac20-52a6bcfb92a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:12.464197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-17450113-5051-44e8-ac20-52a6bcfb92a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:12.465375 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-17450113-5051-44e8-ac20-52a6bcfb92a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091686 Sep 01 05:31:12.465933 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 802/1680] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:12 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:13.490027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-96c86830-cedb-4361-8439-7442fda6ed6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:13.490638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-96c86830-cedb-4361-8439-7442fda6ed6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:13.492872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:13.499673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-96c86830-cedb-4361-8439-7442fda6ed6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:13.500151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-96c86830-cedb-4361-8439-7442fda6ed6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:13.500582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-96c86830-cedb-4361-8439-7442fda6ed6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:13.501315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-96c86830-cedb-4361-8439-7442fda6ed6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:13.501763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-96c86830-cedb-4361-8439-7442fda6ed6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:13.502186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-96c86830-cedb-4361-8439-7442fda6ed6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:13.565597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-96c86830-cedb-4361-8439-7442fda6ed6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:13.574516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-96c86830-cedb-4361-8439-7442fda6ed6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:13.575954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-96c86830-cedb-4361-8439-7442fda6ed6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:13.577122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-96c86830-cedb-4361-8439-7442fda6ed6b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091382 Sep 01 05:31:13.577673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 879/1681] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:13 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:14.600422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c31cc58f-f7e3-4694-b347-6c50a60e14f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:14.600998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c31cc58f-f7e3-4694-b347-6c50a60e14f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:14.602971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=32 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:14.608291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c31cc58f-f7e3-4694-b347-6c50a60e14f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:14.608766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c31cc58f-f7e3-4694-b347-6c50a60e14f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:14.609217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c31cc58f-f7e3-4694-b347-6c50a60e14f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:14.609895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c31cc58f-f7e3-4694-b347-6c50a60e14f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:14.610337 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c31cc58f-f7e3-4694-b347-6c50a60e14f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:14.610758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c31cc58f-f7e3-4694-b347-6c50a60e14f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:14.892636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c31cc58f-f7e3-4694-b347-6c50a60e14f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:14.902226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c31cc58f-f7e3-4694-b347-6c50a60e14f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:14.903678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c31cc58f-f7e3-4694-b347-6c50a60e14f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:14.904886 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c31cc58f-f7e3-4694-b347-6c50a60e14f4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.308474 Sep 01 05:31:14.905443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 803/1682] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:15.928136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c880ba6f-a274-4bec-93d2-8a3daf3f50dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:15.928787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c880ba6f-a274-4bec-93d2-8a3daf3f50dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:15.935183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c880ba6f-a274-4bec-93d2-8a3daf3f50dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:15.935654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c880ba6f-a274-4bec-93d2-8a3daf3f50dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:15.936345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c880ba6f-a274-4bec-93d2-8a3daf3f50dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:15.937044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c880ba6f-a274-4bec-93d2-8a3daf3f50dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:15.937486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c880ba6f-a274-4bec-93d2-8a3daf3f50dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:15.937932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c880ba6f-a274-4bec-93d2-8a3daf3f50dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:15.999644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c880ba6f-a274-4bec-93d2-8a3daf3f50dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:16.008462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c880ba6f-a274-4bec-93d2-8a3daf3f50dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:16.009951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c880ba6f-a274-4bec-93d2-8a3daf3f50dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:16.011096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c880ba6f-a274-4bec-93d2-8a3daf3f50dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087632 Sep 01 05:31:16.011847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 880/1683] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:17.034315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c6c28303-a695-48ad-9503-8abbb39a75e2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:17.034921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c6c28303-a695-48ad-9503-8abbb39a75e2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:17.042379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6c28303-a695-48ad-9503-8abbb39a75e2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.042864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6c28303-a695-48ad-9503-8abbb39a75e2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.043297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6c28303-a695-48ad-9503-8abbb39a75e2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.043983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6c28303-a695-48ad-9503-8abbb39a75e2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.044432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6c28303-a695-48ad-9503-8abbb39a75e2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.044880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6c28303-a695-48ad-9503-8abbb39a75e2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.106519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c6c28303-a695-48ad-9503-8abbb39a75e2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:17.115975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c6c28303-a695-48ad-9503-8abbb39a75e2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:17.117474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c6c28303-a695-48ad-9503-8abbb39a75e2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:17.118612 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c6c28303-a695-48ad-9503-8abbb39a75e2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088216 Sep 01 05:31:17.119161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 804/1684] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:17 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:18.141541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-28857b28-e0b8-491e-b971-4cc653f80031 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:18.142151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-28857b28-e0b8-491e-b971-4cc653f80031 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:18.149277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28857b28-e0b8-491e-b971-4cc653f80031 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:18.149749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28857b28-e0b8-491e-b971-4cc653f80031 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:18.150176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28857b28-e0b8-491e-b971-4cc653f80031 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:18.150963 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28857b28-e0b8-491e-b971-4cc653f80031 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:18.151406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28857b28-e0b8-491e-b971-4cc653f80031 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:18.151817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-28857b28-e0b8-491e-b971-4cc653f80031 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:18.212880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-28857b28-e0b8-491e-b971-4cc653f80031 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:18.221227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-28857b28-e0b8-491e-b971-4cc653f80031 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:18.222703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-28857b28-e0b8-491e-b971-4cc653f80031 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:18.223824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-28857b28-e0b8-491e-b971-4cc653f80031 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086220 Sep 01 05:31:18.224368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 881/1685] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:18 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:19.246412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-987ff4ef-165b-497b-98db-8f2fd76f170d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:19.247033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-987ff4ef-165b-497b-98db-8f2fd76f170d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:19.253735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-987ff4ef-165b-497b-98db-8f2fd76f170d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.254292 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-987ff4ef-165b-497b-98db-8f2fd76f170d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.254721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-987ff4ef-165b-497b-98db-8f2fd76f170d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.255395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-987ff4ef-165b-497b-98db-8f2fd76f170d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.255837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-987ff4ef-165b-497b-98db-8f2fd76f170d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.256256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-987ff4ef-165b-497b-98db-8f2fd76f170d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.317796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-987ff4ef-165b-497b-98db-8f2fd76f170d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:19.326155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-987ff4ef-165b-497b-98db-8f2fd76f170d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:19.327612 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-987ff4ef-165b-497b-98db-8f2fd76f170d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:19.328808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-987ff4ef-165b-497b-98db-8f2fd76f170d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086258 Sep 01 05:31:19.329384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 805/1686] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:19 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:20.352016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-51811f46-d4f9-4311-a162-5eac21040e17 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:20.352628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-51811f46-d4f9-4311-a162-5eac21040e17 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:20.359184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51811f46-d4f9-4311-a162-5eac21040e17 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.359667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51811f46-d4f9-4311-a162-5eac21040e17 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.360098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51811f46-d4f9-4311-a162-5eac21040e17 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:20.360799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51811f46-d4f9-4311-a162-5eac21040e17 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.361256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51811f46-d4f9-4311-a162-5eac21040e17 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.361676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51811f46-d4f9-4311-a162-5eac21040e17 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:20.424980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-51811f46-d4f9-4311-a162-5eac21040e17 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:20.433844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-51811f46-d4f9-4311-a162-5eac21040e17 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:20.435267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-51811f46-d4f9-4311-a162-5eac21040e17 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:20.436652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-51811f46-d4f9-4311-a162-5eac21040e17 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089102 Sep 01 05:31:20.437245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 882/1687] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:21.458137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fb62d5ed-fc9c-4049-b0e0-9865ea5a869f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:21.458771 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fb62d5ed-fc9c-4049-b0e0-9865ea5a869f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:21.465301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb62d5ed-fc9c-4049-b0e0-9865ea5a869f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.465780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb62d5ed-fc9c-4049-b0e0-9865ea5a869f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.466217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb62d5ed-fc9c-4049-b0e0-9865ea5a869f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.466897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb62d5ed-fc9c-4049-b0e0-9865ea5a869f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.467343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb62d5ed-fc9c-4049-b0e0-9865ea5a869f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.467762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb62d5ed-fc9c-4049-b0e0-9865ea5a869f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.528920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fb62d5ed-fc9c-4049-b0e0-9865ea5a869f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:21.537856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fb62d5ed-fc9c-4049-b0e0-9865ea5a869f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:21.539314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fb62d5ed-fc9c-4049-b0e0-9865ea5a869f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:21.540445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fb62d5ed-fc9c-4049-b0e0-9865ea5a869f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086267 Sep 01 05:31:21.541022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 806/1688] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:21 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:22.563545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-db8b7fec-c216-4219-ae2d-150ebbe0be6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:22.564154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-db8b7fec-c216-4219-ae2d-150ebbe0be6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:22.571715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db8b7fec-c216-4219-ae2d-150ebbe0be6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.572189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db8b7fec-c216-4219-ae2d-150ebbe0be6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.572620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db8b7fec-c216-4219-ae2d-150ebbe0be6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.573331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db8b7fec-c216-4219-ae2d-150ebbe0be6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.573779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db8b7fec-c216-4219-ae2d-150ebbe0be6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.574199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db8b7fec-c216-4219-ae2d-150ebbe0be6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.636511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-db8b7fec-c216-4219-ae2d-150ebbe0be6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:22.646177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-db8b7fec-c216-4219-ae2d-150ebbe0be6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:22.647607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-db8b7fec-c216-4219-ae2d-150ebbe0be6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:22.648758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-db8b7fec-c216-4219-ae2d-150ebbe0be6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089410 Sep 01 05:31:22.649343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 883/1689] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:23.671362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-42f2ac1e-4891-434a-ad5e-29461e8a1a1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:23.671948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-42f2ac1e-4891-434a-ad5e-29461e8a1a1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:23.679219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42f2ac1e-4891-434a-ad5e-29461e8a1a1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.679764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42f2ac1e-4891-434a-ad5e-29461e8a1a1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.680242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42f2ac1e-4891-434a-ad5e-29461e8a1a1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:23.681078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42f2ac1e-4891-434a-ad5e-29461e8a1a1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.681582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42f2ac1e-4891-434a-ad5e-29461e8a1a1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.682008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42f2ac1e-4891-434a-ad5e-29461e8a1a1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:23.745571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-42f2ac1e-4891-434a-ad5e-29461e8a1a1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:23.754805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-42f2ac1e-4891-434a-ad5e-29461e8a1a1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:23.756272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-42f2ac1e-4891-434a-ad5e-29461e8a1a1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:23.757444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-42f2ac1e-4891-434a-ad5e-29461e8a1a1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090070 Sep 01 05:31:23.757997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 807/1690] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:24.779512 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-20b7a1d3-a9ef-4359-89f8-d6d004671603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:24.780116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-20b7a1d3-a9ef-4359-89f8-d6d004671603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:24.787202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-20b7a1d3-a9ef-4359-89f8-d6d004671603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.787670 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-20b7a1d3-a9ef-4359-89f8-d6d004671603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.788100 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-20b7a1d3-a9ef-4359-89f8-d6d004671603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.788803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-20b7a1d3-a9ef-4359-89f8-d6d004671603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.789252 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-20b7a1d3-a9ef-4359-89f8-d6d004671603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.789667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-20b7a1d3-a9ef-4359-89f8-d6d004671603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.853837 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-20b7a1d3-a9ef-4359-89f8-d6d004671603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:24.862309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-20b7a1d3-a9ef-4359-89f8-d6d004671603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:24.864405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-20b7a1d3-a9ef-4359-89f8-d6d004671603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:24.865579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-20b7a1d3-a9ef-4359-89f8-d6d004671603 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089945 Sep 01 05:31:24.866127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 884/1691] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:25.887434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-23857643-19d6-4151-8b81-5adf93a0cccf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:25.888053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-23857643-19d6-4151-8b81-5adf93a0cccf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:25.894728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-23857643-19d6-4151-8b81-5adf93a0cccf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.895277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-23857643-19d6-4151-8b81-5adf93a0cccf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.895615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-23857643-19d6-4151-8b81-5adf93a0cccf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.896300 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-23857643-19d6-4151-8b81-5adf93a0cccf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.896739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-23857643-19d6-4151-8b81-5adf93a0cccf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.897176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-23857643-19d6-4151-8b81-5adf93a0cccf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.958986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-23857643-19d6-4151-8b81-5adf93a0cccf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:25.967431 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-23857643-19d6-4151-8b81-5adf93a0cccf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:25.968882 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-23857643-19d6-4151-8b81-5adf93a0cccf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:25.970004 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-23857643-19d6-4151-8b81-5adf93a0cccf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086469 Sep 01 05:31:25.970549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 808/1692] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:26.992631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b0ffa210-f4a2-436b-935c-2b46523d70d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:26.993264 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b0ffa210-f4a2-436b-935c-2b46523d70d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:26.999657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0ffa210-f4a2-436b-935c-2b46523d70d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:27.000119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0ffa210-f4a2-436b-935c-2b46523d70d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:27.000542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0ffa210-f4a2-436b-935c-2b46523d70d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:27.001249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0ffa210-f4a2-436b-935c-2b46523d70d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:27.001691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0ffa210-f4a2-436b-935c-2b46523d70d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:27.002104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0ffa210-f4a2-436b-935c-2b46523d70d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:27.064706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b0ffa210-f4a2-436b-935c-2b46523d70d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:27.073309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b0ffa210-f4a2-436b-935c-2b46523d70d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:27.074750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b0ffa210-f4a2-436b-935c-2b46523d70d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:27.075998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b0ffa210-f4a2-436b-935c-2b46523d70d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087305 Sep 01 05:31:27.076930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 885/1693] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:28.099677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5ab4730f-75fb-4257-9d09-254c162c5b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:28.100213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5ab4730f-75fb-4257-9d09-254c162c5b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:28.106628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ab4730f-75fb-4257-9d09-254c162c5b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.107105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ab4730f-75fb-4257-9d09-254c162c5b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.107538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ab4730f-75fb-4257-9d09-254c162c5b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.108220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ab4730f-75fb-4257-9d09-254c162c5b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.108667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ab4730f-75fb-4257-9d09-254c162c5b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.109115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5ab4730f-75fb-4257-9d09-254c162c5b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.171538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5ab4730f-75fb-4257-9d09-254c162c5b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:28.180944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5ab4730f-75fb-4257-9d09-254c162c5b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:28.182662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5ab4730f-75fb-4257-9d09-254c162c5b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:28.183798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5ab4730f-75fb-4257-9d09-254c162c5b10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088805 Sep 01 05:31:28.184613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 809/1694] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:28 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:29.207359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e7d96f6e-3dbc-4ac4-bd7b-788971340e73 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:29.207878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e7d96f6e-3dbc-4ac4-bd7b-788971340e73 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:29.214227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7d96f6e-3dbc-4ac4-bd7b-788971340e73 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:29.214701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7d96f6e-3dbc-4ac4-bd7b-788971340e73 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:29.215134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7d96f6e-3dbc-4ac4-bd7b-788971340e73 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:29.215808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7d96f6e-3dbc-4ac4-bd7b-788971340e73 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:29.216248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7d96f6e-3dbc-4ac4-bd7b-788971340e73 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:29.216662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7d96f6e-3dbc-4ac4-bd7b-788971340e73 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:29.280959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e7d96f6e-3dbc-4ac4-bd7b-788971340e73 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:29.290256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e7d96f6e-3dbc-4ac4-bd7b-788971340e73 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:29.291749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e7d96f6e-3dbc-4ac4-bd7b-788971340e73 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:29.292913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e7d96f6e-3dbc-4ac4-bd7b-788971340e73 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089834 Sep 01 05:31:29.293474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 886/1695] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:29 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:30.316909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b459a36f-3d83-41da-8aeb-5c9130e38d6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:30.317511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b459a36f-3d83-41da-8aeb-5c9130e38d6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:30.323734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b459a36f-3d83-41da-8aeb-5c9130e38d6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.324206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b459a36f-3d83-41da-8aeb-5c9130e38d6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.324628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b459a36f-3d83-41da-8aeb-5c9130e38d6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.325329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b459a36f-3d83-41da-8aeb-5c9130e38d6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.325770 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b459a36f-3d83-41da-8aeb-5c9130e38d6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.326183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b459a36f-3d83-41da-8aeb-5c9130e38d6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.387704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b459a36f-3d83-41da-8aeb-5c9130e38d6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:30.396723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b459a36f-3d83-41da-8aeb-5c9130e38d6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:30.398169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b459a36f-3d83-41da-8aeb-5c9130e38d6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:30.399295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b459a36f-3d83-41da-8aeb-5c9130e38d6f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087088 Sep 01 05:31:30.399838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 810/1696] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:30 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:31.421411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6ace059b-b3ea-4904-8c28-430dd7f0106d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:31.422021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6ace059b-b3ea-4904-8c28-430dd7f0106d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:31.428609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ace059b-b3ea-4904-8c28-430dd7f0106d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:31.429118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ace059b-b3ea-4904-8c28-430dd7f0106d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:31.429551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ace059b-b3ea-4904-8c28-430dd7f0106d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:31.430235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ace059b-b3ea-4904-8c28-430dd7f0106d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:31.430681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ace059b-b3ea-4904-8c28-430dd7f0106d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:31.431102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ace059b-b3ea-4904-8c28-430dd7f0106d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:31.492495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ace059b-b3ea-4904-8c28-430dd7f0106d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:31.501423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ace059b-b3ea-4904-8c28-430dd7f0106d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:31.503719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ace059b-b3ea-4904-8c28-430dd7f0106d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:31.504894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6ace059b-b3ea-4904-8c28-430dd7f0106d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087390 Sep 01 05:31:31.505451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 887/1697] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:32.528629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-43ccf034-35b4-4a28-bf06-f44b4cc2cec6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:32.529347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-43ccf034-35b4-4a28-bf06-f44b4cc2cec6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:32.535903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43ccf034-35b4-4a28-bf06-f44b4cc2cec6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:32.536368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43ccf034-35b4-4a28-bf06-f44b4cc2cec6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:32.536881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43ccf034-35b4-4a28-bf06-f44b4cc2cec6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:32.537564 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43ccf034-35b4-4a28-bf06-f44b4cc2cec6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:32.538005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43ccf034-35b4-4a28-bf06-f44b4cc2cec6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:32.538419 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43ccf034-35b4-4a28-bf06-f44b4cc2cec6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:32.604629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-43ccf034-35b4-4a28-bf06-f44b4cc2cec6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:32.613860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-43ccf034-35b4-4a28-bf06-f44b4cc2cec6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:32.615278 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-43ccf034-35b4-4a28-bf06-f44b4cc2cec6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:32.616409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-43ccf034-35b4-4a28-bf06-f44b4cc2cec6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091726 Sep 01 05:31:32.616980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 811/1698] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:33.639223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ec4415ec-f050-46f9-adb3-38caf51c274d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:33.639831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ec4415ec-f050-46f9-adb3-38caf51c274d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:33.646880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec4415ec-f050-46f9-adb3-38caf51c274d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.647358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec4415ec-f050-46f9-adb3-38caf51c274d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.647788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec4415ec-f050-46f9-adb3-38caf51c274d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.648470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec4415ec-f050-46f9-adb3-38caf51c274d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.648947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec4415ec-f050-46f9-adb3-38caf51c274d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.649363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec4415ec-f050-46f9-adb3-38caf51c274d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.709380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ec4415ec-f050-46f9-adb3-38caf51c274d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:33.717716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ec4415ec-f050-46f9-adb3-38caf51c274d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:33.719168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ec4415ec-f050-46f9-adb3-38caf51c274d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:33.720301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ec4415ec-f050-46f9-adb3-38caf51c274d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085058 Sep 01 05:31:33.720948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 888/1699] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:34.743640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-84796a34-a75d-45ae-a0a9-0f62b443efdf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:34.744282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-84796a34-a75d-45ae-a0a9-0f62b443efdf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:34.750903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84796a34-a75d-45ae-a0a9-0f62b443efdf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.751382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84796a34-a75d-45ae-a0a9-0f62b443efdf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.751818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84796a34-a75d-45ae-a0a9-0f62b443efdf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.752503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84796a34-a75d-45ae-a0a9-0f62b443efdf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.753790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84796a34-a75d-45ae-a0a9-0f62b443efdf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.754212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-84796a34-a75d-45ae-a0a9-0f62b443efdf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.814323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-84796a34-a75d-45ae-a0a9-0f62b443efdf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:34.823525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-84796a34-a75d-45ae-a0a9-0f62b443efdf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:34.825088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-84796a34-a75d-45ae-a0a9-0f62b443efdf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:34.826237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-84796a34-a75d-45ae-a0a9-0f62b443efdf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086516 Sep 01 05:31:34.826785 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 812/1700] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:35.849203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-23c80d03-54a3-4ca1-82b9-10c2ee486800 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:35.849817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-23c80d03-54a3-4ca1-82b9-10c2ee486800 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:35.856383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23c80d03-54a3-4ca1-82b9-10c2ee486800 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:35.856892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23c80d03-54a3-4ca1-82b9-10c2ee486800 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:35.857330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23c80d03-54a3-4ca1-82b9-10c2ee486800 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:35.858021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23c80d03-54a3-4ca1-82b9-10c2ee486800 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:35.858466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23c80d03-54a3-4ca1-82b9-10c2ee486800 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:35.858903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-23c80d03-54a3-4ca1-82b9-10c2ee486800 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:35.919916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-23c80d03-54a3-4ca1-82b9-10c2ee486800 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:35.928592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-23c80d03-54a3-4ca1-82b9-10c2ee486800 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:35.930066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-23c80d03-54a3-4ca1-82b9-10c2ee486800 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:35.931218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-23c80d03-54a3-4ca1-82b9-10c2ee486800 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086159 Sep 01 05:31:35.931777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 889/1701] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:36.954646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bb00424e-ff40-430d-9387-d9bf86c34233 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:36.955270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bb00424e-ff40-430d-9387-d9bf86c34233 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:36.962234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb00424e-ff40-430d-9387-d9bf86c34233 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:36.962711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb00424e-ff40-430d-9387-d9bf86c34233 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:36.963140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb00424e-ff40-430d-9387-d9bf86c34233 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:36.963821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb00424e-ff40-430d-9387-d9bf86c34233 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:36.964268 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb00424e-ff40-430d-9387-d9bf86c34233 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:36.964689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb00424e-ff40-430d-9387-d9bf86c34233 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:37.025693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bb00424e-ff40-430d-9387-d9bf86c34233 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:37.034545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bb00424e-ff40-430d-9387-d9bf86c34233 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:37.035981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bb00424e-ff40-430d-9387-d9bf86c34233 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:37.037137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bb00424e-ff40-430d-9387-d9bf86c34233 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086473 Sep 01 05:31:37.037687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 813/1702] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:38.060306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-82cd3624-f0cb-4209-93c5-b7f7be924f3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:38.060970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-82cd3624-f0cb-4209-93c5-b7f7be924f3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:38.067801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82cd3624-f0cb-4209-93c5-b7f7be924f3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:38.068424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82cd3624-f0cb-4209-93c5-b7f7be924f3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:38.068980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82cd3624-f0cb-4209-93c5-b7f7be924f3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:38.069727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82cd3624-f0cb-4209-93c5-b7f7be924f3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:38.070234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82cd3624-f0cb-4209-93c5-b7f7be924f3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:38.070721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82cd3624-f0cb-4209-93c5-b7f7be924f3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:38.134019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-82cd3624-f0cb-4209-93c5-b7f7be924f3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:38.142543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-82cd3624-f0cb-4209-93c5-b7f7be924f3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:38.144651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-82cd3624-f0cb-4209-93c5-b7f7be924f3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:38.145813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-82cd3624-f0cb-4209-93c5-b7f7be924f3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089669 Sep 01 05:31:38.146366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 890/1703] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:38 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:39.168496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-26710dd2-bf40-4d45-ae64-49c51975fb6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:39.169108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-26710dd2-bf40-4d45-ae64-49c51975fb6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:39.176189 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26710dd2-bf40-4d45-ae64-49c51975fb6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:39.176668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26710dd2-bf40-4d45-ae64-49c51975fb6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:39.177124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26710dd2-bf40-4d45-ae64-49c51975fb6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:39.177805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26710dd2-bf40-4d45-ae64-49c51975fb6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:39.178251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26710dd2-bf40-4d45-ae64-49c51975fb6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:39.178669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-26710dd2-bf40-4d45-ae64-49c51975fb6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:39.240072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-26710dd2-bf40-4d45-ae64-49c51975fb6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:39.248858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-26710dd2-bf40-4d45-ae64-49c51975fb6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:39.250297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-26710dd2-bf40-4d45-ae64-49c51975fb6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:39.251433 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-26710dd2-bf40-4d45-ae64-49c51975fb6a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086948 Sep 01 05:31:39.252755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 814/1704] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:39 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:40.274958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-740c9626-6c97-4a5d-a692-186a0da9d4cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:40.275559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-740c9626-6c97-4a5d-a692-186a0da9d4cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:40.282287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-740c9626-6c97-4a5d-a692-186a0da9d4cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:40.282763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-740c9626-6c97-4a5d-a692-186a0da9d4cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:40.283214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-740c9626-6c97-4a5d-a692-186a0da9d4cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:40.283905 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-740c9626-6c97-4a5d-a692-186a0da9d4cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:40.284352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-740c9626-6c97-4a5d-a692-186a0da9d4cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:40.284796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-740c9626-6c97-4a5d-a692-186a0da9d4cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:40.351666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-740c9626-6c97-4a5d-a692-186a0da9d4cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:40.368661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-740c9626-6c97-4a5d-a692-186a0da9d4cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:40.370128 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-740c9626-6c97-4a5d-a692-186a0da9d4cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:40.371784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-740c9626-6c97-4a5d-a692-186a0da9d4cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.100614 Sep 01 05:31:40.372778 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 891/1705] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:41.405286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1b7943dc-55a1-4fcb-9dfa-6744e7df43ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:41.405925 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1b7943dc-55a1-4fcb-9dfa-6744e7df43ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:41.413527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b7943dc-55a1-4fcb-9dfa-6744e7df43ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:41.414009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b7943dc-55a1-4fcb-9dfa-6744e7df43ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:41.414442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b7943dc-55a1-4fcb-9dfa-6744e7df43ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:41.415121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b7943dc-55a1-4fcb-9dfa-6744e7df43ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:41.415569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b7943dc-55a1-4fcb-9dfa-6744e7df43ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:41.415987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b7943dc-55a1-4fcb-9dfa-6744e7df43ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:41.482915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1b7943dc-55a1-4fcb-9dfa-6744e7df43ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:41.491707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1b7943dc-55a1-4fcb-9dfa-6744e7df43ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:41.493177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1b7943dc-55a1-4fcb-9dfa-6744e7df43ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:41.494314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1b7943dc-55a1-4fcb-9dfa-6744e7df43ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.092918 Sep 01 05:31:41.494872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 815/1706] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:42.516889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e39048ab-63f8-4da2-aff1-06c861c9c57e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:42.518079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e39048ab-63f8-4da2-aff1-06c861c9c57e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:42.524759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e39048ab-63f8-4da2-aff1-06c861c9c57e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:42.525318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e39048ab-63f8-4da2-aff1-06c861c9c57e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:42.525751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e39048ab-63f8-4da2-aff1-06c861c9c57e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:42.526430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e39048ab-63f8-4da2-aff1-06c861c9c57e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:42.526876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e39048ab-63f8-4da2-aff1-06c861c9c57e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:42.527295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e39048ab-63f8-4da2-aff1-06c861c9c57e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:42.588126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e39048ab-63f8-4da2-aff1-06c861c9c57e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:42.596705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e39048ab-63f8-4da2-aff1-06c861c9c57e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:42.598168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e39048ab-63f8-4da2-aff1-06c861c9c57e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:42.599300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e39048ab-63f8-4da2-aff1-06c861c9c57e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086373 Sep 01 05:31:42.599856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 892/1707] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:43.622094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1901a18d-5b98-4209-ae09-ce7a3cea9d0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:43.622700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1901a18d-5b98-4209-ae09-ce7a3cea9d0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:43.630074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1901a18d-5b98-4209-ae09-ce7a3cea9d0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:43.630553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1901a18d-5b98-4209-ae09-ce7a3cea9d0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:43.630985 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1901a18d-5b98-4209-ae09-ce7a3cea9d0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:43.631662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1901a18d-5b98-4209-ae09-ce7a3cea9d0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:43.632112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1901a18d-5b98-4209-ae09-ce7a3cea9d0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:43.632532 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1901a18d-5b98-4209-ae09-ce7a3cea9d0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:43.635058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=80 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:43.694362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1901a18d-5b98-4209-ae09-ce7a3cea9d0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:43.702724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1901a18d-5b98-4209-ae09-ce7a3cea9d0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:43.704149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1901a18d-5b98-4209-ae09-ce7a3cea9d0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:43.705310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1901a18d-5b98-4209-ae09-ce7a3cea9d0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087119 Sep 01 05:31:43.705853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 816/1708] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:44.728328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-87c4308e-8b9d-45ce-8b5d-4069a6d54136 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:44.728976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-87c4308e-8b9d-45ce-8b5d-4069a6d54136 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:44.731279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=28 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:44.736454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87c4308e-8b9d-45ce-8b5d-4069a6d54136 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:44.736959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87c4308e-8b9d-45ce-8b5d-4069a6d54136 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:44.738216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87c4308e-8b9d-45ce-8b5d-4069a6d54136 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:44.739163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87c4308e-8b9d-45ce-8b5d-4069a6d54136 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:44.739624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87c4308e-8b9d-45ce-8b5d-4069a6d54136 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:44.740049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87c4308e-8b9d-45ce-8b5d-4069a6d54136 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:44.744065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=86 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:44.802989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-87c4308e-8b9d-45ce-8b5d-4069a6d54136 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:44.811656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-87c4308e-8b9d-45ce-8b5d-4069a6d54136 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:44.813116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-87c4308e-8b9d-45ce-8b5d-4069a6d54136 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:44.814261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-87c4308e-8b9d-45ce-8b5d-4069a6d54136 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089877 Sep 01 05:31:44.814815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 893/1709] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:45.839518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d294a173-dec5-4f26-9054-49383d1e83a2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:45.840128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d294a173-dec5-4f26-9054-49383d1e83a2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:45.842613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=28 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:45.848669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d294a173-dec5-4f26-9054-49383d1e83a2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:45.849178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d294a173-dec5-4f26-9054-49383d1e83a2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:45.849610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d294a173-dec5-4f26-9054-49383d1e83a2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:45.850303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d294a173-dec5-4f26-9054-49383d1e83a2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:45.850748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d294a173-dec5-4f26-9054-49383d1e83a2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:45.851258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d294a173-dec5-4f26-9054-49383d1e83a2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:45.912587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d294a173-dec5-4f26-9054-49383d1e83a2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:45.921279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d294a173-dec5-4f26-9054-49383d1e83a2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:45.922701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d294a173-dec5-4f26-9054-49383d1e83a2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:45.923833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d294a173-dec5-4f26-9054-49383d1e83a2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088277 Sep 01 05:31:45.924380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 817/1710] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:45 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:46.947725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1d7527fa-40c9-45ca-86af-2a150be26226 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:46.948340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1d7527fa-40c9-45ca-86af-2a150be26226 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:46.954888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d7527fa-40c9-45ca-86af-2a150be26226 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:46.955368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d7527fa-40c9-45ca-86af-2a150be26226 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:46.956151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d7527fa-40c9-45ca-86af-2a150be26226 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:46.956525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d7527fa-40c9-45ca-86af-2a150be26226 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:46.957005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d7527fa-40c9-45ca-86af-2a150be26226 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:46.957429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d7527fa-40c9-45ca-86af-2a150be26226 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:47.022706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1d7527fa-40c9-45ca-86af-2a150be26226 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:47.031183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1d7527fa-40c9-45ca-86af-2a150be26226 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:47.032620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1d7527fa-40c9-45ca-86af-2a150be26226 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:47.034315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1d7527fa-40c9-45ca-86af-2a150be26226 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090056 Sep 01 05:31:47.035453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 894/1711] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:47.970082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ce9bb960-945d-49ee-9848-1cf5390451ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:47.970613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ce9bb960-945d-49ee-9848-1cf5390451ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:47.977307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce9bb960-945d-49ee-9848-1cf5390451ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:47.977784 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce9bb960-945d-49ee-9848-1cf5390451ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:47.978211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce9bb960-945d-49ee-9848-1cf5390451ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:47.978898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce9bb960-945d-49ee-9848-1cf5390451ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:47.979338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce9bb960-945d-49ee-9848-1cf5390451ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:47.979751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce9bb960-945d-49ee-9848-1cf5390451ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.004630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ce9bb960-945d-49ee-9848-1cf5390451ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Going to try to terminate instance {{(pid=120674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:31:48.059814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3d4f3794-38ae-4f47-bb92-3a53b581c724 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:48.060397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3d4f3794-38ae-4f47-bb92-3a53b581c724 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:48.069401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3d4f3794-38ae-4f47-bb92-3a53b581c724 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:48.069888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3d4f3794-38ae-4f47-bb92-3a53b581c724 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:48.070319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3d4f3794-38ae-4f47-bb92-3a53b581c724 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.071010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3d4f3794-38ae-4f47-bb92-3a53b581c724 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:48.072122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3d4f3794-38ae-4f47-bb92-3a53b581c724 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:48.072554 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3d4f3794-38ae-4f47-bb92-3a53b581c724 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.084315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ce9bb960-945d-49ee-9848-1cf5390451ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 204 len: 0 microversion: 2.1 time: 0.117710 Sep 01 05:31:48.085305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 818/1712] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:31:47 2022] DELETE /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:31:48.093546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-566c9a6e-a848-4647-9f3c-af77eb6c31b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:48.094237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-566c9a6e-a848-4647-9f3c-af77eb6c31b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:48.100095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-566c9a6e-a848-4647-9f3c-af77eb6c31b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:48.100575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-566c9a6e-a848-4647-9f3c-af77eb6c31b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:48.101066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-566c9a6e-a848-4647-9f3c-af77eb6c31b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.101750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-566c9a6e-a848-4647-9f3c-af77eb6c31b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:48.102195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-566c9a6e-a848-4647-9f3c-af77eb6c31b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:48.102610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-566c9a6e-a848-4647-9f3c-af77eb6c31b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:48.138890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3d4f3794-38ae-4f47-bb92-3a53b581c724 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:48.147886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3d4f3794-38ae-4f47-bb92-3a53b581c724 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:48.149374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3d4f3794-38ae-4f47-bb92-3a53b581c724 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:48.150520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3d4f3794-38ae-4f47-bb92-3a53b581c724 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.096250 Sep 01 05:31:48.151086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 895/1713] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:31:48.237320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-566c9a6e-a848-4647-9f3c-af77eb6c31b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:48.246129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-566c9a6e-a848-4647-9f3c-af77eb6c31b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156639 Sep 01 05:31:48.246691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 819/1714] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:48 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:49.172907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d5ccbcff-cbb4-4d55-a05c-c4259e6dbcb5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:49.173521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d5ccbcff-cbb4-4d55-a05c-c4259e6dbcb5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:49.180031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5ccbcff-cbb4-4d55-a05c-c4259e6dbcb5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:49.180507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5ccbcff-cbb4-4d55-a05c-c4259e6dbcb5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:49.180965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5ccbcff-cbb4-4d55-a05c-c4259e6dbcb5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:49.181908 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5ccbcff-cbb4-4d55-a05c-c4259e6dbcb5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:49.182349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5ccbcff-cbb4-4d55-a05c-c4259e6dbcb5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:49.182765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5ccbcff-cbb4-4d55-a05c-c4259e6dbcb5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:49.243445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d5ccbcff-cbb4-4d55-a05c-c4259e6dbcb5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:49.252058 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d5ccbcff-cbb4-4d55-a05c-c4259e6dbcb5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:49.254697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d5ccbcff-cbb4-4d55-a05c-c4259e6dbcb5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:49.255866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d5ccbcff-cbb4-4d55-a05c-c4259e6dbcb5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086906 Sep 01 05:31:49.256442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 896/1715] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:49 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:49.267318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-410e302d-18d2-491f-ac8f-8f58d0cda8de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:49.268788 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-410e302d-18d2-491f-ac8f-8f58d0cda8de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:49.275344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-410e302d-18d2-491f-ac8f-8f58d0cda8de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:49.275823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-410e302d-18d2-491f-ac8f-8f58d0cda8de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:49.276249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-410e302d-18d2-491f-ac8f-8f58d0cda8de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:49.276952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-410e302d-18d2-491f-ac8f-8f58d0cda8de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:49.277395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-410e302d-18d2-491f-ac8f-8f58d0cda8de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:49.277806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-410e302d-18d2-491f-ac8f-8f58d0cda8de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:49.407017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-410e302d-18d2-491f-ac8f-8f58d0cda8de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:49.415425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-410e302d-18d2-491f-ac8f-8f58d0cda8de tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151875 Sep 01 05:31:49.415998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 820/1716] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:49 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:50.278301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-72af7a46-2307-4a30-9d39-afe5e80605db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:50.278909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-72af7a46-2307-4a30-9d39-afe5e80605db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:50.285592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72af7a46-2307-4a30-9d39-afe5e80605db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:50.286064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72af7a46-2307-4a30-9d39-afe5e80605db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:50.286490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72af7a46-2307-4a30-9d39-afe5e80605db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:50.287167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72af7a46-2307-4a30-9d39-afe5e80605db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:50.287610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72af7a46-2307-4a30-9d39-afe5e80605db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:50.288026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72af7a46-2307-4a30-9d39-afe5e80605db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:50.350155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72af7a46-2307-4a30-9d39-afe5e80605db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:50.358697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72af7a46-2307-4a30-9d39-afe5e80605db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:50.360117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72af7a46-2307-4a30-9d39-afe5e80605db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:50.361905 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-72af7a46-2307-4a30-9d39-afe5e80605db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086943 Sep 01 05:31:50.362678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 897/1717] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:50.436788 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9e74d4c2-164a-4586-982b-f5b826b54920 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:50.437408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9e74d4c2-164a-4586-982b-f5b826b54920 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:50.444843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e74d4c2-164a-4586-982b-f5b826b54920 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:50.445325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e74d4c2-164a-4586-982b-f5b826b54920 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:50.445757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e74d4c2-164a-4586-982b-f5b826b54920 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:50.446448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e74d4c2-164a-4586-982b-f5b826b54920 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:50.446896 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e74d4c2-164a-4586-982b-f5b826b54920 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:50.447312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e74d4c2-164a-4586-982b-f5b826b54920 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:50.579760 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9e74d4c2-164a-4586-982b-f5b826b54920 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:50.588187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9e74d4c2-164a-4586-982b-f5b826b54920 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155291 Sep 01 05:31:50.588751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 821/1718] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:50 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:51.384535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-82771362-4281-4ec9-b95b-821300db3867 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:51.385181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-82771362-4281-4ec9-b95b-821300db3867 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:51.391601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82771362-4281-4ec9-b95b-821300db3867 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:51.392081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82771362-4281-4ec9-b95b-821300db3867 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:51.393068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82771362-4281-4ec9-b95b-821300db3867 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:51.393762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82771362-4281-4ec9-b95b-821300db3867 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:51.394210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82771362-4281-4ec9-b95b-821300db3867 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:51.394634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-82771362-4281-4ec9-b95b-821300db3867 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:51.461128 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-82771362-4281-4ec9-b95b-821300db3867 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:51.469883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-82771362-4281-4ec9-b95b-821300db3867 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:51.471430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-82771362-4281-4ec9-b95b-821300db3867 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:51.472498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-82771362-4281-4ec9-b95b-821300db3867 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091877 Sep 01 05:31:51.473088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 898/1719] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:51 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:51.609696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-542cb1cd-2cf5-4511-aeaf-7d9b3b79d498 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:51.610301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-542cb1cd-2cf5-4511-aeaf-7d9b3b79d498 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:51.617049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-542cb1cd-2cf5-4511-aeaf-7d9b3b79d498 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:51.617527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-542cb1cd-2cf5-4511-aeaf-7d9b3b79d498 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:51.617956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-542cb1cd-2cf5-4511-aeaf-7d9b3b79d498 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:51.618636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-542cb1cd-2cf5-4511-aeaf-7d9b3b79d498 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:51.619121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-542cb1cd-2cf5-4511-aeaf-7d9b3b79d498 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:51.619530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-542cb1cd-2cf5-4511-aeaf-7d9b3b79d498 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:51.745313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-542cb1cd-2cf5-4511-aeaf-7d9b3b79d498 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:51.754653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-542cb1cd-2cf5-4511-aeaf-7d9b3b79d498 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148802 Sep 01 05:31:51.755213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 822/1720] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:52.495090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8645bcec-006f-4bed-b390-7ca2b3444726 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:52.495693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8645bcec-006f-4bed-b390-7ca2b3444726 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:52.502181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8645bcec-006f-4bed-b390-7ca2b3444726 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.502650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8645bcec-006f-4bed-b390-7ca2b3444726 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.503080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8645bcec-006f-4bed-b390-7ca2b3444726 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.503758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8645bcec-006f-4bed-b390-7ca2b3444726 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.504206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8645bcec-006f-4bed-b390-7ca2b3444726 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.504624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8645bcec-006f-4bed-b390-7ca2b3444726 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.565642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8645bcec-006f-4bed-b390-7ca2b3444726 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:52.574165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8645bcec-006f-4bed-b390-7ca2b3444726 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:52.575592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8645bcec-006f-4bed-b390-7ca2b3444726 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:52.576719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8645bcec-006f-4bed-b390-7ca2b3444726 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085567 Sep 01 05:31:52.577300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 899/1721] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:52.776718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6cad9260-c5c2-4f03-afc0-16c02c203805 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:52.777357 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6cad9260-c5c2-4f03-afc0-16c02c203805 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:52.784909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6cad9260-c5c2-4f03-afc0-16c02c203805 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.785391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6cad9260-c5c2-4f03-afc0-16c02c203805 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.785823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6cad9260-c5c2-4f03-afc0-16c02c203805 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.786503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6cad9260-c5c2-4f03-afc0-16c02c203805 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.786956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6cad9260-c5c2-4f03-afc0-16c02c203805 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.787377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6cad9260-c5c2-4f03-afc0-16c02c203805 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.914495 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6cad9260-c5c2-4f03-afc0-16c02c203805 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:52.922731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6cad9260-c5c2-4f03-afc0-16c02c203805 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149894 Sep 01 05:31:52.923322 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 823/1722] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:53.599442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d46c5e9e-175c-47a9-8c30-93b9347bc3a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:53.600073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d46c5e9e-175c-47a9-8c30-93b9347bc3a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:53.606431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d46c5e9e-175c-47a9-8c30-93b9347bc3a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.606902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d46c5e9e-175c-47a9-8c30-93b9347bc3a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.607330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d46c5e9e-175c-47a9-8c30-93b9347bc3a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:53.608008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d46c5e9e-175c-47a9-8c30-93b9347bc3a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.608451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d46c5e9e-175c-47a9-8c30-93b9347bc3a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.608897 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d46c5e9e-175c-47a9-8c30-93b9347bc3a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:53.668848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d46c5e9e-175c-47a9-8c30-93b9347bc3a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:53.677894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d46c5e9e-175c-47a9-8c30-93b9347bc3a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:53.679318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d46c5e9e-175c-47a9-8c30-93b9347bc3a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:53.680436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d46c5e9e-175c-47a9-8c30-93b9347bc3a0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085066 Sep 01 05:31:53.681270 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 900/1723] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:53.944463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cd4cb3a6-e3df-4f1e-aa7f-483f0ae7c2f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:53.945094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cd4cb3a6-e3df-4f1e-aa7f-483f0ae7c2f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:53.951637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd4cb3a6-e3df-4f1e-aa7f-483f0ae7c2f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.952108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd4cb3a6-e3df-4f1e-aa7f-483f0ae7c2f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.952531 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd4cb3a6-e3df-4f1e-aa7f-483f0ae7c2f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:53.953235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd4cb3a6-e3df-4f1e-aa7f-483f0ae7c2f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.953680 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd4cb3a6-e3df-4f1e-aa7f-483f0ae7c2f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.954094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd4cb3a6-e3df-4f1e-aa7f-483f0ae7c2f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.084396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cd4cb3a6-e3df-4f1e-aa7f-483f0ae7c2f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.092706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cd4cb3a6-e3df-4f1e-aa7f-483f0ae7c2f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152256 Sep 01 05:31:54.093303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 824/1724] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:54.703645 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ecb7c933-5a9a-4d29-a1c2-6cd9a63ebaca tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:54.704264 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ecb7c933-5a9a-4d29-a1c2-6cd9a63ebaca tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:54.711412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecb7c933-5a9a-4d29-a1c2-6cd9a63ebaca tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.711892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecb7c933-5a9a-4d29-a1c2-6cd9a63ebaca tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.712345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecb7c933-5a9a-4d29-a1c2-6cd9a63ebaca tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.713073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecb7c933-5a9a-4d29-a1c2-6cd9a63ebaca tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.713528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecb7c933-5a9a-4d29-a1c2-6cd9a63ebaca tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.713950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ecb7c933-5a9a-4d29-a1c2-6cd9a63ebaca tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.774123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ecb7c933-5a9a-4d29-a1c2-6cd9a63ebaca tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.783478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ecb7c933-5a9a-4d29-a1c2-6cd9a63ebaca tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.784968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ecb7c933-5a9a-4d29-a1c2-6cd9a63ebaca tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.786103 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ecb7c933-5a9a-4d29-a1c2-6cd9a63ebaca tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086455 Sep 01 05:31:54.786670 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 901/1725] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:55.114116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-826c9479-c101-4777-a73a-a09401821fd6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:55.114682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-826c9479-c101-4777-a73a-a09401821fd6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:55.121093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-826c9479-c101-4777-a73a-a09401821fd6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:55.121572 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-826c9479-c101-4777-a73a-a09401821fd6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:55.122003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-826c9479-c101-4777-a73a-a09401821fd6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:55.122686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-826c9479-c101-4777-a73a-a09401821fd6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:55.123135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-826c9479-c101-4777-a73a-a09401821fd6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:55.123553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-826c9479-c101-4777-a73a-a09401821fd6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:55.251011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-826c9479-c101-4777-a73a-a09401821fd6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:55.260301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-826c9479-c101-4777-a73a-a09401821fd6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150601 Sep 01 05:31:55.260892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 825/1726] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:55 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:55.809364 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-834a1742-43d0-41cc-8f92-45e2b2751a39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:55.809954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-834a1742-43d0-41cc-8f92-45e2b2751a39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:55.816930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-834a1742-43d0-41cc-8f92-45e2b2751a39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:55.817402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-834a1742-43d0-41cc-8f92-45e2b2751a39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:55.817826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-834a1742-43d0-41cc-8f92-45e2b2751a39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:55.818500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-834a1742-43d0-41cc-8f92-45e2b2751a39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:55.818942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-834a1742-43d0-41cc-8f92-45e2b2751a39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:55.819355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-834a1742-43d0-41cc-8f92-45e2b2751a39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:55.882103 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-834a1742-43d0-41cc-8f92-45e2b2751a39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:55.891042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-834a1742-43d0-41cc-8f92-45e2b2751a39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:55.892855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-834a1742-43d0-41cc-8f92-45e2b2751a39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:55.894018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-834a1742-43d0-41cc-8f92-45e2b2751a39 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088791 Sep 01 05:31:55.894619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 902/1727] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:56.283875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-db1af8e1-91c7-443a-ae5f-99eec1bb3827 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:56.284476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-db1af8e1-91c7-443a-ae5f-99eec1bb3827 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:56.291011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-db1af8e1-91c7-443a-ae5f-99eec1bb3827 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.291486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-db1af8e1-91c7-443a-ae5f-99eec1bb3827 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.292013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-db1af8e1-91c7-443a-ae5f-99eec1bb3827 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.292704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-db1af8e1-91c7-443a-ae5f-99eec1bb3827 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.293177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-db1af8e1-91c7-443a-ae5f-99eec1bb3827 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.293592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-db1af8e1-91c7-443a-ae5f-99eec1bb3827 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.425890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-db1af8e1-91c7-443a-ae5f-99eec1bb3827 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:56.434332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-db1af8e1-91c7-443a-ae5f-99eec1bb3827 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155308 Sep 01 05:31:56.434903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 826/1728] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:56.916683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9f67b6a3-df8f-45e1-b404-637db9054058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:56.917322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9f67b6a3-df8f-45e1-b404-637db9054058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:56.924738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f67b6a3-df8f-45e1-b404-637db9054058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.925218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f67b6a3-df8f-45e1-b404-637db9054058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.925655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f67b6a3-df8f-45e1-b404-637db9054058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.926341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f67b6a3-df8f-45e1-b404-637db9054058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.926788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f67b6a3-df8f-45e1-b404-637db9054058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.927205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f67b6a3-df8f-45e1-b404-637db9054058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.988817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9f67b6a3-df8f-45e1-b404-637db9054058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:56.997239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9f67b6a3-df8f-45e1-b404-637db9054058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:56.998674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9f67b6a3-df8f-45e1-b404-637db9054058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:56.999812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9f67b6a3-df8f-45e1-b404-637db9054058 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087138 Sep 01 05:31:57.000370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 903/1729] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:57.456911 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d0add1a2-3e23-4b04-866f-67566f37b471 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:57.457550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d0add1a2-3e23-4b04-866f-67566f37b471 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:57.463901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0add1a2-3e23-4b04-866f-67566f37b471 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.464375 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0add1a2-3e23-4b04-866f-67566f37b471 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.464827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0add1a2-3e23-4b04-866f-67566f37b471 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.465506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0add1a2-3e23-4b04-866f-67566f37b471 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.466048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0add1a2-3e23-4b04-866f-67566f37b471 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.466470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0add1a2-3e23-4b04-866f-67566f37b471 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.595860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d0add1a2-3e23-4b04-866f-67566f37b471 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:57.604015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d0add1a2-3e23-4b04-866f-67566f37b471 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152142 Sep 01 05:31:57.604568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 827/1730] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:57 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:58.023410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-42f275f0-70e7-4e91-a6a4-bfffabedc5ee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:58.024023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-42f275f0-70e7-4e91-a6a4-bfffabedc5ee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:58.030393 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42f275f0-70e7-4e91-a6a4-bfffabedc5ee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.030866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42f275f0-70e7-4e91-a6a4-bfffabedc5ee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.031302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42f275f0-70e7-4e91-a6a4-bfffabedc5ee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.031979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42f275f0-70e7-4e91-a6a4-bfffabedc5ee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.033227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42f275f0-70e7-4e91-a6a4-bfffabedc5ee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.033815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42f275f0-70e7-4e91-a6a4-bfffabedc5ee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.099448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-42f275f0-70e7-4e91-a6a4-bfffabedc5ee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.107960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-42f275f0-70e7-4e91-a6a4-bfffabedc5ee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.109361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-42f275f0-70e7-4e91-a6a4-bfffabedc5ee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.111180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-42f275f0-70e7-4e91-a6a4-bfffabedc5ee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090954 Sep 01 05:31:58.111740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 904/1731] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:58.625675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-76fe19b1-e244-49eb-aae2-f4ceea374be6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:58.626527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-76fe19b1-e244-49eb-aae2-f4ceea374be6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:58.632709 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-76fe19b1-e244-49eb-aae2-f4ceea374be6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.633213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-76fe19b1-e244-49eb-aae2-f4ceea374be6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.633645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-76fe19b1-e244-49eb-aae2-f4ceea374be6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.634322 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-76fe19b1-e244-49eb-aae2-f4ceea374be6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.634768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-76fe19b1-e244-49eb-aae2-f4ceea374be6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.635183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-76fe19b1-e244-49eb-aae2-f4ceea374be6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.765076 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-76fe19b1-e244-49eb-aae2-f4ceea374be6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.773796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-76fe19b1-e244-49eb-aae2-f4ceea374be6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152058 Sep 01 05:31:58.774366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 828/1732] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:58 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:59.133936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-aab67f25-ec45-4940-bd29-5ec8142a0c8d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:59.134758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-aab67f25-ec45-4940-bd29-5ec8142a0c8d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:59.142112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aab67f25-ec45-4940-bd29-5ec8142a0c8d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.142590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aab67f25-ec45-4940-bd29-5ec8142a0c8d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.143024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aab67f25-ec45-4940-bd29-5ec8142a0c8d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.143710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aab67f25-ec45-4940-bd29-5ec8142a0c8d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.144159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aab67f25-ec45-4940-bd29-5ec8142a0c8d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.144578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aab67f25-ec45-4940-bd29-5ec8142a0c8d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.204871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-aab67f25-ec45-4940-bd29-5ec8142a0c8d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:59.213426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-aab67f25-ec45-4940-bd29-5ec8142a0c8d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:59.214859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-aab67f25-ec45-4940-bd29-5ec8142a0c8d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:59.216029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-aab67f25-ec45-4940-bd29-5ec8142a0c8d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086196 Sep 01 05:31:59.216578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 905/1733] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:59 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:59.795547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-04e3adb7-a1e0-44f5-ba54-8a1e4a369bc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:59.796154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-04e3adb7-a1e0-44f5-ba54-8a1e4a369bc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:59.803158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-04e3adb7-a1e0-44f5-ba54-8a1e4a369bc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.803635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-04e3adb7-a1e0-44f5-ba54-8a1e4a369bc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.804060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-04e3adb7-a1e0-44f5-ba54-8a1e4a369bc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.804737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-04e3adb7-a1e0-44f5-ba54-8a1e4a369bc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.805469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-04e3adb7-a1e0-44f5-ba54-8a1e4a369bc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.805883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-04e3adb7-a1e0-44f5-ba54-8a1e4a369bc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.935814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-04e3adb7-a1e0-44f5-ba54-8a1e4a369bc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:59.943970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-04e3adb7-a1e0-44f5-ba54-8a1e4a369bc7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152280 Sep 01 05:31:59.944529 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 829/1734] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:59 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:00.238669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e004b63c-6a3a-4099-8468-31dd7aca83c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:00.239314 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e004b63c-6a3a-4099-8468-31dd7aca83c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:00.245766 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e004b63c-6a3a-4099-8468-31dd7aca83c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.246248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e004b63c-6a3a-4099-8468-31dd7aca83c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.246684 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e004b63c-6a3a-4099-8468-31dd7aca83c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.247370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e004b63c-6a3a-4099-8468-31dd7aca83c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.247846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e004b63c-6a3a-4099-8468-31dd7aca83c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.248268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e004b63c-6a3a-4099-8468-31dd7aca83c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.314247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e004b63c-6a3a-4099-8468-31dd7aca83c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:00.322661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e004b63c-6a3a-4099-8468-31dd7aca83c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:00.324101 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e004b63c-6a3a-4099-8468-31dd7aca83c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:00.325261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e004b63c-6a3a-4099-8468-31dd7aca83c3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090526 Sep 01 05:32:00.325822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 906/1735] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:00 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:00.965092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-97a03aba-19de-420e-8b4c-aa6152d05656 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:00.965699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-97a03aba-19de-420e-8b4c-aa6152d05656 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:00.972988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97a03aba-19de-420e-8b4c-aa6152d05656 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.973467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97a03aba-19de-420e-8b4c-aa6152d05656 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.973897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97a03aba-19de-420e-8b4c-aa6152d05656 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.974570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97a03aba-19de-420e-8b4c-aa6152d05656 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.975014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97a03aba-19de-420e-8b4c-aa6152d05656 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.975431 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-97a03aba-19de-420e-8b4c-aa6152d05656 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.105784 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-97a03aba-19de-420e-8b4c-aa6152d05656 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.114143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-97a03aba-19de-420e-8b4c-aa6152d05656 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152973 Sep 01 05:32:01.114704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 830/1736] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:01.349085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6e626dfa-a0fd-4c6f-a8ab-9a2f6567a03d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:01.349603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6e626dfa-a0fd-4c6f-a8ab-9a2f6567a03d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:01.355961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6e626dfa-a0fd-4c6f-a8ab-9a2f6567a03d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:01.356454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6e626dfa-a0fd-4c6f-a8ab-9a2f6567a03d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:01.356901 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6e626dfa-a0fd-4c6f-a8ab-9a2f6567a03d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.357597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6e626dfa-a0fd-4c6f-a8ab-9a2f6567a03d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:01.358031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6e626dfa-a0fd-4c6f-a8ab-9a2f6567a03d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:01.358451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6e626dfa-a0fd-4c6f-a8ab-9a2f6567a03d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.419284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6e626dfa-a0fd-4c6f-a8ab-9a2f6567a03d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.427722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6e626dfa-a0fd-4c6f-a8ab-9a2f6567a03d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.429170 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6e626dfa-a0fd-4c6f-a8ab-9a2f6567a03d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.430562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6e626dfa-a0fd-4c6f-a8ab-9a2f6567a03d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085543 Sep 01 05:32:01.431320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 907/1737] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:02.135338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-16ceddd7-ad76-47cc-9a72-dba01aee551d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:02.136033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-16ceddd7-ad76-47cc-9a72-dba01aee551d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:02.142809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-16ceddd7-ad76-47cc-9a72-dba01aee551d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.143293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-16ceddd7-ad76-47cc-9a72-dba01aee551d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.143732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-16ceddd7-ad76-47cc-9a72-dba01aee551d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.144421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-16ceddd7-ad76-47cc-9a72-dba01aee551d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.144906 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-16ceddd7-ad76-47cc-9a72-dba01aee551d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.145342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-16ceddd7-ad76-47cc-9a72-dba01aee551d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.147981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:02.281048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-16ceddd7-ad76-47cc-9a72-dba01aee551d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:02.289295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-16ceddd7-ad76-47cc-9a72-dba01aee551d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157840 Sep 01 05:32:02.289858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 831/1738] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:02 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:02.454400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-07cff916-665b-4d1a-8ca0-592ecd9c6c51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:02.454921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-07cff916-665b-4d1a-8ca0-592ecd9c6c51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:02.461257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07cff916-665b-4d1a-8ca0-592ecd9c6c51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.461725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07cff916-665b-4d1a-8ca0-592ecd9c6c51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.462152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07cff916-665b-4d1a-8ca0-592ecd9c6c51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.462823 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07cff916-665b-4d1a-8ca0-592ecd9c6c51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.463259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07cff916-665b-4d1a-8ca0-592ecd9c6c51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.463668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-07cff916-665b-4d1a-8ca0-592ecd9c6c51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.524442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-07cff916-665b-4d1a-8ca0-592ecd9c6c51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:02.533078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-07cff916-665b-4d1a-8ca0-592ecd9c6c51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:02.534508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-07cff916-665b-4d1a-8ca0-592ecd9c6c51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:02.535633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-07cff916-665b-4d1a-8ca0-592ecd9c6c51 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085804 Sep 01 05:32:02.536179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 908/1739] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:03.311097 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-132d5843-3590-425c-ab3c-41ad8d66fc5d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:03.311721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-132d5843-3590-425c-ab3c-41ad8d66fc5d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:03.318642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-132d5843-3590-425c-ab3c-41ad8d66fc5d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.319126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-132d5843-3590-425c-ab3c-41ad8d66fc5d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.319561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-132d5843-3590-425c-ab3c-41ad8d66fc5d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.320248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-132d5843-3590-425c-ab3c-41ad8d66fc5d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.320699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-132d5843-3590-425c-ab3c-41ad8d66fc5d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.321149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-132d5843-3590-425c-ab3c-41ad8d66fc5d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.448160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-132d5843-3590-425c-ab3c-41ad8d66fc5d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:03.456907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-132d5843-3590-425c-ab3c-41ad8d66fc5d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149734 Sep 01 05:32:03.457466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 832/1740] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:03 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:03.558536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cff95307-103e-4fa5-a43f-846874ce9015 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:03.559152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cff95307-103e-4fa5-a43f-846874ce9015 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:03.566203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cff95307-103e-4fa5-a43f-846874ce9015 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.566630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cff95307-103e-4fa5-a43f-846874ce9015 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.567065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cff95307-103e-4fa5-a43f-846874ce9015 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.567744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cff95307-103e-4fa5-a43f-846874ce9015 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.568195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cff95307-103e-4fa5-a43f-846874ce9015 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.568617 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cff95307-103e-4fa5-a43f-846874ce9015 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.629846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cff95307-103e-4fa5-a43f-846874ce9015 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:03.632031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:03.639717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cff95307-103e-4fa5-a43f-846874ce9015 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:03.641805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cff95307-103e-4fa5-a43f-846874ce9015 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:03.642973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cff95307-103e-4fa5-a43f-846874ce9015 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088617 Sep 01 05:32:03.643529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 909/1741] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:04.478956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7e10cf5f-a423-4969-bad1-ef386b47afd9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:04.479567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7e10cf5f-a423-4969-bad1-ef386b47afd9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:04.487334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e10cf5f-a423-4969-bad1-ef386b47afd9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.487815 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e10cf5f-a423-4969-bad1-ef386b47afd9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.488250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e10cf5f-a423-4969-bad1-ef386b47afd9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.488981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e10cf5f-a423-4969-bad1-ef386b47afd9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.489432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e10cf5f-a423-4969-bad1-ef386b47afd9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.489885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e10cf5f-a423-4969-bad1-ef386b47afd9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.634710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7e10cf5f-a423-4969-bad1-ef386b47afd9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:04.643704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7e10cf5f-a423-4969-bad1-ef386b47afd9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.168633 Sep 01 05:32:04.644284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 833/1742] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:04.671691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9d6651c5-1b5d-43d6-b274-351067df2286 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:04.672539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9d6651c5-1b5d-43d6-b274-351067df2286 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:04.679920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d6651c5-1b5d-43d6-b274-351067df2286 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.680396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d6651c5-1b5d-43d6-b274-351067df2286 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.680853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d6651c5-1b5d-43d6-b274-351067df2286 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.681549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d6651c5-1b5d-43d6-b274-351067df2286 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.682028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d6651c5-1b5d-43d6-b274-351067df2286 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.682448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d6651c5-1b5d-43d6-b274-351067df2286 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.754471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9d6651c5-1b5d-43d6-b274-351067df2286 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:04.767324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9d6651c5-1b5d-43d6-b274-351067df2286 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:04.769096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9d6651c5-1b5d-43d6-b274-351067df2286 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:04.770247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9d6651c5-1b5d-43d6-b274-351067df2286 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.102665 Sep 01 05:32:04.770808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 910/1743] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:05.666403 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-88f90093-7dad-4c71-9c8f-536aa89db585 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:05.667017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-88f90093-7dad-4c71-9c8f-536aa89db585 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:05.673649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88f90093-7dad-4c71-9c8f-536aa89db585 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.674124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88f90093-7dad-4c71-9c8f-536aa89db585 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.674551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88f90093-7dad-4c71-9c8f-536aa89db585 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.675224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88f90093-7dad-4c71-9c8f-536aa89db585 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.675669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88f90093-7dad-4c71-9c8f-536aa89db585 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.676084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88f90093-7dad-4c71-9c8f-536aa89db585 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.793700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0fb884e7-157d-4003-aff7-83f1c527c54c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:05.794331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0fb884e7-157d-4003-aff7-83f1c527c54c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:05.801347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0fb884e7-157d-4003-aff7-83f1c527c54c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.801822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0fb884e7-157d-4003-aff7-83f1c527c54c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.802246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0fb884e7-157d-4003-aff7-83f1c527c54c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.802931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0fb884e7-157d-4003-aff7-83f1c527c54c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.803374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0fb884e7-157d-4003-aff7-83f1c527c54c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.803791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0fb884e7-157d-4003-aff7-83f1c527c54c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.806843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-88f90093-7dad-4c71-9c8f-536aa89db585 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.815173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-88f90093-7dad-4c71-9c8f-536aa89db585 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152598 Sep 01 05:32:05.815745 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 834/1744] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:05 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:05.866730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0fb884e7-157d-4003-aff7-83f1c527c54c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.876028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0fb884e7-157d-4003-aff7-83f1c527c54c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.877522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0fb884e7-157d-4003-aff7-83f1c527c54c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.878655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0fb884e7-157d-4003-aff7-83f1c527c54c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088833 Sep 01 05:32:05.879206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 911/1745] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:06.836917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3efea49f-b86e-4950-8710-ce7ba87b5c19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:06.837581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3efea49f-b86e-4950-8710-ce7ba87b5c19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:06.844671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3efea49f-b86e-4950-8710-ce7ba87b5c19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.845179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3efea49f-b86e-4950-8710-ce7ba87b5c19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.845609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3efea49f-b86e-4950-8710-ce7ba87b5c19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.846290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3efea49f-b86e-4950-8710-ce7ba87b5c19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.846736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3efea49f-b86e-4950-8710-ce7ba87b5c19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.847153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3efea49f-b86e-4950-8710-ce7ba87b5c19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.901539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b5da9be7-c1a8-4387-8196-32d374051711 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:06.902145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b5da9be7-c1a8-4387-8196-32d374051711 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:06.909332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5da9be7-c1a8-4387-8196-32d374051711 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.909806 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5da9be7-c1a8-4387-8196-32d374051711 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.910235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5da9be7-c1a8-4387-8196-32d374051711 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.910915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5da9be7-c1a8-4387-8196-32d374051711 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.911368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5da9be7-c1a8-4387-8196-32d374051711 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.911780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5da9be7-c1a8-4387-8196-32d374051711 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.975437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b5da9be7-c1a8-4387-8196-32d374051711 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:06.982651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3efea49f-b86e-4950-8710-ce7ba87b5c19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:06.984304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b5da9be7-c1a8-4387-8196-32d374051711 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:06.986013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b5da9be7-c1a8-4387-8196-32d374051711 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:06.987159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b5da9be7-c1a8-4387-8196-32d374051711 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089571 Sep 01 05:32:06.987724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 912/1746] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:06.990988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3efea49f-b86e-4950-8710-ce7ba87b5c19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157926 Sep 01 05:32:06.991539 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 835/1747] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:06 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:08.009344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9a18ec18-51ba-4f4d-bef8-8dffa88bfc44 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:08.009961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9a18ec18-51ba-4f4d-bef8-8dffa88bfc44 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:08.011274 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f2a6d842-3c1e-48b8-809f-bcf772de6996 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:08.011884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f2a6d842-3c1e-48b8-809f-bcf772de6996 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:08.016350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a18ec18-51ba-4f4d-bef8-8dffa88bfc44 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.017069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a18ec18-51ba-4f4d-bef8-8dffa88bfc44 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.017508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a18ec18-51ba-4f4d-bef8-8dffa88bfc44 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.018146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2a6d842-3c1e-48b8-809f-bcf772de6996 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.018263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a18ec18-51ba-4f4d-bef8-8dffa88bfc44 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.018633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a18ec18-51ba-4f4d-bef8-8dffa88bfc44 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.018751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2a6d842-3c1e-48b8-809f-bcf772de6996 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.019053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a18ec18-51ba-4f4d-bef8-8dffa88bfc44 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.019156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2a6d842-3c1e-48b8-809f-bcf772de6996 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.019733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2a6d842-3c1e-48b8-809f-bcf772de6996 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.020178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2a6d842-3c1e-48b8-809f-bcf772de6996 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.020595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2a6d842-3c1e-48b8-809f-bcf772de6996 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.081535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9a18ec18-51ba-4f4d-bef8-8dffa88bfc44 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:08.090333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9a18ec18-51ba-4f4d-bef8-8dffa88bfc44 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:08.091769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9a18ec18-51ba-4f4d-bef8-8dffa88bfc44 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:08.092938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9a18ec18-51ba-4f4d-bef8-8dffa88bfc44 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087546 Sep 01 05:32:08.093490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 913/1748] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:08.152460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f2a6d842-3c1e-48b8-809f-bcf772de6996 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:08.161309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f2a6d842-3c1e-48b8-809f-bcf772de6996 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153969 Sep 01 05:32:08.161863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 836/1749] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:08 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:09.116303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2095456e-c050-4fd3-b434-a3ba83a3840e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:09.116939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2095456e-c050-4fd3-b434-a3ba83a3840e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:09.123372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2095456e-c050-4fd3-b434-a3ba83a3840e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.123849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2095456e-c050-4fd3-b434-a3ba83a3840e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.125312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2095456e-c050-4fd3-b434-a3ba83a3840e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.125312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2095456e-c050-4fd3-b434-a3ba83a3840e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.125532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2095456e-c050-4fd3-b434-a3ba83a3840e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.125816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2095456e-c050-4fd3-b434-a3ba83a3840e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.183870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c26dd24f-c266-4793-93c0-553e22f3175c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:09.184421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c26dd24f-c266-4793-93c0-553e22f3175c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:09.191326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c26dd24f-c266-4793-93c0-553e22f3175c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.191457 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c26dd24f-c266-4793-93c0-553e22f3175c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.191777 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c26dd24f-c266-4793-93c0-553e22f3175c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.192467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c26dd24f-c266-4793-93c0-553e22f3175c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.192952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c26dd24f-c266-4793-93c0-553e22f3175c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.193373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c26dd24f-c266-4793-93c0-553e22f3175c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.193489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2095456e-c050-4fd3-b434-a3ba83a3840e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:09.202269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2095456e-c050-4fd3-b434-a3ba83a3840e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:09.204609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2095456e-c050-4fd3-b434-a3ba83a3840e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:09.205835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2095456e-c050-4fd3-b434-a3ba83a3840e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.093793 Sep 01 05:32:09.206396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 914/1750] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:09 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:09.322105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c26dd24f-c266-4793-93c0-553e22f3175c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:09.330826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c26dd24f-c266-4793-93c0-553e22f3175c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151042 Sep 01 05:32:09.331428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 837/1751] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:09 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:10.229528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9f550e4c-479f-4d92-8ead-304e61ada957 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:10.230141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9f550e4c-479f-4d92-8ead-304e61ada957 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:10.236801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f550e4c-479f-4d92-8ead-304e61ada957 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.237287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f550e4c-479f-4d92-8ead-304e61ada957 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.237713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f550e4c-479f-4d92-8ead-304e61ada957 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.238387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f550e4c-479f-4d92-8ead-304e61ada957 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.238829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f550e4c-479f-4d92-8ead-304e61ada957 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.239239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9f550e4c-479f-4d92-8ead-304e61ada957 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.300574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9f550e4c-479f-4d92-8ead-304e61ada957 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.309701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9f550e4c-479f-4d92-8ead-304e61ada957 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.311125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9f550e4c-479f-4d92-8ead-304e61ada957 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.312250 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9f550e4c-479f-4d92-8ead-304e61ada957 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086684 Sep 01 05:32:10.313370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 915/1752] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:10 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:10.351614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6f52ea81-b55f-4d9d-bcbd-9edd559c9757 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:10.352229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6f52ea81-b55f-4d9d-bcbd-9edd559c9757 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:10.358637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f52ea81-b55f-4d9d-bcbd-9edd559c9757 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.359118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f52ea81-b55f-4d9d-bcbd-9edd559c9757 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.359632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f52ea81-b55f-4d9d-bcbd-9edd559c9757 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.360320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f52ea81-b55f-4d9d-bcbd-9edd559c9757 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.360802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f52ea81-b55f-4d9d-bcbd-9edd559c9757 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.361218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6f52ea81-b55f-4d9d-bcbd-9edd559c9757 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.492224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6f52ea81-b55f-4d9d-bcbd-9edd559c9757 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.500689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6f52ea81-b55f-4d9d-bcbd-9edd559c9757 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152682 Sep 01 05:32:10.501326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 838/1753] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:11.335104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ae659298-b261-4dca-9f02-16436eb55385 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:11.335667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ae659298-b261-4dca-9f02-16436eb55385 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:11.341986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae659298-b261-4dca-9f02-16436eb55385 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.342458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae659298-b261-4dca-9f02-16436eb55385 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.342884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae659298-b261-4dca-9f02-16436eb55385 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.343596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae659298-b261-4dca-9f02-16436eb55385 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.344036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae659298-b261-4dca-9f02-16436eb55385 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.344451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae659298-b261-4dca-9f02-16436eb55385 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.405064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ae659298-b261-4dca-9f02-16436eb55385 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:11.413485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ae659298-b261-4dca-9f02-16436eb55385 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:11.414902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ae659298-b261-4dca-9f02-16436eb55385 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:11.416020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ae659298-b261-4dca-9f02-16436eb55385 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.084936 Sep 01 05:32:11.416570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 916/1754] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:11.522427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3f7ec772-be27-4639-b90a-d35d188484a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:11.523030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3f7ec772-be27-4639-b90a-d35d188484a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:11.529601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f7ec772-be27-4639-b90a-d35d188484a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.530088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f7ec772-be27-4639-b90a-d35d188484a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.530536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f7ec772-be27-4639-b90a-d35d188484a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.531909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f7ec772-be27-4639-b90a-d35d188484a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.532414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f7ec772-be27-4639-b90a-d35d188484a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.532920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f7ec772-be27-4639-b90a-d35d188484a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.659231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3f7ec772-be27-4639-b90a-d35d188484a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:11.667305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3f7ec772-be27-4639-b90a-d35d188484a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148773 Sep 01 05:32:11.667869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 839/1755] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:11 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:12.440290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6b59d833-7d28-440c-b98e-36241d95a649 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:12.440942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6b59d833-7d28-440c-b98e-36241d95a649 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:12.447511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b59d833-7d28-440c-b98e-36241d95a649 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.447997 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b59d833-7d28-440c-b98e-36241d95a649 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.448433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b59d833-7d28-440c-b98e-36241d95a649 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.449166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b59d833-7d28-440c-b98e-36241d95a649 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.449644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b59d833-7d28-440c-b98e-36241d95a649 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.450070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b59d833-7d28-440c-b98e-36241d95a649 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.510631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6b59d833-7d28-440c-b98e-36241d95a649 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:12.520008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6b59d833-7d28-440c-b98e-36241d95a649 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:12.521480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6b59d833-7d28-440c-b98e-36241d95a649 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:12.522648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6b59d833-7d28-440c-b98e-36241d95a649 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086857 Sep 01 05:32:12.523202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 917/1756] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:12 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:12.689329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-78025c90-0691-40f0-9df0-933612f44cfc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:12.689938 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-78025c90-0691-40f0-9df0-933612f44cfc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:12.696499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78025c90-0691-40f0-9df0-933612f44cfc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.696949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78025c90-0691-40f0-9df0-933612f44cfc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.697384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78025c90-0691-40f0-9df0-933612f44cfc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.698064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78025c90-0691-40f0-9df0-933612f44cfc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.698507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78025c90-0691-40f0-9df0-933612f44cfc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.698924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78025c90-0691-40f0-9df0-933612f44cfc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.829571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-78025c90-0691-40f0-9df0-933612f44cfc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:12.837581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-78025c90-0691-40f0-9df0-933612f44cfc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152629 Sep 01 05:32:12.838156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 840/1757] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:12 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:13.545061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d721cdc5-738d-4827-a828-7b4f6a10b5be tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:13.545700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d721cdc5-738d-4827-a828-7b4f6a10b5be tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:13.552868 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d721cdc5-738d-4827-a828-7b4f6a10b5be tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.553620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d721cdc5-738d-4827-a828-7b4f6a10b5be tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.554062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d721cdc5-738d-4827-a828-7b4f6a10b5be tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.554739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d721cdc5-738d-4827-a828-7b4f6a10b5be tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.555180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d721cdc5-738d-4827-a828-7b4f6a10b5be tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.555594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d721cdc5-738d-4827-a828-7b4f6a10b5be tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.619866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d721cdc5-738d-4827-a828-7b4f6a10b5be tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:13.628328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d721cdc5-738d-4827-a828-7b4f6a10b5be tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:13.629856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d721cdc5-738d-4827-a828-7b4f6a10b5be tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:13.630997 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d721cdc5-738d-4827-a828-7b4f6a10b5be tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089909 Sep 01 05:32:13.631546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 918/1758] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:13 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:13.859046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c4759a0e-82ff-4427-9afe-56c75766dd2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:13.859641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c4759a0e-82ff-4427-9afe-56c75766dd2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:13.866108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4759a0e-82ff-4427-9afe-56c75766dd2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.866576 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4759a0e-82ff-4427-9afe-56c75766dd2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.867005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4759a0e-82ff-4427-9afe-56c75766dd2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.867682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4759a0e-82ff-4427-9afe-56c75766dd2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.868127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4759a0e-82ff-4427-9afe-56c75766dd2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.868538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4759a0e-82ff-4427-9afe-56c75766dd2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.000132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c4759a0e-82ff-4427-9afe-56c75766dd2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:14.008259 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c4759a0e-82ff-4427-9afe-56c75766dd2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153109 Sep 01 05:32:14.008854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 841/1759] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:14.653968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d1d245c3-062f-4293-92a3-447594f73010 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:14.654571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d1d245c3-062f-4293-92a3-447594f73010 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:14.661503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1d245c3-062f-4293-92a3-447594f73010 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.661973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1d245c3-062f-4293-92a3-447594f73010 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.662395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1d245c3-062f-4293-92a3-447594f73010 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.663067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1d245c3-062f-4293-92a3-447594f73010 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.663502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1d245c3-062f-4293-92a3-447594f73010 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.663910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1d245c3-062f-4293-92a3-447594f73010 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.725356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d1d245c3-062f-4293-92a3-447594f73010 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:14.734711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d1d245c3-062f-4293-92a3-447594f73010 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:14.736147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d1d245c3-062f-4293-92a3-447594f73010 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:14.737312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d1d245c3-062f-4293-92a3-447594f73010 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087300 Sep 01 05:32:14.737865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 919/1760] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:15.031273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-964d1e8f-efa1-4ee3-b554-59efb3603fe4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:15.031959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-964d1e8f-efa1-4ee3-b554-59efb3603fe4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:15.038439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-964d1e8f-efa1-4ee3-b554-59efb3603fe4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.038924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-964d1e8f-efa1-4ee3-b554-59efb3603fe4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.039388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-964d1e8f-efa1-4ee3-b554-59efb3603fe4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.040070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-964d1e8f-efa1-4ee3-b554-59efb3603fe4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.040519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-964d1e8f-efa1-4ee3-b554-59efb3603fe4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.040975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-964d1e8f-efa1-4ee3-b554-59efb3603fe4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.167704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-964d1e8f-efa1-4ee3-b554-59efb3603fe4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:15.175920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-964d1e8f-efa1-4ee3-b554-59efb3603fe4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149146 Sep 01 05:32:15.176482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 842/1761] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:15.760156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-055af94a-444a-4c5d-ad30-2f87db1c92b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:15.760750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-055af94a-444a-4c5d-ad30-2f87db1c92b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:15.763048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=54 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:15.769256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-055af94a-444a-4c5d-ad30-2f87db1c92b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.769730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-055af94a-444a-4c5d-ad30-2f87db1c92b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.770164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-055af94a-444a-4c5d-ad30-2f87db1c92b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.770845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-055af94a-444a-4c5d-ad30-2f87db1c92b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.771292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-055af94a-444a-4c5d-ad30-2f87db1c92b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.771711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-055af94a-444a-4c5d-ad30-2f87db1c92b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.837180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-055af94a-444a-4c5d-ad30-2f87db1c92b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:15.846035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-055af94a-444a-4c5d-ad30-2f87db1c92b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:15.847471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-055af94a-444a-4c5d-ad30-2f87db1c92b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:15.848634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-055af94a-444a-4c5d-ad30-2f87db1c92b9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.092388 Sep 01 05:32:15.849223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 920/1762] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:16.197380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-74fbbc86-fb37-4f26-989c-ea1e281d0eed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:16.197985 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-74fbbc86-fb37-4f26-989c-ea1e281d0eed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:16.200305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:16.206392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74fbbc86-fb37-4f26-989c-ea1e281d0eed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.206886 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74fbbc86-fb37-4f26-989c-ea1e281d0eed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.207321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74fbbc86-fb37-4f26-989c-ea1e281d0eed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.208021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74fbbc86-fb37-4f26-989c-ea1e281d0eed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.208475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74fbbc86-fb37-4f26-989c-ea1e281d0eed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.208923 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-74fbbc86-fb37-4f26-989c-ea1e281d0eed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.350219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-74fbbc86-fb37-4f26-989c-ea1e281d0eed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:16.359599 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-74fbbc86-fb37-4f26-989c-ea1e281d0eed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.165447 Sep 01 05:32:16.360191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 843/1763] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:16 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:16.871725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f97a9143-5dc2-4891-889e-041f82b263e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:16.872411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f97a9143-5dc2-4891-889e-041f82b263e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:16.879713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f97a9143-5dc2-4891-889e-041f82b263e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.880191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f97a9143-5dc2-4891-889e-041f82b263e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.880620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f97a9143-5dc2-4891-889e-041f82b263e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.881336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f97a9143-5dc2-4891-889e-041f82b263e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.881784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f97a9143-5dc2-4891-889e-041f82b263e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.882204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f97a9143-5dc2-4891-889e-041f82b263e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.944649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f97a9143-5dc2-4891-889e-041f82b263e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:16.953301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f97a9143-5dc2-4891-889e-041f82b263e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:16.954750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f97a9143-5dc2-4891-889e-041f82b263e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:16.955867 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f97a9143-5dc2-4891-889e-041f82b263e0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088313 Sep 01 05:32:16.956423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 921/1764] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:16 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:17.381073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e8a6bfd9-12fa-488a-843d-af30efd2dccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:17.381675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e8a6bfd9-12fa-488a-843d-af30efd2dccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:17.388009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8a6bfd9-12fa-488a-843d-af30efd2dccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.388482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8a6bfd9-12fa-488a-843d-af30efd2dccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.388938 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8a6bfd9-12fa-488a-843d-af30efd2dccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.390120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8a6bfd9-12fa-488a-843d-af30efd2dccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.390722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8a6bfd9-12fa-488a-843d-af30efd2dccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.391038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8a6bfd9-12fa-488a-843d-af30efd2dccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.518871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e8a6bfd9-12fa-488a-843d-af30efd2dccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:17.526991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e8a6bfd9-12fa-488a-843d-af30efd2dccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149871 Sep 01 05:32:17.527554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 844/1765] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:17 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:17.978435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f0930dd4-3e82-4208-93ba-2e959e720ee3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:17.979049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f0930dd4-3e82-4208-93ba-2e959e720ee3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:17.985733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0930dd4-3e82-4208-93ba-2e959e720ee3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.986215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0930dd4-3e82-4208-93ba-2e959e720ee3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.986650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0930dd4-3e82-4208-93ba-2e959e720ee3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.987336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0930dd4-3e82-4208-93ba-2e959e720ee3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.987783 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0930dd4-3e82-4208-93ba-2e959e720ee3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.988204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0930dd4-3e82-4208-93ba-2e959e720ee3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:18.051295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f0930dd4-3e82-4208-93ba-2e959e720ee3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:18.060024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f0930dd4-3e82-4208-93ba-2e959e720ee3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:18.062148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f0930dd4-3e82-4208-93ba-2e959e720ee3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:18.063409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f0930dd4-3e82-4208-93ba-2e959e720ee3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088952 Sep 01 05:32:18.063971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 922/1766] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:17 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:18.549650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-35067699-ac76-4f48-9ccb-b4f56ead7aa2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:18.550248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-35067699-ac76-4f48-9ccb-b4f56ead7aa2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:18.556937 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35067699-ac76-4f48-9ccb-b4f56ead7aa2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:18.557420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35067699-ac76-4f48-9ccb-b4f56ead7aa2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:18.557852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35067699-ac76-4f48-9ccb-b4f56ead7aa2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:18.558540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35067699-ac76-4f48-9ccb-b4f56ead7aa2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:18.558988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35067699-ac76-4f48-9ccb-b4f56ead7aa2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:18.559409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35067699-ac76-4f48-9ccb-b4f56ead7aa2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:18.689370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-35067699-ac76-4f48-9ccb-b4f56ead7aa2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:18.697427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-35067699-ac76-4f48-9ccb-b4f56ead7aa2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151862 Sep 01 05:32:18.697995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 845/1767] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:18 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:19.086306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8143a9f8-099d-4091-8aad-8287b85fec63 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:19.086878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8143a9f8-099d-4091-8aad-8287b85fec63 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:19.094089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8143a9f8-099d-4091-8aad-8287b85fec63 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:19.094559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8143a9f8-099d-4091-8aad-8287b85fec63 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:19.094986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8143a9f8-099d-4091-8aad-8287b85fec63 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:19.095656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8143a9f8-099d-4091-8aad-8287b85fec63 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:19.096097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8143a9f8-099d-4091-8aad-8287b85fec63 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:19.096516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8143a9f8-099d-4091-8aad-8287b85fec63 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:19.158878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8143a9f8-099d-4091-8aad-8287b85fec63 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:19.167428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8143a9f8-099d-4091-8aad-8287b85fec63 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:19.168872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8143a9f8-099d-4091-8aad-8287b85fec63 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:19.170002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8143a9f8-099d-4091-8aad-8287b85fec63 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087863 Sep 01 05:32:19.170562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 923/1768] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:19 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:19.720342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d5fc003c-6abf-4894-a658-d0f4e6058750 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:19.720999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d5fc003c-6abf-4894-a658-d0f4e6058750 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:19.727451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5fc003c-6abf-4894-a658-d0f4e6058750 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:19.727931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5fc003c-6abf-4894-a658-d0f4e6058750 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:19.728364 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5fc003c-6abf-4894-a658-d0f4e6058750 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:19.729079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5fc003c-6abf-4894-a658-d0f4e6058750 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:19.729535 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5fc003c-6abf-4894-a658-d0f4e6058750 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:19.729953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5fc003c-6abf-4894-a658-d0f4e6058750 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:19.858373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d5fc003c-6abf-4894-a658-d0f4e6058750 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:19.866619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d5fc003c-6abf-4894-a658-d0f4e6058750 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150828 Sep 01 05:32:19.867186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 846/1769] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:19 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:20.193014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ac14dc22-0966-4786-bc71-1462b725c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:20.193628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ac14dc22-0966-4786-bc71-1462b725c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:20.199974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac14dc22-0966-4786-bc71-1462b725c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:20.200445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac14dc22-0966-4786-bc71-1462b725c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:20.200903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac14dc22-0966-4786-bc71-1462b725c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:20.201614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac14dc22-0966-4786-bc71-1462b725c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:20.202932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac14dc22-0966-4786-bc71-1462b725c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:20.203689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac14dc22-0966-4786-bc71-1462b725c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:20.269707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ac14dc22-0966-4786-bc71-1462b725c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:20.278088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ac14dc22-0966-4786-bc71-1462b725c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:20.279524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ac14dc22-0966-4786-bc71-1462b725c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:20.281061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ac14dc22-0966-4786-bc71-1462b725c443 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091902 Sep 01 05:32:20.281621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 924/1770] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:20.887988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-38073259-a8ca-4410-912f-61432958dc41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:20.888618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-38073259-a8ca-4410-912f-61432958dc41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:20.895064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38073259-a8ca-4410-912f-61432958dc41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:20.895588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38073259-a8ca-4410-912f-61432958dc41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:20.895965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38073259-a8ca-4410-912f-61432958dc41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:20.896651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38073259-a8ca-4410-912f-61432958dc41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:20.897132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38073259-a8ca-4410-912f-61432958dc41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:20.897553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38073259-a8ca-4410-912f-61432958dc41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:21.027985 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-38073259-a8ca-4410-912f-61432958dc41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:21.030798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:21.038053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-38073259-a8ca-4410-912f-61432958dc41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153931 Sep 01 05:32:21.038625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 847/1771] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:20 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:21.304619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d5303835-b41b-40df-a3b7-a70894adcdc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:21.305289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d5303835-b41b-40df-a3b7-a70894adcdc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:21.311500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5303835-b41b-40df-a3b7-a70894adcdc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:21.311964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5303835-b41b-40df-a3b7-a70894adcdc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:21.312391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5303835-b41b-40df-a3b7-a70894adcdc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:21.313100 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5303835-b41b-40df-a3b7-a70894adcdc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:21.313548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5303835-b41b-40df-a3b7-a70894adcdc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:21.313965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5303835-b41b-40df-a3b7-a70894adcdc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:21.373343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d5303835-b41b-40df-a3b7-a70894adcdc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:21.381804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d5303835-b41b-40df-a3b7-a70894adcdc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:21.383229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d5303835-b41b-40df-a3b7-a70894adcdc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:21.384360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d5303835-b41b-40df-a3b7-a70894adcdc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.083968 Sep 01 05:32:21.384949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 925/1772] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:21 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:22.060625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d3edc19e-c050-44ff-bbde-6b6a2ec0d5d3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:22.062409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d3edc19e-c050-44ff-bbde-6b6a2ec0d5d3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:22.068817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d3edc19e-c050-44ff-bbde-6b6a2ec0d5d3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:22.069301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d3edc19e-c050-44ff-bbde-6b6a2ec0d5d3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:22.069732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d3edc19e-c050-44ff-bbde-6b6a2ec0d5d3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:22.070411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d3edc19e-c050-44ff-bbde-6b6a2ec0d5d3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:22.070858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d3edc19e-c050-44ff-bbde-6b6a2ec0d5d3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:22.071278 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d3edc19e-c050-44ff-bbde-6b6a2ec0d5d3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:22.203010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d3edc19e-c050-44ff-bbde-6b6a2ec0d5d3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:22.211071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d3edc19e-c050-44ff-bbde-6b6a2ec0d5d3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154280 Sep 01 05:32:22.211634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 848/1773] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:22 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:22.407929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e3cadb99-6b2c-4681-951b-c02bb09dfb4b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:22.408466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e3cadb99-6b2c-4681-951b-c02bb09dfb4b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:22.414802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3cadb99-6b2c-4681-951b-c02bb09dfb4b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:22.415280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3cadb99-6b2c-4681-951b-c02bb09dfb4b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:22.415720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3cadb99-6b2c-4681-951b-c02bb09dfb4b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:22.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3cadb99-6b2c-4681-951b-c02bb09dfb4b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:22.416886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3cadb99-6b2c-4681-951b-c02bb09dfb4b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:22.417314 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3cadb99-6b2c-4681-951b-c02bb09dfb4b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:22.433275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:22.482226 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e3cadb99-6b2c-4681-951b-c02bb09dfb4b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:22.491629 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e3cadb99-6b2c-4681-951b-c02bb09dfb4b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:22.493080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e3cadb99-6b2c-4681-951b-c02bb09dfb4b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:22.494215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e3cadb99-6b2c-4681-951b-c02bb09dfb4b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090853 Sep 01 05:32:22.494889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 926/1774] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:23.233222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b1abda91-0fc6-4885-8b28-b05aa76bcc98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:23.233792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b1abda91-0fc6-4885-8b28-b05aa76bcc98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:23.240383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1abda91-0fc6-4885-8b28-b05aa76bcc98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:23.240895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1abda91-0fc6-4885-8b28-b05aa76bcc98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:23.241368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1abda91-0fc6-4885-8b28-b05aa76bcc98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:23.242058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1abda91-0fc6-4885-8b28-b05aa76bcc98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:23.242512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1abda91-0fc6-4885-8b28-b05aa76bcc98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:23.242936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1abda91-0fc6-4885-8b28-b05aa76bcc98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:23.371133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b1abda91-0fc6-4885-8b28-b05aa76bcc98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:23.379339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b1abda91-0fc6-4885-8b28-b05aa76bcc98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150239 Sep 01 05:32:23.379902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 849/1775] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:23 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:23.517866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d2824913-bda0-4326-a947-3dcad1c0eb3e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:23.518382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d2824913-bda0-4326-a947-3dcad1c0eb3e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:23.524892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2824913-bda0-4326-a947-3dcad1c0eb3e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:23.525377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2824913-bda0-4326-a947-3dcad1c0eb3e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:23.525808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2824913-bda0-4326-a947-3dcad1c0eb3e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:23.526520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2824913-bda0-4326-a947-3dcad1c0eb3e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:23.526967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2824913-bda0-4326-a947-3dcad1c0eb3e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:23.527387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2824913-bda0-4326-a947-3dcad1c0eb3e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:23.588076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d2824913-bda0-4326-a947-3dcad1c0eb3e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:23.597500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d2824913-bda0-4326-a947-3dcad1c0eb3e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:23.598940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d2824913-bda0-4326-a947-3dcad1c0eb3e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:23.600077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d2824913-bda0-4326-a947-3dcad1c0eb3e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086795 Sep 01 05:32:23.600628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 927/1776] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:24.401250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f9d86f27-35db-4751-a785-b7adf1aecbff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:24.401899 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f9d86f27-35db-4751-a785-b7adf1aecbff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:24.409625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f9d86f27-35db-4751-a785-b7adf1aecbff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:24.410105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f9d86f27-35db-4751-a785-b7adf1aecbff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:24.410538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f9d86f27-35db-4751-a785-b7adf1aecbff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:24.411220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f9d86f27-35db-4751-a785-b7adf1aecbff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:24.411667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f9d86f27-35db-4751-a785-b7adf1aecbff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:24.412082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f9d86f27-35db-4751-a785-b7adf1aecbff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:24.545966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f9d86f27-35db-4751-a785-b7adf1aecbff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:24.554357 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f9d86f27-35db-4751-a785-b7adf1aecbff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157002 Sep 01 05:32:24.554926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 850/1777] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:24 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:24.622686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cce22d96-6e30-40db-a3ca-6df9fa58f21e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:24.623298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cce22d96-6e30-40db-a3ca-6df9fa58f21e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:24.629791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cce22d96-6e30-40db-a3ca-6df9fa58f21e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:24.630268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cce22d96-6e30-40db-a3ca-6df9fa58f21e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:24.630698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cce22d96-6e30-40db-a3ca-6df9fa58f21e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:24.631377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cce22d96-6e30-40db-a3ca-6df9fa58f21e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:24.631819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cce22d96-6e30-40db-a3ca-6df9fa58f21e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:24.632236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cce22d96-6e30-40db-a3ca-6df9fa58f21e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:24.693493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cce22d96-6e30-40db-a3ca-6df9fa58f21e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:24.701941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cce22d96-6e30-40db-a3ca-6df9fa58f21e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:24.703379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cce22d96-6e30-40db-a3ca-6df9fa58f21e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:24.704512 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cce22d96-6e30-40db-a3ca-6df9fa58f21e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085672 Sep 01 05:32:24.705109 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 928/1778] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:25.575462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-13c48556-614a-446e-ab85-967943a06cea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:25.576556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-13c48556-614a-446e-ab85-967943a06cea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:25.583171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13c48556-614a-446e-ab85-967943a06cea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:25.583649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13c48556-614a-446e-ab85-967943a06cea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:25.584080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13c48556-614a-446e-ab85-967943a06cea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:25.584762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13c48556-614a-446e-ab85-967943a06cea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:25.585237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13c48556-614a-446e-ab85-967943a06cea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:25.585660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13c48556-614a-446e-ab85-967943a06cea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:25.713010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-13c48556-614a-446e-ab85-967943a06cea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:25.721956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-13c48556-614a-446e-ab85-967943a06cea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150454 Sep 01 05:32:25.722516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 851/1779] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:25 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:25.727373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-40c5ae85-dce3-4c20-b944-0b7fa55422b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:25.727985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-40c5ae85-dce3-4c20-b944-0b7fa55422b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:25.734756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40c5ae85-dce3-4c20-b944-0b7fa55422b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:25.735232 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40c5ae85-dce3-4c20-b944-0b7fa55422b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:25.735672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40c5ae85-dce3-4c20-b944-0b7fa55422b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:25.736355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40c5ae85-dce3-4c20-b944-0b7fa55422b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:25.736827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40c5ae85-dce3-4c20-b944-0b7fa55422b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:25.737249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40c5ae85-dce3-4c20-b944-0b7fa55422b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:25.797712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40c5ae85-dce3-4c20-b944-0b7fa55422b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:25.806559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40c5ae85-dce3-4c20-b944-0b7fa55422b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:25.808010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40c5ae85-dce3-4c20-b944-0b7fa55422b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:25.809158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-40c5ae85-dce3-4c20-b944-0b7fa55422b6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085612 Sep 01 05:32:25.809711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 929/1780] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:26.743291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bbdab064-c661-4734-8cb3-902e30d25f70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:26.743903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bbdab064-c661-4734-8cb3-902e30d25f70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:26.750963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbdab064-c661-4734-8cb3-902e30d25f70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:26.751446 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbdab064-c661-4734-8cb3-902e30d25f70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:26.751881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbdab064-c661-4734-8cb3-902e30d25f70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:26.752571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbdab064-c661-4734-8cb3-902e30d25f70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:26.753057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbdab064-c661-4734-8cb3-902e30d25f70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:26.753486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbdab064-c661-4734-8cb3-902e30d25f70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:26.831345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9ab374c9-c865-41f6-98a3-a540dceb6201 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:26.831964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9ab374c9-c865-41f6-98a3-a540dceb6201 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:26.838374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ab374c9-c865-41f6-98a3-a540dceb6201 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:26.838860 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ab374c9-c865-41f6-98a3-a540dceb6201 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:26.839318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ab374c9-c865-41f6-98a3-a540dceb6201 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:26.840002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ab374c9-c865-41f6-98a3-a540dceb6201 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:26.840475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ab374c9-c865-41f6-98a3-a540dceb6201 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:26.840981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ab374c9-c865-41f6-98a3-a540dceb6201 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:26.887199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bbdab064-c661-4734-8cb3-902e30d25f70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:26.897127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bbdab064-c661-4734-8cb3-902e30d25f70 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157584 Sep 01 05:32:26.897727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 852/1781] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:26 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:26.906786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ab374c9-c865-41f6-98a3-a540dceb6201 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:26.915642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ab374c9-c865-41f6-98a3-a540dceb6201 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:26.917271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ab374c9-c865-41f6-98a3-a540dceb6201 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:26.918496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9ab374c9-c865-41f6-98a3-a540dceb6201 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091068 Sep 01 05:32:26.919137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 930/1782] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:27.919468 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7275c44b-962a-496a-8f2c-b65ad65436f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:27.920177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7275c44b-962a-496a-8f2c-b65ad65436f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:27.927031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7275c44b-962a-496a-8f2c-b65ad65436f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:27.927516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7275c44b-962a-496a-8f2c-b65ad65436f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:27.927954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7275c44b-962a-496a-8f2c-b65ad65436f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:27.928685 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7275c44b-962a-496a-8f2c-b65ad65436f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:27.929171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7275c44b-962a-496a-8f2c-b65ad65436f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:27.929595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7275c44b-962a-496a-8f2c-b65ad65436f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:27.941869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a24a5537-bc83-4e50-a388-9c21a550e718 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:27.942475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a24a5537-bc83-4e50-a388-9c21a550e718 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:27.948879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a24a5537-bc83-4e50-a388-9c21a550e718 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:27.949366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a24a5537-bc83-4e50-a388-9c21a550e718 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:27.949800 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a24a5537-bc83-4e50-a388-9c21a550e718 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:27.950486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a24a5537-bc83-4e50-a388-9c21a550e718 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:27.951725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a24a5537-bc83-4e50-a388-9c21a550e718 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:27.952301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a24a5537-bc83-4e50-a388-9c21a550e718 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:28.016349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a24a5537-bc83-4e50-a388-9c21a550e718 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:28.025066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a24a5537-bc83-4e50-a388-9c21a550e718 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:28.026488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a24a5537-bc83-4e50-a388-9c21a550e718 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:28.027620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a24a5537-bc83-4e50-a388-9c21a550e718 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089606 Sep 01 05:32:28.028172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 931/1783] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:27 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:28.062609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7275c44b-962a-496a-8f2c-b65ad65436f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:28.070839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7275c44b-962a-496a-8f2c-b65ad65436f4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155244 Sep 01 05:32:28.071406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 853/1784] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:27 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:29.051345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9ffba8ed-511e-4850-9a9f-8ad1f3cf69dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:29.052210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9ffba8ed-511e-4850-9a9f-8ad1f3cf69dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:29.058623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ffba8ed-511e-4850-9a9f-8ad1f3cf69dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:29.059092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ffba8ed-511e-4850-9a9f-8ad1f3cf69dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:29.059517 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ffba8ed-511e-4850-9a9f-8ad1f3cf69dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:29.060690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ffba8ed-511e-4850-9a9f-8ad1f3cf69dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:29.061163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ffba8ed-511e-4850-9a9f-8ad1f3cf69dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:29.061572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ffba8ed-511e-4850-9a9f-8ad1f3cf69dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:29.092238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-38a5f04b-0976-47a1-a4c4-0316e84b4b85 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:29.092873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-38a5f04b-0976-47a1-a4c4-0316e84b4b85 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:29.099738 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38a5f04b-0976-47a1-a4c4-0316e84b4b85 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:29.100264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38a5f04b-0976-47a1-a4c4-0316e84b4b85 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:29.100710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38a5f04b-0976-47a1-a4c4-0316e84b4b85 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:29.101435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38a5f04b-0976-47a1-a4c4-0316e84b4b85 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:29.101890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38a5f04b-0976-47a1-a4c4-0316e84b4b85 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:29.102314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-38a5f04b-0976-47a1-a4c4-0316e84b4b85 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:29.121378 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ffba8ed-511e-4850-9a9f-8ad1f3cf69dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:29.132629 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ffba8ed-511e-4850-9a9f-8ad1f3cf69dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:29.134601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ffba8ed-511e-4850-9a9f-8ad1f3cf69dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:29.135764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9ffba8ed-511e-4850-9a9f-8ad1f3cf69dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088294 Sep 01 05:32:29.136719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 932/1785] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:29 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:29.235196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-38a5f04b-0976-47a1-a4c4-0316e84b4b85 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:29.243377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-38a5f04b-0976-47a1-a4c4-0316e84b4b85 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155434 Sep 01 05:32:29.243941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 854/1786] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:29 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:30.160240 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a1c8a63d-1bce-47ef-85a1-7c83be5cf3cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:30.160882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a1c8a63d-1bce-47ef-85a1-7c83be5cf3cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:30.167338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1c8a63d-1bce-47ef-85a1-7c83be5cf3cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:30.167809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1c8a63d-1bce-47ef-85a1-7c83be5cf3cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:30.168228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1c8a63d-1bce-47ef-85a1-7c83be5cf3cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:30.168927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1c8a63d-1bce-47ef-85a1-7c83be5cf3cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:30.169392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1c8a63d-1bce-47ef-85a1-7c83be5cf3cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:30.169804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1c8a63d-1bce-47ef-85a1-7c83be5cf3cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:30.230258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a1c8a63d-1bce-47ef-85a1-7c83be5cf3cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:30.238868 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a1c8a63d-1bce-47ef-85a1-7c83be5cf3cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:30.240340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a1c8a63d-1bce-47ef-85a1-7c83be5cf3cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:30.241525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a1c8a63d-1bce-47ef-85a1-7c83be5cf3cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085248 Sep 01 05:32:30.242081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 933/1787] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:30 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:30.265484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a5a87e71-b957-404f-8293-e5b08c797f31 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:30.266092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a5a87e71-b957-404f-8293-e5b08c797f31 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:30.272496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5a87e71-b957-404f-8293-e5b08c797f31 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:30.273013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5a87e71-b957-404f-8293-e5b08c797f31 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:30.273453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5a87e71-b957-404f-8293-e5b08c797f31 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:30.274145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5a87e71-b957-404f-8293-e5b08c797f31 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:30.274604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5a87e71-b957-404f-8293-e5b08c797f31 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:30.275031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5a87e71-b957-404f-8293-e5b08c797f31 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:30.409181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a5a87e71-b957-404f-8293-e5b08c797f31 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:30.417489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a5a87e71-b957-404f-8293-e5b08c797f31 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156491 Sep 01 05:32:30.417993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 855/1788] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:30 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:31.264464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f694e706-269a-4c67-87d3-95b71bf35d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:31.265036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f694e706-269a-4c67-87d3-95b71bf35d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:31.271328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f694e706-269a-4c67-87d3-95b71bf35d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:31.271801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f694e706-269a-4c67-87d3-95b71bf35d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:31.272229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f694e706-269a-4c67-87d3-95b71bf35d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:31.272935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f694e706-269a-4c67-87d3-95b71bf35d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:31.273372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f694e706-269a-4c67-87d3-95b71bf35d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:31.273786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f694e706-269a-4c67-87d3-95b71bf35d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:31.337600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f694e706-269a-4c67-87d3-95b71bf35d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:31.346170 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f694e706-269a-4c67-87d3-95b71bf35d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:31.347602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f694e706-269a-4c67-87d3-95b71bf35d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:31.348728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f694e706-269a-4c67-87d3-95b71bf35d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089135 Sep 01 05:32:31.349322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 934/1789] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:31.439725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f24c907e-dae0-4c90-9395-3ebfce6d3712 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:31.440340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f24c907e-dae0-4c90-9395-3ebfce6d3712 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:31.446817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f24c907e-dae0-4c90-9395-3ebfce6d3712 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:31.447298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f24c907e-dae0-4c90-9395-3ebfce6d3712 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:31.447733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f24c907e-dae0-4c90-9395-3ebfce6d3712 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:31.448415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f24c907e-dae0-4c90-9395-3ebfce6d3712 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:31.448895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f24c907e-dae0-4c90-9395-3ebfce6d3712 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:31.449322 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f24c907e-dae0-4c90-9395-3ebfce6d3712 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:31.581596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f24c907e-dae0-4c90-9395-3ebfce6d3712 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:31.589706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f24c907e-dae0-4c90-9395-3ebfce6d3712 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154603 Sep 01 05:32:31.590270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 856/1790] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:31 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:32.371539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-04d202c2-5473-45a5-ad0f-8a36f4d979df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:32.372786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-04d202c2-5473-45a5-ad0f-8a36f4d979df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:32.379441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04d202c2-5473-45a5-ad0f-8a36f4d979df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:32.379930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04d202c2-5473-45a5-ad0f-8a36f4d979df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:32.380362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04d202c2-5473-45a5-ad0f-8a36f4d979df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:32.381073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04d202c2-5473-45a5-ad0f-8a36f4d979df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:32.381524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04d202c2-5473-45a5-ad0f-8a36f4d979df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:32.381948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04d202c2-5473-45a5-ad0f-8a36f4d979df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:32.443482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-04d202c2-5473-45a5-ad0f-8a36f4d979df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:32.452301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-04d202c2-5473-45a5-ad0f-8a36f4d979df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:32.453777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-04d202c2-5473-45a5-ad0f-8a36f4d979df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:32.454913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-04d202c2-5473-45a5-ad0f-8a36f4d979df tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087318 Sep 01 05:32:32.455481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 935/1791] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:32.612293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f2b99424-763a-41fe-92f1-40e9ad7e2cbc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:32.612936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f2b99424-763a-41fe-92f1-40e9ad7e2cbc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:32.619361 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2b99424-763a-41fe-92f1-40e9ad7e2cbc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:32.619846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2b99424-763a-41fe-92f1-40e9ad7e2cbc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:32.620286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2b99424-763a-41fe-92f1-40e9ad7e2cbc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:32.621015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2b99424-763a-41fe-92f1-40e9ad7e2cbc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:32.621473 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2b99424-763a-41fe-92f1-40e9ad7e2cbc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:32.621952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2b99424-763a-41fe-92f1-40e9ad7e2cbc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:32.751279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f2b99424-763a-41fe-92f1-40e9ad7e2cbc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:32.759489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f2b99424-763a-41fe-92f1-40e9ad7e2cbc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151083 Sep 01 05:32:32.760059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 857/1792] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:32 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:33.477636 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a1ebddbb-d7e7-4ed9-a6d5-dab72e641ecc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:33.478240 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a1ebddbb-d7e7-4ed9-a6d5-dab72e641ecc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:33.486553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1ebddbb-d7e7-4ed9-a6d5-dab72e641ecc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:33.487022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1ebddbb-d7e7-4ed9-a6d5-dab72e641ecc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:33.487446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1ebddbb-d7e7-4ed9-a6d5-dab72e641ecc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:33.488119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1ebddbb-d7e7-4ed9-a6d5-dab72e641ecc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:33.488557 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1ebddbb-d7e7-4ed9-a6d5-dab72e641ecc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:33.489001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a1ebddbb-d7e7-4ed9-a6d5-dab72e641ecc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:33.549791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a1ebddbb-d7e7-4ed9-a6d5-dab72e641ecc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:33.558407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a1ebddbb-d7e7-4ed9-a6d5-dab72e641ecc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:33.560357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a1ebddbb-d7e7-4ed9-a6d5-dab72e641ecc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:33.561510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a1ebddbb-d7e7-4ed9-a6d5-dab72e641ecc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087845 Sep 01 05:32:33.562056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 936/1793] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:33.781332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0bab13a1-c272-4a5a-8568-fce08c718652 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:33.781947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0bab13a1-c272-4a5a-8568-fce08c718652 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:33.788240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0bab13a1-c272-4a5a-8568-fce08c718652 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:33.788722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0bab13a1-c272-4a5a-8568-fce08c718652 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:33.789190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0bab13a1-c272-4a5a-8568-fce08c718652 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:33.789876 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0bab13a1-c272-4a5a-8568-fce08c718652 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:33.790332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0bab13a1-c272-4a5a-8568-fce08c718652 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:33.790756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0bab13a1-c272-4a5a-8568-fce08c718652 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:33.920191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0bab13a1-c272-4a5a-8568-fce08c718652 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:33.928588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0bab13a1-c272-4a5a-8568-fce08c718652 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151271 Sep 01 05:32:33.929180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 858/1794] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:34.585135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-110a7b6b-5af9-48d5-8bbb-ed7c43672228 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:34.585784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-110a7b6b-5af9-48d5-8bbb-ed7c43672228 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:34.592696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-110a7b6b-5af9-48d5-8bbb-ed7c43672228 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:34.593193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-110a7b6b-5af9-48d5-8bbb-ed7c43672228 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:34.593620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-110a7b6b-5af9-48d5-8bbb-ed7c43672228 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:34.594290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-110a7b6b-5af9-48d5-8bbb-ed7c43672228 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:34.594729 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-110a7b6b-5af9-48d5-8bbb-ed7c43672228 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:34.595141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-110a7b6b-5af9-48d5-8bbb-ed7c43672228 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:34.658237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-110a7b6b-5af9-48d5-8bbb-ed7c43672228 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:34.666725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-110a7b6b-5af9-48d5-8bbb-ed7c43672228 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:34.668135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-110a7b6b-5af9-48d5-8bbb-ed7c43672228 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:34.669519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-110a7b6b-5af9-48d5-8bbb-ed7c43672228 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088337 Sep 01 05:32:34.669984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 937/1795] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:34.949467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-68100c88-9cbd-490a-af30-15ec58a4a4ca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:34.950595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-68100c88-9cbd-490a-af30-15ec58a4a4ca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:34.957013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-68100c88-9cbd-490a-af30-15ec58a4a4ca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:34.957494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-68100c88-9cbd-490a-af30-15ec58a4a4ca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:34.957931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-68100c88-9cbd-490a-af30-15ec58a4a4ca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:34.958622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-68100c88-9cbd-490a-af30-15ec58a4a4ca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:34.959071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-68100c88-9cbd-490a-af30-15ec58a4a4ca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:34.959489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-68100c88-9cbd-490a-af30-15ec58a4a4ca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:35.088393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-68100c88-9cbd-490a-af30-15ec58a4a4ca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:35.098647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-68100c88-9cbd-490a-af30-15ec58a4a4ca tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153066 Sep 01 05:32:35.099212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 859/1796] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:35.692318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d36eeb58-fdf9-4191-8d6c-bd0f980f4dc4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:35.692950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d36eeb58-fdf9-4191-8d6c-bd0f980f4dc4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:35.699275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d36eeb58-fdf9-4191-8d6c-bd0f980f4dc4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:35.699760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d36eeb58-fdf9-4191-8d6c-bd0f980f4dc4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:35.700871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d36eeb58-fdf9-4191-8d6c-bd0f980f4dc4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:35.701547 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d36eeb58-fdf9-4191-8d6c-bd0f980f4dc4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:35.701989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d36eeb58-fdf9-4191-8d6c-bd0f980f4dc4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:35.702403 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d36eeb58-fdf9-4191-8d6c-bd0f980f4dc4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:35.765006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d36eeb58-fdf9-4191-8d6c-bd0f980f4dc4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:35.773565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d36eeb58-fdf9-4191-8d6c-bd0f980f4dc4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:35.775013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d36eeb58-fdf9-4191-8d6c-bd0f980f4dc4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:35.776149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d36eeb58-fdf9-4191-8d6c-bd0f980f4dc4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087763 Sep 01 05:32:35.776715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 938/1797] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:36.121219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5fc5399f-d724-4ba1-b032-52be835be318 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:36.121868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5fc5399f-d724-4ba1-b032-52be835be318 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:36.128192 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5fc5399f-d724-4ba1-b032-52be835be318 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:36.128668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5fc5399f-d724-4ba1-b032-52be835be318 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:36.129127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5fc5399f-d724-4ba1-b032-52be835be318 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:36.129806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5fc5399f-d724-4ba1-b032-52be835be318 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:36.130299 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5fc5399f-d724-4ba1-b032-52be835be318 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:36.130714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5fc5399f-d724-4ba1-b032-52be835be318 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:36.261506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5fc5399f-d724-4ba1-b032-52be835be318 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:36.270612 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5fc5399f-d724-4ba1-b032-52be835be318 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153424 Sep 01 05:32:36.271424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 860/1798] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:36 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:36.799930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f948f4d2-042b-4a90-bf7a-3373902a5c21 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:36.800547 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f948f4d2-042b-4a90-bf7a-3373902a5c21 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:36.807285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f948f4d2-042b-4a90-bf7a-3373902a5c21 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:36.807765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f948f4d2-042b-4a90-bf7a-3373902a5c21 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:36.808200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f948f4d2-042b-4a90-bf7a-3373902a5c21 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:36.808920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f948f4d2-042b-4a90-bf7a-3373902a5c21 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:36.809414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f948f4d2-042b-4a90-bf7a-3373902a5c21 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:36.809855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f948f4d2-042b-4a90-bf7a-3373902a5c21 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:36.870755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f948f4d2-042b-4a90-bf7a-3373902a5c21 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:36.879595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f948f4d2-042b-4a90-bf7a-3373902a5c21 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:36.881075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f948f4d2-042b-4a90-bf7a-3373902a5c21 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:36.882213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f948f4d2-042b-4a90-bf7a-3373902a5c21 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086195 Sep 01 05:32:36.882774 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 939/1799] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:37.292591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e5f64b2f-f2ad-4b4b-8cc2-2ccb473d4a6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:37.293224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e5f64b2f-f2ad-4b4b-8cc2-2ccb473d4a6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:37.299559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e5f64b2f-f2ad-4b4b-8cc2-2ccb473d4a6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:37.300099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e5f64b2f-f2ad-4b4b-8cc2-2ccb473d4a6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:37.300530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e5f64b2f-f2ad-4b4b-8cc2-2ccb473d4a6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:37.301489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e5f64b2f-f2ad-4b4b-8cc2-2ccb473d4a6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:37.301936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e5f64b2f-f2ad-4b4b-8cc2-2ccb473d4a6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:37.302352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e5f64b2f-f2ad-4b4b-8cc2-2ccb473d4a6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:37.429149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e5f64b2f-f2ad-4b4b-8cc2-2ccb473d4a6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:37.437971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e5f64b2f-f2ad-4b4b-8cc2-2ccb473d4a6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149282 Sep 01 05:32:37.438538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 861/1800] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:37 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:37.905597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e97b70c2-1503-49ce-861a-7a3baa7831ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:37.906206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e97b70c2-1503-49ce-861a-7a3baa7831ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:37.912327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e97b70c2-1503-49ce-861a-7a3baa7831ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:37.912838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e97b70c2-1503-49ce-861a-7a3baa7831ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:37.913271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e97b70c2-1503-49ce-861a-7a3baa7831ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:37.913985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e97b70c2-1503-49ce-861a-7a3baa7831ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:37.914434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e97b70c2-1503-49ce-861a-7a3baa7831ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:37.914856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e97b70c2-1503-49ce-861a-7a3baa7831ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:37.978368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e97b70c2-1503-49ce-861a-7a3baa7831ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:37.987786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e97b70c2-1503-49ce-861a-7a3baa7831ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:37.989259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e97b70c2-1503-49ce-861a-7a3baa7831ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:37.990402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e97b70c2-1503-49ce-861a-7a3baa7831ac tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089233 Sep 01 05:32:37.990990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 940/1801] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:37 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:38.460008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3650a4e2-e003-4673-8f90-2381c85ed61b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:38.460639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3650a4e2-e003-4673-8f90-2381c85ed61b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:38.467982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3650a4e2-e003-4673-8f90-2381c85ed61b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:38.468627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3650a4e2-e003-4673-8f90-2381c85ed61b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:38.469295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3650a4e2-e003-4673-8f90-2381c85ed61b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:38.469973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3650a4e2-e003-4673-8f90-2381c85ed61b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:38.470419 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3650a4e2-e003-4673-8f90-2381c85ed61b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:38.470832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3650a4e2-e003-4673-8f90-2381c85ed61b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:38.604194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3650a4e2-e003-4673-8f90-2381c85ed61b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:38.612596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3650a4e2-e003-4673-8f90-2381c85ed61b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156458 Sep 01 05:32:38.613127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 862/1802] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:38 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:39.014049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-29a03600-e444-4bac-bd76-da160667c589 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:39.014665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-29a03600-e444-4bac-bd76-da160667c589 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:39.021101 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29a03600-e444-4bac-bd76-da160667c589 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:39.021585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29a03600-e444-4bac-bd76-da160667c589 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:39.022022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29a03600-e444-4bac-bd76-da160667c589 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:39.022707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29a03600-e444-4bac-bd76-da160667c589 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:39.023155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29a03600-e444-4bac-bd76-da160667c589 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:39.023577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-29a03600-e444-4bac-bd76-da160667c589 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:39.084976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-29a03600-e444-4bac-bd76-da160667c589 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:39.094390 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-29a03600-e444-4bac-bd76-da160667c589 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:39.095838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-29a03600-e444-4bac-bd76-da160667c589 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:39.097016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-29a03600-e444-4bac-bd76-da160667c589 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086991 Sep 01 05:32:39.097573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 941/1803] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:39 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:39.633959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7087b862-8519-4446-be90-4a9ead8d7382 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:39.634580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7087b862-8519-4446-be90-4a9ead8d7382 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:39.641649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7087b862-8519-4446-be90-4a9ead8d7382 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:39.642133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7087b862-8519-4446-be90-4a9ead8d7382 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:39.642570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7087b862-8519-4446-be90-4a9ead8d7382 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:39.643263 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7087b862-8519-4446-be90-4a9ead8d7382 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:39.643715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7087b862-8519-4446-be90-4a9ead8d7382 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:39.644157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7087b862-8519-4446-be90-4a9ead8d7382 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:39.775852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7087b862-8519-4446-be90-4a9ead8d7382 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:39.784571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7087b862-8519-4446-be90-4a9ead8d7382 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154375 Sep 01 05:32:39.785160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 863/1804] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:40.119588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ee6a78d4-d739-4149-a2cd-9f01f7c1cfd5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:40.120164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ee6a78d4-d739-4149-a2cd-9f01f7c1cfd5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:40.126863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee6a78d4-d739-4149-a2cd-9f01f7c1cfd5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.127334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee6a78d4-d739-4149-a2cd-9f01f7c1cfd5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.127763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee6a78d4-d739-4149-a2cd-9f01f7c1cfd5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.128444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee6a78d4-d739-4149-a2cd-9f01f7c1cfd5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.128920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee6a78d4-d739-4149-a2cd-9f01f7c1cfd5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.129339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee6a78d4-d739-4149-a2cd-9f01f7c1cfd5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.193631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ee6a78d4-d739-4149-a2cd-9f01f7c1cfd5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:40.202618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ee6a78d4-d739-4149-a2cd-9f01f7c1cfd5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:40.204035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ee6a78d4-d739-4149-a2cd-9f01f7c1cfd5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:40.205200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ee6a78d4-d739-4149-a2cd-9f01f7c1cfd5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089542 Sep 01 05:32:40.205754 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 942/1805] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:40.806726 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-aa3f2d8f-c6ee-4c70-a026-7f428497e00e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:40.807344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-aa3f2d8f-c6ee-4c70-a026-7f428497e00e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:40.814836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa3f2d8f-c6ee-4c70-a026-7f428497e00e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.815320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa3f2d8f-c6ee-4c70-a026-7f428497e00e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.815756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa3f2d8f-c6ee-4c70-a026-7f428497e00e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.816446 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa3f2d8f-c6ee-4c70-a026-7f428497e00e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.816923 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa3f2d8f-c6ee-4c70-a026-7f428497e00e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.817350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa3f2d8f-c6ee-4c70-a026-7f428497e00e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.832285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:40.949741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-aa3f2d8f-c6ee-4c70-a026-7f428497e00e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:40.957940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-aa3f2d8f-c6ee-4c70-a026-7f428497e00e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155156 Sep 01 05:32:40.958504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 864/1806] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:40 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:41.227514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1af882e5-fe80-4579-82d2-7b5335b119c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:41.228177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1af882e5-fe80-4579-82d2-7b5335b119c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:41.235323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1af882e5-fe80-4579-82d2-7b5335b119c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.235798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1af882e5-fe80-4579-82d2-7b5335b119c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.236231 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1af882e5-fe80-4579-82d2-7b5335b119c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.236947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1af882e5-fe80-4579-82d2-7b5335b119c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.237398 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1af882e5-fe80-4579-82d2-7b5335b119c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.237818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1af882e5-fe80-4579-82d2-7b5335b119c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.241692 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:41.299068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1af882e5-fe80-4579-82d2-7b5335b119c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:41.308136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1af882e5-fe80-4579-82d2-7b5335b119c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:41.309961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1af882e5-fe80-4579-82d2-7b5335b119c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:41.311087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1af882e5-fe80-4579-82d2-7b5335b119c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087520 Sep 01 05:32:41.311644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 943/1807] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:41.979594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-11ac72fe-b66d-48fa-baac-655f203c397b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:41.980197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-11ac72fe-b66d-48fa-baac-655f203c397b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:41.987304 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-11ac72fe-b66d-48fa-baac-655f203c397b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.987778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-11ac72fe-b66d-48fa-baac-655f203c397b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.988205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-11ac72fe-b66d-48fa-baac-655f203c397b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.988943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-11ac72fe-b66d-48fa-baac-655f203c397b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.989367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-11ac72fe-b66d-48fa-baac-655f203c397b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.989780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-11ac72fe-b66d-48fa-baac-655f203c397b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:42.116606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-11ac72fe-b66d-48fa-baac-655f203c397b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:42.124897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-11ac72fe-b66d-48fa-baac-655f203c397b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149106 Sep 01 05:32:42.125463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 865/1808] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:42.334471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e185f255-f2f9-41bd-93c7-376b9d6b95d6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:42.335081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e185f255-f2f9-41bd-93c7-376b9d6b95d6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:42.342294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e185f255-f2f9-41bd-93c7-376b9d6b95d6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:42.342764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e185f255-f2f9-41bd-93c7-376b9d6b95d6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:42.343248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e185f255-f2f9-41bd-93c7-376b9d6b95d6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:42.343925 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e185f255-f2f9-41bd-93c7-376b9d6b95d6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:42.344365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e185f255-f2f9-41bd-93c7-376b9d6b95d6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:42.344793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e185f255-f2f9-41bd-93c7-376b9d6b95d6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:42.406731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e185f255-f2f9-41bd-93c7-376b9d6b95d6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:42.415243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e185f255-f2f9-41bd-93c7-376b9d6b95d6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:42.416677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e185f255-f2f9-41bd-93c7-376b9d6b95d6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:42.417842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e185f255-f2f9-41bd-93c7-376b9d6b95d6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087270 Sep 01 05:32:42.418441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 944/1809] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:43.146863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9baea12e-d2a2-45c1-b40c-e302d3377411 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:43.147509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9baea12e-d2a2-45c1-b40c-e302d3377411 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:43.154222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9baea12e-d2a2-45c1-b40c-e302d3377411 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.154705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9baea12e-d2a2-45c1-b40c-e302d3377411 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.155131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9baea12e-d2a2-45c1-b40c-e302d3377411 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.155803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9baea12e-d2a2-45c1-b40c-e302d3377411 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.156246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9baea12e-d2a2-45c1-b40c-e302d3377411 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.156659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9baea12e-d2a2-45c1-b40c-e302d3377411 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.283557 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9baea12e-d2a2-45c1-b40c-e302d3377411 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:43.291824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9baea12e-d2a2-45c1-b40c-e302d3377411 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149075 Sep 01 05:32:43.292388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 866/1810] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:43 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:43.441117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-063a575d-88b3-45c9-a193-5649530c4eb2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:43.441644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-063a575d-88b3-45c9-a193-5649530c4eb2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:43.447888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-063a575d-88b3-45c9-a193-5649530c4eb2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.448358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-063a575d-88b3-45c9-a193-5649530c4eb2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.448798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-063a575d-88b3-45c9-a193-5649530c4eb2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.450249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-063a575d-88b3-45c9-a193-5649530c4eb2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.450781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-063a575d-88b3-45c9-a193-5649530c4eb2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.451197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-063a575d-88b3-45c9-a193-5649530c4eb2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.510158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-063a575d-88b3-45c9-a193-5649530c4eb2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:43.520257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-063a575d-88b3-45c9-a193-5649530c4eb2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:43.521731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-063a575d-88b3-45c9-a193-5649530c4eb2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:43.522862 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-063a575d-88b3-45c9-a193-5649530c4eb2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086001 Sep 01 05:32:43.523440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 945/1811] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:44.314001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-725f0a9d-265c-493f-9486-197f78a681e7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:44.314616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-725f0a9d-265c-493f-9486-197f78a681e7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:44.321070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-725f0a9d-265c-493f-9486-197f78a681e7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.321552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-725f0a9d-265c-493f-9486-197f78a681e7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.321988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-725f0a9d-265c-493f-9486-197f78a681e7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.322676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-725f0a9d-265c-493f-9486-197f78a681e7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.323130 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-725f0a9d-265c-493f-9486-197f78a681e7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.323555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-725f0a9d-265c-493f-9486-197f78a681e7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.457433 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-725f0a9d-265c-493f-9486-197f78a681e7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:44.466502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-725f0a9d-265c-493f-9486-197f78a681e7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156353 Sep 01 05:32:44.467079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 867/1812] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:44 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:44.545377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-821a3f5f-e253-4bc5-94e6-1cd0325c3c45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:44.545920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-821a3f5f-e253-4bc5-94e6-1cd0325c3c45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:44.552565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-821a3f5f-e253-4bc5-94e6-1cd0325c3c45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.553084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-821a3f5f-e253-4bc5-94e6-1cd0325c3c45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.553523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-821a3f5f-e253-4bc5-94e6-1cd0325c3c45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.554216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-821a3f5f-e253-4bc5-94e6-1cd0325c3c45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.554668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-821a3f5f-e253-4bc5-94e6-1cd0325c3c45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.555123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-821a3f5f-e253-4bc5-94e6-1cd0325c3c45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.618843 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-821a3f5f-e253-4bc5-94e6-1cd0325c3c45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:44.627373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-821a3f5f-e253-4bc5-94e6-1cd0325c3c45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:44.628881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-821a3f5f-e253-4bc5-94e6-1cd0325c3c45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:44.630017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-821a3f5f-e253-4bc5-94e6-1cd0325c3c45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088756 Sep 01 05:32:44.630573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 946/1813] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:45.487485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-29374746-7213-4d58-95f5-b75ae159dbaf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:45.488089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-29374746-7213-4d58-95f5-b75ae159dbaf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:45.494502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-29374746-7213-4d58-95f5-b75ae159dbaf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.494978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-29374746-7213-4d58-95f5-b75ae159dbaf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.495407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-29374746-7213-4d58-95f5-b75ae159dbaf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.496283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-29374746-7213-4d58-95f5-b75ae159dbaf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.497138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-29374746-7213-4d58-95f5-b75ae159dbaf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.497915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-29374746-7213-4d58-95f5-b75ae159dbaf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.626943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-29374746-7213-4d58-95f5-b75ae159dbaf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:45.634900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-29374746-7213-4d58-95f5-b75ae159dbaf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151267 Sep 01 05:32:45.635456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 868/1814] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:45.653608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cb2db4e6-78a6-4d3a-afe2-fac325fd387b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:45.654213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cb2db4e6-78a6-4d3a-afe2-fac325fd387b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:45.660514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb2db4e6-78a6-4d3a-afe2-fac325fd387b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.661021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb2db4e6-78a6-4d3a-afe2-fac325fd387b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.661447 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb2db4e6-78a6-4d3a-afe2-fac325fd387b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.662119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb2db4e6-78a6-4d3a-afe2-fac325fd387b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.662558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb2db4e6-78a6-4d3a-afe2-fac325fd387b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.662973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cb2db4e6-78a6-4d3a-afe2-fac325fd387b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.963427 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cb2db4e6-78a6-4d3a-afe2-fac325fd387b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:45.972696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cb2db4e6-78a6-4d3a-afe2-fac325fd387b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:45.974169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cb2db4e6-78a6-4d3a-afe2-fac325fd387b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:45.975340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cb2db4e6-78a6-4d3a-afe2-fac325fd387b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.326322 Sep 01 05:32:45.975903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 947/1815] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:45 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:46.659434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fe53c03a-cae9-48fb-b6ef-070c8c9bfd21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:46.660037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fe53c03a-cae9-48fb-b6ef-070c8c9bfd21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:46.662457 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=52 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:46.668340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe53c03a-cae9-48fb-b6ef-070c8c9bfd21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:46.668865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe53c03a-cae9-48fb-b6ef-070c8c9bfd21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:46.669303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe53c03a-cae9-48fb-b6ef-070c8c9bfd21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:46.669991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe53c03a-cae9-48fb-b6ef-070c8c9bfd21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:46.670440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe53c03a-cae9-48fb-b6ef-070c8c9bfd21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:46.670861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe53c03a-cae9-48fb-b6ef-070c8c9bfd21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:46.801887 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fe53c03a-cae9-48fb-b6ef-070c8c9bfd21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:46.810001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fe53c03a-cae9-48fb-b6ef-070c8c9bfd21 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154451 Sep 01 05:32:46.810566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 869/1816] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:46 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:46.998738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-082dfe6a-e669-4eb9-b6d9-f77e35202b85 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:46.999250 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-082dfe6a-e669-4eb9-b6d9-f77e35202b85 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:47.001580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=56 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:47.007004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-082dfe6a-e669-4eb9-b6d9-f77e35202b85 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.007474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-082dfe6a-e669-4eb9-b6d9-f77e35202b85 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.007900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-082dfe6a-e669-4eb9-b6d9-f77e35202b85 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.008573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-082dfe6a-e669-4eb9-b6d9-f77e35202b85 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.009045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-082dfe6a-e669-4eb9-b6d9-f77e35202b85 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.009458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-082dfe6a-e669-4eb9-b6d9-f77e35202b85 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.071102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-082dfe6a-e669-4eb9-b6d9-f77e35202b85 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:47.080268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-082dfe6a-e669-4eb9-b6d9-f77e35202b85 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:47.081742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-082dfe6a-e669-4eb9-b6d9-f77e35202b85 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:47.082880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-082dfe6a-e669-4eb9-b6d9-f77e35202b85 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088828 Sep 01 05:32:47.083441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 948/1817] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:47.830847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-34e1f18c-ad73-4596-8983-22b1e9c3b039 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:47.831443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-34e1f18c-ad73-4596-8983-22b1e9c3b039 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:47.837809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34e1f18c-ad73-4596-8983-22b1e9c3b039 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.838279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34e1f18c-ad73-4596-8983-22b1e9c3b039 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.838707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34e1f18c-ad73-4596-8983-22b1e9c3b039 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.839380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34e1f18c-ad73-4596-8983-22b1e9c3b039 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.840492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34e1f18c-ad73-4596-8983-22b1e9c3b039 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.840936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34e1f18c-ad73-4596-8983-22b1e9c3b039 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.969391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-34e1f18c-ad73-4596-8983-22b1e9c3b039 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:47.977633 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-34e1f18c-ad73-4596-8983-22b1e9c3b039 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150675 Sep 01 05:32:47.978199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 870/1818] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:48.105395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1d75d71d-70f2-4edd-8244-c0bc1fe26da9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:48.106148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1d75d71d-70f2-4edd-8244-c0bc1fe26da9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:48.112571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d75d71d-70f2-4edd-8244-c0bc1fe26da9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.113081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d75d71d-70f2-4edd-8244-c0bc1fe26da9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.113551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d75d71d-70f2-4edd-8244-c0bc1fe26da9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.114235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d75d71d-70f2-4edd-8244-c0bc1fe26da9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.114678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d75d71d-70f2-4edd-8244-c0bc1fe26da9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.115097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d75d71d-70f2-4edd-8244-c0bc1fe26da9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.176473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1d75d71d-70f2-4edd-8244-c0bc1fe26da9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:48.185400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1d75d71d-70f2-4edd-8244-c0bc1fe26da9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:48.186833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1d75d71d-70f2-4edd-8244-c0bc1fe26da9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:48.187964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1d75d71d-70f2-4edd-8244-c0bc1fe26da9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086656 Sep 01 05:32:48.188526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 949/1819] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:49.000229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dce42cbb-b9da-4d5b-a454-667b5bb8c58d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:49.000864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dce42cbb-b9da-4d5b-a454-667b5bb8c58d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:49.007510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dce42cbb-b9da-4d5b-a454-667b5bb8c58d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.008018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dce42cbb-b9da-4d5b-a454-667b5bb8c58d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.008450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dce42cbb-b9da-4d5b-a454-667b5bb8c58d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.009159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dce42cbb-b9da-4d5b-a454-667b5bb8c58d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.009616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dce42cbb-b9da-4d5b-a454-667b5bb8c58d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.010037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dce42cbb-b9da-4d5b-a454-667b5bb8c58d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.143169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dce42cbb-b9da-4d5b-a454-667b5bb8c58d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:49.151308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dce42cbb-b9da-4d5b-a454-667b5bb8c58d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155592 Sep 01 05:32:49.152531 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 871/1820] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:48 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:49.211011 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f4c850ed-5868-464e-b551-0e19bf7f03b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:49.211630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f4c850ed-5868-464e-b551-0e19bf7f03b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:49.218708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4c850ed-5868-464e-b551-0e19bf7f03b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.219190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4c850ed-5868-464e-b551-0e19bf7f03b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.219626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4c850ed-5868-464e-b551-0e19bf7f03b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.220310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4c850ed-5868-464e-b551-0e19bf7f03b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.220797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4c850ed-5868-464e-b551-0e19bf7f03b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.221216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f4c850ed-5868-464e-b551-0e19bf7f03b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.281978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f4c850ed-5868-464e-b551-0e19bf7f03b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:49.290556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f4c850ed-5868-464e-b551-0e19bf7f03b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:49.292056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f4c850ed-5868-464e-b551-0e19bf7f03b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:49.293954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f4c850ed-5868-464e-b551-0e19bf7f03b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086919 Sep 01 05:32:49.294523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 950/1821] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:49 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:50.172994 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-40d407f4-21c5-438b-a7f1-5767df458c13 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:50.173614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-40d407f4-21c5-438b-a7f1-5767df458c13 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:50.176279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:32:50.176413 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:32:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 (ip 10.222.0.49) !!! Sep 01 05:32:50.186125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-40d407f4-21c5-438b-a7f1-5767df458c13 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:50.186617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-40d407f4-21c5-438b-a7f1-5767df458c13 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:50.187052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-40d407f4-21c5-438b-a7f1-5767df458c13 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:50.187740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-40d407f4-21c5-438b-a7f1-5767df458c13 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:50.188193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-40d407f4-21c5-438b-a7f1-5767df458c13 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:50.188615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-40d407f4-21c5-438b-a7f1-5767df458c13 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:50.317688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3328b87a-c953-4db2-a627-01ccabb6b499 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:50.319166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3328b87a-c953-4db2-a627-01ccabb6b499 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:50.321811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-40d407f4-21c5-438b-a7f1-5767df458c13 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:50.329540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3328b87a-c953-4db2-a627-01ccabb6b499 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:50.330386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3328b87a-c953-4db2-a627-01ccabb6b499 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:50.331185 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3328b87a-c953-4db2-a627-01ccabb6b499 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:50.332391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3328b87a-c953-4db2-a627-01ccabb6b499 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:50.333244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3328b87a-c953-4db2-a627-01ccabb6b499 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:50.334020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3328b87a-c953-4db2-a627-01ccabb6b499 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:50.335450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-40d407f4-21c5-438b-a7f1-5767df458c13 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.166126 Sep 01 05:32:50.336619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 872/1822] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:50 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:50.402813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3328b87a-c953-4db2-a627-01ccabb6b499 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:50.411404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3328b87a-c953-4db2-a627-01ccabb6b499 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:50.412863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3328b87a-c953-4db2-a627-01ccabb6b499 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:50.413989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3328b87a-c953-4db2-a627-01ccabb6b499 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.101167 Sep 01 05:32:50.414543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 951/1823] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:51.360450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0f713c2f-6d1d-4955-927e-7c470e11e6ce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:51.361106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0f713c2f-6d1d-4955-927e-7c470e11e6ce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:51.367565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f713c2f-6d1d-4955-927e-7c470e11e6ce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.368045 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f713c2f-6d1d-4955-927e-7c470e11e6ce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.368481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f713c2f-6d1d-4955-927e-7c470e11e6ce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.369190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f713c2f-6d1d-4955-927e-7c470e11e6ce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.369644 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f713c2f-6d1d-4955-927e-7c470e11e6ce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.370064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f713c2f-6d1d-4955-927e-7c470e11e6ce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.436618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4432eb54-711d-4705-873e-aa0cb6c9a427 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:51.437236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4432eb54-711d-4705-873e-aa0cb6c9a427 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:51.443798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4432eb54-711d-4705-873e-aa0cb6c9a427 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.444282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4432eb54-711d-4705-873e-aa0cb6c9a427 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.444720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4432eb54-711d-4705-873e-aa0cb6c9a427 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.445569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4432eb54-711d-4705-873e-aa0cb6c9a427 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.446026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4432eb54-711d-4705-873e-aa0cb6c9a427 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.446448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4432eb54-711d-4705-873e-aa0cb6c9a427 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.500964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0f713c2f-6d1d-4955-927e-7c470e11e6ce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:51.508110 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4432eb54-711d-4705-873e-aa0cb6c9a427 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:51.509579 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0f713c2f-6d1d-4955-927e-7c470e11e6ce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153020 Sep 01 05:32:51.510157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 873/1824] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:51.517010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4432eb54-711d-4705-873e-aa0cb6c9a427 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:51.518424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4432eb54-711d-4705-873e-aa0cb6c9a427 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:51.519548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4432eb54-711d-4705-873e-aa0cb6c9a427 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086998 Sep 01 05:32:51.520096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 952/1825] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:51 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:52.531464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dc7caaba-d1b7-44d6-89e8-63edb06fb0f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:52.532071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dc7caaba-d1b7-44d6-89e8-63edb06fb0f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:52.538646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc7caaba-d1b7-44d6-89e8-63edb06fb0f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:52.539135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc7caaba-d1b7-44d6-89e8-63edb06fb0f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:52.539568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc7caaba-d1b7-44d6-89e8-63edb06fb0f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:52.540256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc7caaba-d1b7-44d6-89e8-63edb06fb0f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:52.540706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc7caaba-d1b7-44d6-89e8-63edb06fb0f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:52.541152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dc7caaba-d1b7-44d6-89e8-63edb06fb0f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:52.543506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0ed4ca03-6914-4616-ad0c-eca8f63cf3f7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:52.544130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0ed4ca03-6914-4616-ad0c-eca8f63cf3f7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:52.550837 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ed4ca03-6914-4616-ad0c-eca8f63cf3f7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:52.551317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ed4ca03-6914-4616-ad0c-eca8f63cf3f7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:52.551755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ed4ca03-6914-4616-ad0c-eca8f63cf3f7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:52.552441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ed4ca03-6914-4616-ad0c-eca8f63cf3f7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:52.552917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ed4ca03-6914-4616-ad0c-eca8f63cf3f7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:52.553340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ed4ca03-6914-4616-ad0c-eca8f63cf3f7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:52.614081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0ed4ca03-6914-4616-ad0c-eca8f63cf3f7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:52.624031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0ed4ca03-6914-4616-ad0c-eca8f63cf3f7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:52.625538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0ed4ca03-6914-4616-ad0c-eca8f63cf3f7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:52.626693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0ed4ca03-6914-4616-ad0c-eca8f63cf3f7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087768 Sep 01 05:32:52.627450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 953/1826] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:52.679349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dc7caaba-d1b7-44d6-89e8-63edb06fb0f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:52.688270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dc7caaba-d1b7-44d6-89e8-63edb06fb0f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.160707 Sep 01 05:32:52.688857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 874/1827] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:53.648896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-37b2f032-3135-4ada-8327-5f67dde2d69a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:53.649507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-37b2f032-3135-4ada-8327-5f67dde2d69a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:53.656619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37b2f032-3135-4ada-8327-5f67dde2d69a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:53.657121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37b2f032-3135-4ada-8327-5f67dde2d69a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:53.657551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37b2f032-3135-4ada-8327-5f67dde2d69a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:53.658227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37b2f032-3135-4ada-8327-5f67dde2d69a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:53.658669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37b2f032-3135-4ada-8327-5f67dde2d69a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:53.659082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37b2f032-3135-4ada-8327-5f67dde2d69a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:53.709678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f0325e29-5faa-4ecc-b323-819553f46bcf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:53.710313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f0325e29-5faa-4ecc-b323-819553f46bcf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:53.716907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0325e29-5faa-4ecc-b323-819553f46bcf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:53.717486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0325e29-5faa-4ecc-b323-819553f46bcf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:53.717808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0325e29-5faa-4ecc-b323-819553f46bcf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:53.718494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0325e29-5faa-4ecc-b323-819553f46bcf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:53.718940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0325e29-5faa-4ecc-b323-819553f46bcf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:53.719359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f0325e29-5faa-4ecc-b323-819553f46bcf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:53.719737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-37b2f032-3135-4ada-8327-5f67dde2d69a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:53.728373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-37b2f032-3135-4ada-8327-5f67dde2d69a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:53.730043 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-37b2f032-3135-4ada-8327-5f67dde2d69a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:53.731178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-37b2f032-3135-4ada-8327-5f67dde2d69a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086396 Sep 01 05:32:53.731735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 954/1828] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:53.847917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f0325e29-5faa-4ecc-b323-819553f46bcf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:53.856525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f0325e29-5faa-4ecc-b323-819553f46bcf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150482 Sep 01 05:32:53.857265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 875/1829] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:54.754736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-51190b49-26a3-4352-87b0-16c843571b52 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:54.755375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-51190b49-26a3-4352-87b0-16c843571b52 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:54.761979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51190b49-26a3-4352-87b0-16c843571b52 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.762457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51190b49-26a3-4352-87b0-16c843571b52 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.762891 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51190b49-26a3-4352-87b0-16c843571b52 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.763582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51190b49-26a3-4352-87b0-16c843571b52 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.764030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51190b49-26a3-4352-87b0-16c843571b52 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.764448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51190b49-26a3-4352-87b0-16c843571b52 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.828217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-51190b49-26a3-4352-87b0-16c843571b52 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:54.836802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-51190b49-26a3-4352-87b0-16c843571b52 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:54.838230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-51190b49-26a3-4352-87b0-16c843571b52 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:54.840353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-51190b49-26a3-4352-87b0-16c843571b52 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089627 Sep 01 05:32:54.840938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 955/1830] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:54.878073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4e0dadb0-b264-4f85-9e37-874c99394e5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:54.878677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4e0dadb0-b264-4f85-9e37-874c99394e5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:54.885915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e0dadb0-b264-4f85-9e37-874c99394e5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.886400 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e0dadb0-b264-4f85-9e37-874c99394e5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.886831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e0dadb0-b264-4f85-9e37-874c99394e5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.887507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e0dadb0-b264-4f85-9e37-874c99394e5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.887950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e0dadb0-b264-4f85-9e37-874c99394e5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.888364 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e0dadb0-b264-4f85-9e37-874c99394e5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.019184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4e0dadb0-b264-4f85-9e37-874c99394e5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:55.027944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4e0dadb0-b264-4f85-9e37-874c99394e5b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153678 Sep 01 05:32:55.028510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 876/1831] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:55.862992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a9e991c1-8ee9-4d51-9f51-207912752d4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:55.863597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a9e991c1-8ee9-4d51-9f51-207912752d4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:55.870545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9e991c1-8ee9-4d51-9f51-207912752d4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.871016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9e991c1-8ee9-4d51-9f51-207912752d4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.871441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9e991c1-8ee9-4d51-9f51-207912752d4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.872113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9e991c1-8ee9-4d51-9f51-207912752d4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.872586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9e991c1-8ee9-4d51-9f51-207912752d4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.873017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a9e991c1-8ee9-4d51-9f51-207912752d4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.935731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a9e991c1-8ee9-4d51-9f51-207912752d4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:55.944346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a9e991c1-8ee9-4d51-9f51-207912752d4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:55.945820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a9e991c1-8ee9-4d51-9f51-207912752d4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:55.946957 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a9e991c1-8ee9-4d51-9f51-207912752d4f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087850 Sep 01 05:32:55.947512 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 956/1832] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:56.048730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-35b74dd6-1c99-48a0-92ee-4c6689715b95 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:56.049630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-35b74dd6-1c99-48a0-92ee-4c6689715b95 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:56.056274 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35b74dd6-1c99-48a0-92ee-4c6689715b95 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:56.056882 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35b74dd6-1c99-48a0-92ee-4c6689715b95 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:56.057360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35b74dd6-1c99-48a0-92ee-4c6689715b95 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:56.058091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35b74dd6-1c99-48a0-92ee-4c6689715b95 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:56.058545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35b74dd6-1c99-48a0-92ee-4c6689715b95 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:56.058970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-35b74dd6-1c99-48a0-92ee-4c6689715b95 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:56.185098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-35b74dd6-1c99-48a0-92ee-4c6689715b95 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:56.193227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-35b74dd6-1c99-48a0-92ee-4c6689715b95 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148386 Sep 01 05:32:56.193790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 877/1833] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:56.970440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6ca5cc5e-235d-42c1-a9a2-3b4ec0e8fdc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:56.970983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6ca5cc5e-235d-42c1-a9a2-3b4ec0e8fdc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:56.977527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ca5cc5e-235d-42c1-a9a2-3b4ec0e8fdc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:56.977999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ca5cc5e-235d-42c1-a9a2-3b4ec0e8fdc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:56.978426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ca5cc5e-235d-42c1-a9a2-3b4ec0e8fdc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:56.979953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ca5cc5e-235d-42c1-a9a2-3b4ec0e8fdc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:56.980551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ca5cc5e-235d-42c1-a9a2-3b4ec0e8fdc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:56.981010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ca5cc5e-235d-42c1-a9a2-3b4ec0e8fdc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.044827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ca5cc5e-235d-42c1-a9a2-3b4ec0e8fdc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:57.053537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ca5cc5e-235d-42c1-a9a2-3b4ec0e8fdc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:57.054974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ca5cc5e-235d-42c1-a9a2-3b4ec0e8fdc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:57.056099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6ca5cc5e-235d-42c1-a9a2-3b4ec0e8fdc0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089700 Sep 01 05:32:57.056649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 957/1834] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:57.215086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-401f7fff-6ae8-4c95-8b94-41f6ee42d0ea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:57.215701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-401f7fff-6ae8-4c95-8b94-41f6ee42d0ea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:57.222343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-401f7fff-6ae8-4c95-8b94-41f6ee42d0ea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.222750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-401f7fff-6ae8-4c95-8b94-41f6ee42d0ea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.223189 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-401f7fff-6ae8-4c95-8b94-41f6ee42d0ea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.223877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-401f7fff-6ae8-4c95-8b94-41f6ee42d0ea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.224331 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-401f7fff-6ae8-4c95-8b94-41f6ee42d0ea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.224795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-401f7fff-6ae8-4c95-8b94-41f6ee42d0ea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.350861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-401f7fff-6ae8-4c95-8b94-41f6ee42d0ea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:57.358897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-401f7fff-6ae8-4c95-8b94-41f6ee42d0ea tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148392 Sep 01 05:32:57.359459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 878/1835] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:57 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:58.078615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d65dea87-3b00-4546-a97d-4f074442d598 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:58.079218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d65dea87-3b00-4546-a97d-4f074442d598 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:58.085567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d65dea87-3b00-4546-a97d-4f074442d598 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:58.086035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d65dea87-3b00-4546-a97d-4f074442d598 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:58.086463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d65dea87-3b00-4546-a97d-4f074442d598 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.087140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d65dea87-3b00-4546-a97d-4f074442d598 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:58.087580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d65dea87-3b00-4546-a97d-4f074442d598 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:58.087992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d65dea87-3b00-4546-a97d-4f074442d598 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.147842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d65dea87-3b00-4546-a97d-4f074442d598 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:58.156876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d65dea87-3b00-4546-a97d-4f074442d598 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:58.158294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d65dea87-3b00-4546-a97d-4f074442d598 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:58.159404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d65dea87-3b00-4546-a97d-4f074442d598 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.084750 Sep 01 05:32:58.159987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 958/1836] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:58.380121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d313d290-d612-4473-9e10-702da19428dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:58.380758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d313d290-d612-4473-9e10-702da19428dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:58.387145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d313d290-d612-4473-9e10-702da19428dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:58.387611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d313d290-d612-4473-9e10-702da19428dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:58.388036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d313d290-d612-4473-9e10-702da19428dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.388713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d313d290-d612-4473-9e10-702da19428dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:58.389187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d313d290-d612-4473-9e10-702da19428dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:58.389606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d313d290-d612-4473-9e10-702da19428dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.522801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d313d290-d612-4473-9e10-702da19428dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:58.531642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d313d290-d612-4473-9e10-702da19428dc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155418 Sep 01 05:32:58.532193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 879/1837] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:58 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:59.183856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5d7a321e-e2b2-4466-8040-040817dc318e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:59.184393 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5d7a321e-e2b2-4466-8040-040817dc318e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:59.190684 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d7a321e-e2b2-4466-8040-040817dc318e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.191345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d7a321e-e2b2-4466-8040-040817dc318e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.191917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d7a321e-e2b2-4466-8040-040817dc318e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.192599 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d7a321e-e2b2-4466-8040-040817dc318e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.193070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d7a321e-e2b2-4466-8040-040817dc318e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.193485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d7a321e-e2b2-4466-8040-040817dc318e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.256670 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5d7a321e-e2b2-4466-8040-040817dc318e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:59.258936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:59.267234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5d7a321e-e2b2-4466-8040-040817dc318e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:59.268653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5d7a321e-e2b2-4466-8040-040817dc318e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:59.269813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5d7a321e-e2b2-4466-8040-040817dc318e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090602 Sep 01 05:32:59.270362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 959/1838] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:59 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:59.553463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-883eb60d-57fa-44da-965c-fbefcad96fb5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:59.554013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-883eb60d-57fa-44da-965c-fbefcad96fb5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:59.555997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:32:59.556140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 (ip 10.222.0.49) !!! Sep 01 05:32:59.563652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-883eb60d-57fa-44da-965c-fbefcad96fb5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.564134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-883eb60d-57fa-44da-965c-fbefcad96fb5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.564563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-883eb60d-57fa-44da-965c-fbefcad96fb5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.565267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-883eb60d-57fa-44da-965c-fbefcad96fb5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.565714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-883eb60d-57fa-44da-965c-fbefcad96fb5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.566129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-883eb60d-57fa-44da-965c-fbefcad96fb5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.698279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-883eb60d-57fa-44da-965c-fbefcad96fb5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:59.706416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-883eb60d-57fa-44da-965c-fbefcad96fb5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156922 Sep 01 05:32:59.706976 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 880/1839] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:59 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:00.291578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f2bf233a-cceb-4875-bfa1-d209b3cc7def tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:00.292300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f2bf233a-cceb-4875-bfa1-d209b3cc7def tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:00.298984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2bf233a-cceb-4875-bfa1-d209b3cc7def tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:00.299466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2bf233a-cceb-4875-bfa1-d209b3cc7def tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:00.299899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2bf233a-cceb-4875-bfa1-d209b3cc7def tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:00.301271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2bf233a-cceb-4875-bfa1-d209b3cc7def tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:00.302082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2bf233a-cceb-4875-bfa1-d209b3cc7def tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:00.302559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f2bf233a-cceb-4875-bfa1-d209b3cc7def tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:00.366827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f2bf233a-cceb-4875-bfa1-d209b3cc7def tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:00.375362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f2bf233a-cceb-4875-bfa1-d209b3cc7def tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:00.376813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f2bf233a-cceb-4875-bfa1-d209b3cc7def tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:00.377936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f2bf233a-cceb-4875-bfa1-d209b3cc7def tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090391 Sep 01 05:33:00.378490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 960/1840] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:00 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:00.727341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9c8de138-ea8e-444c-bfb7-58a6a08085dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:00.727953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9c8de138-ea8e-444c-bfb7-58a6a08085dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:00.735334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c8de138-ea8e-444c-bfb7-58a6a08085dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:00.735821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c8de138-ea8e-444c-bfb7-58a6a08085dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:00.738532 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c8de138-ea8e-444c-bfb7-58a6a08085dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:00.739768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c8de138-ea8e-444c-bfb7-58a6a08085dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:00.740233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c8de138-ea8e-444c-bfb7-58a6a08085dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:00.740666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9c8de138-ea8e-444c-bfb7-58a6a08085dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:00.743228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:00.872368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9c8de138-ea8e-444c-bfb7-58a6a08085dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:00.880444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9c8de138-ea8e-444c-bfb7-58a6a08085dd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157008 Sep 01 05:33:00.881030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 881/1841] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:01.400250 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bb9b619f-1ed2-4870-9939-9cd9c618720f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:01.401016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bb9b619f-1ed2-4870-9939-9cd9c618720f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:01.407188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bb9b619f-1ed2-4870-9939-9cd9c618720f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:01.407659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bb9b619f-1ed2-4870-9939-9cd9c618720f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:01.408086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bb9b619f-1ed2-4870-9939-9cd9c618720f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:01.408760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bb9b619f-1ed2-4870-9939-9cd9c618720f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:01.409226 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bb9b619f-1ed2-4870-9939-9cd9c618720f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:01.409641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bb9b619f-1ed2-4870-9939-9cd9c618720f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:01.469888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bb9b619f-1ed2-4870-9939-9cd9c618720f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:01.478161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bb9b619f-1ed2-4870-9939-9cd9c618720f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:01.479991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bb9b619f-1ed2-4870-9939-9cd9c618720f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:01.481154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bb9b619f-1ed2-4870-9939-9cd9c618720f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.084771 Sep 01 05:33:01.481714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 961/1842] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:01.903190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d46440c4-2d53-4f57-828c-e5e3123a39b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:01.903826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d46440c4-2d53-4f57-828c-e5e3123a39b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:01.910190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d46440c4-2d53-4f57-828c-e5e3123a39b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:01.910664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d46440c4-2d53-4f57-828c-e5e3123a39b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:01.911092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d46440c4-2d53-4f57-828c-e5e3123a39b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:01.911766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d46440c4-2d53-4f57-828c-e5e3123a39b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:01.912209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d46440c4-2d53-4f57-828c-e5e3123a39b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:01.912620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d46440c4-2d53-4f57-828c-e5e3123a39b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:02.039352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d46440c4-2d53-4f57-828c-e5e3123a39b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:02.048148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d46440c4-2d53-4f57-828c-e5e3123a39b2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149526 Sep 01 05:33:02.049004 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 882/1843] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:01 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:02.504026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-41f9f749-466f-404f-9148-fafc7f587c77 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:02.504666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-41f9f749-466f-404f-9148-fafc7f587c77 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:02.511776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41f9f749-466f-404f-9148-fafc7f587c77 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:02.512254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41f9f749-466f-404f-9148-fafc7f587c77 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:02.512687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41f9f749-466f-404f-9148-fafc7f587c77 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:02.513405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41f9f749-466f-404f-9148-fafc7f587c77 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:02.513857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41f9f749-466f-404f-9148-fafc7f587c77 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:02.514279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41f9f749-466f-404f-9148-fafc7f587c77 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:02.574815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-41f9f749-466f-404f-9148-fafc7f587c77 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:02.583348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-41f9f749-466f-404f-9148-fafc7f587c77 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:02.584870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-41f9f749-466f-404f-9148-fafc7f587c77 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:02.585962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-41f9f749-466f-404f-9148-fafc7f587c77 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085903 Sep 01 05:33:02.586521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 962/1844] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:03.069059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-13343ef8-006b-4d8d-a8e8-510d5234431f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:03.070274 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-13343ef8-006b-4d8d-a8e8-510d5234431f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:03.077290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13343ef8-006b-4d8d-a8e8-510d5234431f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.077779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13343ef8-006b-4d8d-a8e8-510d5234431f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.078227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13343ef8-006b-4d8d-a8e8-510d5234431f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.078925 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13343ef8-006b-4d8d-a8e8-510d5234431f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.079379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13343ef8-006b-4d8d-a8e8-510d5234431f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.079803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13343ef8-006b-4d8d-a8e8-510d5234431f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.211918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-13343ef8-006b-4d8d-a8e8-510d5234431f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:03.220891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-13343ef8-006b-4d8d-a8e8-510d5234431f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155585 Sep 01 05:33:03.221465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 883/1845] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:03 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:03.610098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4f4e24ff-60d6-46be-a93b-f5d16fc0dfb1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:03.610632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4f4e24ff-60d6-46be-a93b-f5d16fc0dfb1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:03.617007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f4e24ff-60d6-46be-a93b-f5d16fc0dfb1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.617484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f4e24ff-60d6-46be-a93b-f5d16fc0dfb1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.617917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f4e24ff-60d6-46be-a93b-f5d16fc0dfb1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.618600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f4e24ff-60d6-46be-a93b-f5d16fc0dfb1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.619625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f4e24ff-60d6-46be-a93b-f5d16fc0dfb1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.620002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f4e24ff-60d6-46be-a93b-f5d16fc0dfb1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.682609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4f4e24ff-60d6-46be-a93b-f5d16fc0dfb1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:03.691072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4f4e24ff-60d6-46be-a93b-f5d16fc0dfb1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:03.692504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4f4e24ff-60d6-46be-a93b-f5d16fc0dfb1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:03.693662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4f4e24ff-60d6-46be-a93b-f5d16fc0dfb1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087679 Sep 01 05:33:03.694217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 963/1846] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:04.242276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-eb398b7e-a056-4f6f-ac5f-7b52795c0495 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:04.242834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-eb398b7e-a056-4f6f-ac5f-7b52795c0495 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:04.250174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eb398b7e-a056-4f6f-ac5f-7b52795c0495 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:04.250665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eb398b7e-a056-4f6f-ac5f-7b52795c0495 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:04.251217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eb398b7e-a056-4f6f-ac5f-7b52795c0495 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:04.251914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eb398b7e-a056-4f6f-ac5f-7b52795c0495 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:04.252368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eb398b7e-a056-4f6f-ac5f-7b52795c0495 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:04.252815 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eb398b7e-a056-4f6f-ac5f-7b52795c0495 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:04.391471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-eb398b7e-a056-4f6f-ac5f-7b52795c0495 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:04.400673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-eb398b7e-a056-4f6f-ac5f-7b52795c0495 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.162178 Sep 01 05:33:04.401110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 884/1847] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:04.717872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a5b976bf-a248-49d0-b695-4f0f97b43420 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:04.718479 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a5b976bf-a248-49d0-b695-4f0f97b43420 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:04.724937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5b976bf-a248-49d0-b695-4f0f97b43420 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:04.725477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5b976bf-a248-49d0-b695-4f0f97b43420 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:04.725943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5b976bf-a248-49d0-b695-4f0f97b43420 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:04.726632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5b976bf-a248-49d0-b695-4f0f97b43420 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:04.727079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5b976bf-a248-49d0-b695-4f0f97b43420 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:04.727487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5b976bf-a248-49d0-b695-4f0f97b43420 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:04.814587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a5b976bf-a248-49d0-b695-4f0f97b43420 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:04.823913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a5b976bf-a248-49d0-b695-4f0f97b43420 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:04.825391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a5b976bf-a248-49d0-b695-4f0f97b43420 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:04.826532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a5b976bf-a248-49d0-b695-4f0f97b43420 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.113657 Sep 01 05:33:04.827095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 964/1848] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:05.422081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3983e966-842d-4229-b8fb-e6c9ccaf59c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:05.422690 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3983e966-842d-4229-b8fb-e6c9ccaf59c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:05.429435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3983e966-842d-4229-b8fb-e6c9ccaf59c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:05.429913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3983e966-842d-4229-b8fb-e6c9ccaf59c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:05.430341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3983e966-842d-4229-b8fb-e6c9ccaf59c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:05.431020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3983e966-842d-4229-b8fb-e6c9ccaf59c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:05.432012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3983e966-842d-4229-b8fb-e6c9ccaf59c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:05.432474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3983e966-842d-4229-b8fb-e6c9ccaf59c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:05.562068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3983e966-842d-4229-b8fb-e6c9ccaf59c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:05.570231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3983e966-842d-4229-b8fb-e6c9ccaf59c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152057 Sep 01 05:33:05.570792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 885/1849] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:05 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:05.849861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0ee717d0-277b-4f24-99f7-4a1e2e5d27dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:05.850406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0ee717d0-277b-4f24-99f7-4a1e2e5d27dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:05.857524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ee717d0-277b-4f24-99f7-4a1e2e5d27dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:05.858003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ee717d0-277b-4f24-99f7-4a1e2e5d27dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:05.858432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ee717d0-277b-4f24-99f7-4a1e2e5d27dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:05.859116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ee717d0-277b-4f24-99f7-4a1e2e5d27dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:05.859561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ee717d0-277b-4f24-99f7-4a1e2e5d27dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:05.859981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ee717d0-277b-4f24-99f7-4a1e2e5d27dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:05.921635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0ee717d0-277b-4f24-99f7-4a1e2e5d27dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:05.930573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0ee717d0-277b-4f24-99f7-4a1e2e5d27dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:05.932259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0ee717d0-277b-4f24-99f7-4a1e2e5d27dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:05.933429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0ee717d0-277b-4f24-99f7-4a1e2e5d27dd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087633 Sep 01 05:33:05.933983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 965/1850] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:06.591714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-30688a46-4c08-446b-9ef8-782d8a4c0d29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:06.592327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-30688a46-4c08-446b-9ef8-782d8a4c0d29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:06.598986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30688a46-4c08-446b-9ef8-782d8a4c0d29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:06.599468 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30688a46-4c08-446b-9ef8-782d8a4c0d29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:06.599928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30688a46-4c08-446b-9ef8-782d8a4c0d29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:06.600643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30688a46-4c08-446b-9ef8-782d8a4c0d29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:06.601154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30688a46-4c08-446b-9ef8-782d8a4c0d29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:06.601575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30688a46-4c08-446b-9ef8-782d8a4c0d29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:06.737285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-30688a46-4c08-446b-9ef8-782d8a4c0d29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:06.746053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-30688a46-4c08-446b-9ef8-782d8a4c0d29 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.158447 Sep 01 05:33:06.746618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 886/1851] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:06 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:06.957685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bee36467-3d73-4ef4-a4cf-2041897bdda2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:06.958300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bee36467-3d73-4ef4-a4cf-2041897bdda2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:06.965448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bee36467-3d73-4ef4-a4cf-2041897bdda2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:06.965927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bee36467-3d73-4ef4-a4cf-2041897bdda2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:06.966361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bee36467-3d73-4ef4-a4cf-2041897bdda2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:06.967046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bee36467-3d73-4ef4-a4cf-2041897bdda2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:06.967500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bee36467-3d73-4ef4-a4cf-2041897bdda2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:06.967920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bee36467-3d73-4ef4-a4cf-2041897bdda2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:07.029099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bee36467-3d73-4ef4-a4cf-2041897bdda2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:07.037590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bee36467-3d73-4ef4-a4cf-2041897bdda2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:07.039037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bee36467-3d73-4ef4-a4cf-2041897bdda2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:07.040176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bee36467-3d73-4ef4-a4cf-2041897bdda2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086446 Sep 01 05:33:07.041164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 966/1852] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:07.767226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3ee2ed36-d44c-4a9b-9b07-5a9495cd2381 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:07.767830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3ee2ed36-d44c-4a9b-9b07-5a9495cd2381 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:07.774356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3ee2ed36-d44c-4a9b-9b07-5a9495cd2381 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:07.775458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3ee2ed36-d44c-4a9b-9b07-5a9495cd2381 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:07.776053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3ee2ed36-d44c-4a9b-9b07-5a9495cd2381 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:07.776736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3ee2ed36-d44c-4a9b-9b07-5a9495cd2381 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:07.777207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3ee2ed36-d44c-4a9b-9b07-5a9495cd2381 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:07.777627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3ee2ed36-d44c-4a9b-9b07-5a9495cd2381 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:07.905244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3ee2ed36-d44c-4a9b-9b07-5a9495cd2381 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:07.913420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3ee2ed36-d44c-4a9b-9b07-5a9495cd2381 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150051 Sep 01 05:33:07.913989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 887/1853] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:07 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:08.063231 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a338e891-b242-49d5-af77-a7a09fdd1f3d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:08.063786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a338e891-b242-49d5-af77-a7a09fdd1f3d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:08.069817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a338e891-b242-49d5-af77-a7a09fdd1f3d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:08.070288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a338e891-b242-49d5-af77-a7a09fdd1f3d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:08.070715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a338e891-b242-49d5-af77-a7a09fdd1f3d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:08.071389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a338e891-b242-49d5-af77-a7a09fdd1f3d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:08.072544 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a338e891-b242-49d5-af77-a7a09fdd1f3d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:08.072987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a338e891-b242-49d5-af77-a7a09fdd1f3d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:08.135258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a338e891-b242-49d5-af77-a7a09fdd1f3d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:08.143759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a338e891-b242-49d5-af77-a7a09fdd1f3d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:08.145217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a338e891-b242-49d5-af77-a7a09fdd1f3d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:08.146333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a338e891-b242-49d5-af77-a7a09fdd1f3d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087079 Sep 01 05:33:08.146891 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 967/1854] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:08.934707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-09cae9f0-37d0-4432-9392-b9f20c91d583 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:08.935325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-09cae9f0-37d0-4432-9392-b9f20c91d583 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:08.941952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09cae9f0-37d0-4432-9392-b9f20c91d583 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:08.942428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09cae9f0-37d0-4432-9392-b9f20c91d583 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:08.942854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09cae9f0-37d0-4432-9392-b9f20c91d583 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:08.943533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09cae9f0-37d0-4432-9392-b9f20c91d583 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:08.944003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09cae9f0-37d0-4432-9392-b9f20c91d583 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:08.944420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09cae9f0-37d0-4432-9392-b9f20c91d583 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:09.074782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-09cae9f0-37d0-4432-9392-b9f20c91d583 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:09.083140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-09cae9f0-37d0-4432-9392-b9f20c91d583 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152263 Sep 01 05:33:09.083715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 888/1855] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:08 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:09.168662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f9bda9b8-c9c9-4a22-a4d7-f4bc38bee1c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:09.169254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f9bda9b8-c9c9-4a22-a4d7-f4bc38bee1c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:09.175740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f9bda9b8-c9c9-4a22-a4d7-f4bc38bee1c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:09.176210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f9bda9b8-c9c9-4a22-a4d7-f4bc38bee1c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:09.176637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f9bda9b8-c9c9-4a22-a4d7-f4bc38bee1c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:09.177337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f9bda9b8-c9c9-4a22-a4d7-f4bc38bee1c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:09.177780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f9bda9b8-c9c9-4a22-a4d7-f4bc38bee1c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:09.178195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f9bda9b8-c9c9-4a22-a4d7-f4bc38bee1c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:09.239136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f9bda9b8-c9c9-4a22-a4d7-f4bc38bee1c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:09.247748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f9bda9b8-c9c9-4a22-a4d7-f4bc38bee1c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:09.249230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f9bda9b8-c9c9-4a22-a4d7-f4bc38bee1c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:09.250354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f9bda9b8-c9c9-4a22-a4d7-f4bc38bee1c2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085955 Sep 01 05:33:09.250899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 968/1856] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:09 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:10.105195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cb9c26d0-50b6-48df-bc73-84f2d2e03b9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:10.105802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cb9c26d0-50b6-48df-bc73-84f2d2e03b9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:10.112191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb9c26d0-50b6-48df-bc73-84f2d2e03b9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:10.112661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb9c26d0-50b6-48df-bc73-84f2d2e03b9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:10.113120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb9c26d0-50b6-48df-bc73-84f2d2e03b9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:10.113793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb9c26d0-50b6-48df-bc73-84f2d2e03b9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:10.114236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb9c26d0-50b6-48df-bc73-84f2d2e03b9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:10.114653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb9c26d0-50b6-48df-bc73-84f2d2e03b9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:10.242167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cb9c26d0-50b6-48df-bc73-84f2d2e03b9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:10.250780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cb9c26d0-50b6-48df-bc73-84f2d2e03b9e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149642 Sep 01 05:33:10.251347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 889/1857] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:10.273817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0eae9fd7-df8c-48fe-9818-4a398635ead5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:10.274441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0eae9fd7-df8c-48fe-9818-4a398635ead5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:10.280825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0eae9fd7-df8c-48fe-9818-4a398635ead5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:10.281309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0eae9fd7-df8c-48fe-9818-4a398635ead5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:10.281748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0eae9fd7-df8c-48fe-9818-4a398635ead5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:10.282436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0eae9fd7-df8c-48fe-9818-4a398635ead5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:10.282892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0eae9fd7-df8c-48fe-9818-4a398635ead5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:10.283318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0eae9fd7-df8c-48fe-9818-4a398635ead5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:10.345558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0eae9fd7-df8c-48fe-9818-4a398635ead5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:10.354117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0eae9fd7-df8c-48fe-9818-4a398635ead5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:10.355563 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0eae9fd7-df8c-48fe-9818-4a398635ead5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:10.356802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0eae9fd7-df8c-48fe-9818-4a398635ead5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086978 Sep 01 05:33:10.357434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 969/1858] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:10 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:11.272656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-61f086b9-eb91-4d3d-a1e2-027d98731b98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:11.273262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-61f086b9-eb91-4d3d-a1e2-027d98731b98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:11.280287 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-61f086b9-eb91-4d3d-a1e2-027d98731b98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:11.280783 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-61f086b9-eb91-4d3d-a1e2-027d98731b98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:11.281226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-61f086b9-eb91-4d3d-a1e2-027d98731b98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:11.281907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-61f086b9-eb91-4d3d-a1e2-027d98731b98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:11.282357 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-61f086b9-eb91-4d3d-a1e2-027d98731b98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:11.282770 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-61f086b9-eb91-4d3d-a1e2-027d98731b98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:11.379734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f0989460-6afc-4a47-842e-0d8b83f93a12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:11.380351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f0989460-6afc-4a47-842e-0d8b83f93a12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:11.387635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0989460-6afc-4a47-842e-0d8b83f93a12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:11.388219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0989460-6afc-4a47-842e-0d8b83f93a12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:11.388648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0989460-6afc-4a47-842e-0d8b83f93a12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:11.389376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0989460-6afc-4a47-842e-0d8b83f93a12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:11.389817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0989460-6afc-4a47-842e-0d8b83f93a12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:11.390229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f0989460-6afc-4a47-842e-0d8b83f93a12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:11.411385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-61f086b9-eb91-4d3d-a1e2-027d98731b98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:11.419826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-61f086b9-eb91-4d3d-a1e2-027d98731b98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151112 Sep 01 05:33:11.420397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 890/1859] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:11 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:11.451675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f0989460-6afc-4a47-842e-0d8b83f93a12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:11.460174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f0989460-6afc-4a47-842e-0d8b83f93a12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:11.461625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f0989460-6afc-4a47-842e-0d8b83f93a12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:11.462834 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f0989460-6afc-4a47-842e-0d8b83f93a12 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087081 Sep 01 05:33:11.463379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 970/1860] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:33:12.441292 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4d2bd205-aa43-4378-bbdf-31db5ac1b46a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:12.441903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4d2bd205-aa43-4378-bbdf-31db5ac1b46a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:12.448617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d2bd205-aa43-4378-bbdf-31db5ac1b46a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:12.449126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d2bd205-aa43-4378-bbdf-31db5ac1b46a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:12.449560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d2bd205-aa43-4378-bbdf-31db5ac1b46a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:12.450240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d2bd205-aa43-4378-bbdf-31db5ac1b46a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:12.450690 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d2bd205-aa43-4378-bbdf-31db5ac1b46a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:12.451117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d2bd205-aa43-4378-bbdf-31db5ac1b46a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:12.484946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a403a02f-f63e-42ce-81ce-63dd5bc059e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:12.485578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a403a02f-f63e-42ce-81ce-63dd5bc059e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:12.491962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a403a02f-f63e-42ce-81ce-63dd5bc059e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:12.492435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a403a02f-f63e-42ce-81ce-63dd5bc059e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:12.492910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a403a02f-f63e-42ce-81ce-63dd5bc059e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:12.493843 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a403a02f-f63e-42ce-81ce-63dd5bc059e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:12.494307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a403a02f-f63e-42ce-81ce-63dd5bc059e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:12.494729 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a403a02f-f63e-42ce-81ce-63dd5bc059e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:12.562477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a403a02f-f63e-42ce-81ce-63dd5bc059e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:12.570960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a403a02f-f63e-42ce-81ce-63dd5bc059e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:12.572573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a403a02f-f63e-42ce-81ce-63dd5bc059e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:12.573746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a403a02f-f63e-42ce-81ce-63dd5bc059e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.092673 Sep 01 05:33:12.574302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 971/1861] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:12 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:33:12.583821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4d2bd205-aa43-4378-bbdf-31db5ac1b46a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:12.592810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4d2bd205-aa43-4378-bbdf-31db5ac1b46a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155420 Sep 01 05:33:12.593381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 891/1862] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:12 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:13.596580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4f17a25e-dde4-4e60-90f8-c6717f4d83f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:13.597174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4f17a25e-dde4-4e60-90f8-c6717f4d83f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:13.603604 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f17a25e-dde4-4e60-90f8-c6717f4d83f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:13.604078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f17a25e-dde4-4e60-90f8-c6717f4d83f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:13.604510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f17a25e-dde4-4e60-90f8-c6717f4d83f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:13.605226 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f17a25e-dde4-4e60-90f8-c6717f4d83f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:13.605677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f17a25e-dde4-4e60-90f8-c6717f4d83f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:13.606100 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f17a25e-dde4-4e60-90f8-c6717f4d83f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:13.614811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-71b80514-5a55-4f7e-9701-b5b5bcfbfb08 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:13.615430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-71b80514-5a55-4f7e-9701-b5b5bcfbfb08 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:13.621670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71b80514-5a55-4f7e-9701-b5b5bcfbfb08 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:13.622159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71b80514-5a55-4f7e-9701-b5b5bcfbfb08 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:13.622594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71b80514-5a55-4f7e-9701-b5b5bcfbfb08 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:13.623282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71b80514-5a55-4f7e-9701-b5b5bcfbfb08 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:13.623732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71b80514-5a55-4f7e-9701-b5b5bcfbfb08 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:13.624155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71b80514-5a55-4f7e-9701-b5b5bcfbfb08 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:13.668790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4f17a25e-dde4-4e60-90f8-c6717f4d83f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:13.677857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4f17a25e-dde4-4e60-90f8-c6717f4d83f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:13.679315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4f17a25e-dde4-4e60-90f8-c6717f4d83f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:13.680447 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4f17a25e-dde4-4e60-90f8-c6717f4d83f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087833 Sep 01 05:33:13.681025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 972/1863] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:13 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:13.756917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-71b80514-5a55-4f7e-9701-b5b5bcfbfb08 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:13.765862 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-71b80514-5a55-4f7e-9701-b5b5bcfbfb08 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154931 Sep 01 05:33:13.766434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 892/1864] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:14.703941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8580eae6-15bc-4a41-8515-445a4f68217e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:14.704534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8580eae6-15bc-4a41-8515-445a4f68217e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:14.710879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8580eae6-15bc-4a41-8515-445a4f68217e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:14.711358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8580eae6-15bc-4a41-8515-445a4f68217e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:14.711782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8580eae6-15bc-4a41-8515-445a4f68217e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:14.713079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8580eae6-15bc-4a41-8515-445a4f68217e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:14.713540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8580eae6-15bc-4a41-8515-445a4f68217e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:14.713952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8580eae6-15bc-4a41-8515-445a4f68217e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:14.773728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8580eae6-15bc-4a41-8515-445a4f68217e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:14.782567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8580eae6-15bc-4a41-8515-445a4f68217e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:14.783990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8580eae6-15bc-4a41-8515-445a4f68217e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:14.785139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8580eae6-15bc-4a41-8515-445a4f68217e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085200 Sep 01 05:33:14.785690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 973/1865] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:14.787640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-99619a82-5f8c-474d-946f-e4972a46f879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:14.788258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-99619a82-5f8c-474d-946f-e4972a46f879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:14.795804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-99619a82-5f8c-474d-946f-e4972a46f879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:14.796281 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-99619a82-5f8c-474d-946f-e4972a46f879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:14.796716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-99619a82-5f8c-474d-946f-e4972a46f879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:14.797689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-99619a82-5f8c-474d-946f-e4972a46f879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:14.798140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-99619a82-5f8c-474d-946f-e4972a46f879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:14.798562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-99619a82-5f8c-474d-946f-e4972a46f879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:14.933533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-99619a82-5f8c-474d-946f-e4972a46f879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:14.941955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-99619a82-5f8c-474d-946f-e4972a46f879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.158203 Sep 01 05:33:14.942522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 893/1866] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:14 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:15.808597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d59477fc-5858-433f-9f63-47b01c273493 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:15.809225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d59477fc-5858-433f-9f63-47b01c273493 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:15.815522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d59477fc-5858-433f-9f63-47b01c273493 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:15.815991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d59477fc-5858-433f-9f63-47b01c273493 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:15.816417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d59477fc-5858-433f-9f63-47b01c273493 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:15.817126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d59477fc-5858-433f-9f63-47b01c273493 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:15.817569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d59477fc-5858-433f-9f63-47b01c273493 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:15.817984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d59477fc-5858-433f-9f63-47b01c273493 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:15.878655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d59477fc-5858-433f-9f63-47b01c273493 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:15.887638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d59477fc-5858-433f-9f63-47b01c273493 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:15.889449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d59477fc-5858-433f-9f63-47b01c273493 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:15.891107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d59477fc-5858-433f-9f63-47b01c273493 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085631 Sep 01 05:33:15.891107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 974/1867] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:15.964488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6e36f5da-51db-4403-a245-952d6ddab467 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:15.965121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6e36f5da-51db-4403-a245-952d6ddab467 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:15.971545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e36f5da-51db-4403-a245-952d6ddab467 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:15.972031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e36f5da-51db-4403-a245-952d6ddab467 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:15.972464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e36f5da-51db-4403-a245-952d6ddab467 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:15.973183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e36f5da-51db-4403-a245-952d6ddab467 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:15.973630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e36f5da-51db-4403-a245-952d6ddab467 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:15.974051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e36f5da-51db-4403-a245-952d6ddab467 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:16.101801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6e36f5da-51db-4403-a245-952d6ddab467 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:16.110853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6e36f5da-51db-4403-a245-952d6ddab467 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151135 Sep 01 05:33:16.111414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 894/1868] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:16.913098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e9fb25ee-c038-42b7-9fec-d24b53ff8b82 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:16.913706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e9fb25ee-c038-42b7-9fec-d24b53ff8b82 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:16.920176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9fb25ee-c038-42b7-9fec-d24b53ff8b82 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:16.920649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9fb25ee-c038-42b7-9fec-d24b53ff8b82 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:16.921114 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9fb25ee-c038-42b7-9fec-d24b53ff8b82 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:16.921791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9fb25ee-c038-42b7-9fec-d24b53ff8b82 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:16.922501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9fb25ee-c038-42b7-9fec-d24b53ff8b82 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:16.922911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9fb25ee-c038-42b7-9fec-d24b53ff8b82 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:16.986010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e9fb25ee-c038-42b7-9fec-d24b53ff8b82 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:16.995062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e9fb25ee-c038-42b7-9fec-d24b53ff8b82 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:16.996484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e9fb25ee-c038-42b7-9fec-d24b53ff8b82 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:16.997638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e9fb25ee-c038-42b7-9fec-d24b53ff8b82 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088406 Sep 01 05:33:16.998229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 975/1869] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:16 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:17.133160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ec282a9c-1751-4487-b5d4-2b8e01411082 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:17.133773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ec282a9c-1751-4487-b5d4-2b8e01411082 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:17.137227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=52 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:17.142914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec282a9c-1751-4487-b5d4-2b8e01411082 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:17.143395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec282a9c-1751-4487-b5d4-2b8e01411082 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:17.143831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec282a9c-1751-4487-b5d4-2b8e01411082 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:17.144520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec282a9c-1751-4487-b5d4-2b8e01411082 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:17.145033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec282a9c-1751-4487-b5d4-2b8e01411082 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:17.145453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec282a9c-1751-4487-b5d4-2b8e01411082 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:17.275407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ec282a9c-1751-4487-b5d4-2b8e01411082 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:17.283682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ec282a9c-1751-4487-b5d4-2b8e01411082 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154499 Sep 01 05:33:17.284263 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 895/1870] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:17 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:18.021196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a8597408-e06d-44b0-866d-081b9954eaa8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:18.021829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a8597408-e06d-44b0-866d-081b9954eaa8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:18.024068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=56 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:18.029332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a8597408-e06d-44b0-866d-081b9954eaa8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:18.029824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a8597408-e06d-44b0-866d-081b9954eaa8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:18.030254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a8597408-e06d-44b0-866d-081b9954eaa8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:18.030936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a8597408-e06d-44b0-866d-081b9954eaa8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:18.031376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a8597408-e06d-44b0-866d-081b9954eaa8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:18.031790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a8597408-e06d-44b0-866d-081b9954eaa8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:18.047721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:18.095816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a8597408-e06d-44b0-866d-081b9954eaa8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:18.105016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a8597408-e06d-44b0-866d-081b9954eaa8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:18.106442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a8597408-e06d-44b0-866d-081b9954eaa8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:18.107567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a8597408-e06d-44b0-866d-081b9954eaa8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090245 Sep 01 05:33:18.108116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 976/1871] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:18 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:18.306560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-375aaab6-0407-46d8-8fce-e32bfec427a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:18.307102 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-375aaab6-0407-46d8-8fce-e32bfec427a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:18.313549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-375aaab6-0407-46d8-8fce-e32bfec427a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:18.314023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-375aaab6-0407-46d8-8fce-e32bfec427a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:18.314448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-375aaab6-0407-46d8-8fce-e32bfec427a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:18.315124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-375aaab6-0407-46d8-8fce-e32bfec427a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:18.315567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-375aaab6-0407-46d8-8fce-e32bfec427a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:18.315982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-375aaab6-0407-46d8-8fce-e32bfec427a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:18.442740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-375aaab6-0407-46d8-8fce-e32bfec427a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:18.451264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-375aaab6-0407-46d8-8fce-e32bfec427a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149371 Sep 01 05:33:18.451834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 896/1872] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:18 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:19.130523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-aadcd76e-2818-45f5-9ade-38971896f93f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:19.131280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-aadcd76e-2818-45f5-9ade-38971896f93f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:19.138794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aadcd76e-2818-45f5-9ade-38971896f93f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:19.139461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aadcd76e-2818-45f5-9ade-38971896f93f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:19.139954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aadcd76e-2818-45f5-9ade-38971896f93f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:19.140804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aadcd76e-2818-45f5-9ade-38971896f93f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:19.141257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aadcd76e-2818-45f5-9ade-38971896f93f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:19.141673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aadcd76e-2818-45f5-9ade-38971896f93f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:19.205150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-aadcd76e-2818-45f5-9ade-38971896f93f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:19.214197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-aadcd76e-2818-45f5-9ade-38971896f93f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:19.215615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-aadcd76e-2818-45f5-9ade-38971896f93f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:19.216964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-aadcd76e-2818-45f5-9ade-38971896f93f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090427 Sep 01 05:33:19.217520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 977/1873] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:19 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:19.473620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e41da5fa-86de-4a8b-a8b9-04370b2b9dce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:19.474155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e41da5fa-86de-4a8b-a8b9-04370b2b9dce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:19.481175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e41da5fa-86de-4a8b-a8b9-04370b2b9dce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:19.481651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e41da5fa-86de-4a8b-a8b9-04370b2b9dce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:19.482083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e41da5fa-86de-4a8b-a8b9-04370b2b9dce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:19.482764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e41da5fa-86de-4a8b-a8b9-04370b2b9dce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:19.483211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e41da5fa-86de-4a8b-a8b9-04370b2b9dce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:19.483629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e41da5fa-86de-4a8b-a8b9-04370b2b9dce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:19.611078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e41da5fa-86de-4a8b-a8b9-04370b2b9dce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:19.613281 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:19.621475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e41da5fa-86de-4a8b-a8b9-04370b2b9dce tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151811 Sep 01 05:33:19.622056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 897/1874] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:19 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:20.239529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e7022d23-631d-4315-9d3b-84021deaad8c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:20.240080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e7022d23-631d-4315-9d3b-84021deaad8c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:20.247067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7022d23-631d-4315-9d3b-84021deaad8c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:20.247541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7022d23-631d-4315-9d3b-84021deaad8c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:20.247970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7022d23-631d-4315-9d3b-84021deaad8c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:20.248650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7022d23-631d-4315-9d3b-84021deaad8c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:20.249117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7022d23-631d-4315-9d3b-84021deaad8c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:20.249534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e7022d23-631d-4315-9d3b-84021deaad8c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:20.279943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:33:20.280152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:33:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf (ip 10.222.0.49) !!! Sep 01 05:33:20.312985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e7022d23-631d-4315-9d3b-84021deaad8c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:20.321626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e7022d23-631d-4315-9d3b-84021deaad8c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:20.323072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e7022d23-631d-4315-9d3b-84021deaad8c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:20.324213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e7022d23-631d-4315-9d3b-84021deaad8c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088672 Sep 01 05:33:20.324792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 978/1875] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:20.643852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-85b5040d-2205-4afd-868b-ad7cf4e43834 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:20.644466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-85b5040d-2205-4afd-868b-ad7cf4e43834 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:20.651509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-85b5040d-2205-4afd-868b-ad7cf4e43834 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:20.651991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-85b5040d-2205-4afd-868b-ad7cf4e43834 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:20.652425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-85b5040d-2205-4afd-868b-ad7cf4e43834 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:20.653135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-85b5040d-2205-4afd-868b-ad7cf4e43834 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:20.653590 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-85b5040d-2205-4afd-868b-ad7cf4e43834 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:20.654014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-85b5040d-2205-4afd-868b-ad7cf4e43834 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:20.784043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-85b5040d-2205-4afd-868b-ad7cf4e43834 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:20.792740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-85b5040d-2205-4afd-868b-ad7cf4e43834 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152740 Sep 01 05:33:20.793277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 898/1876] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:20 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:21.345721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-168a3558-6551-4e87-8cf0-c54fa3ca397d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:21.346387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-168a3558-6551-4e87-8cf0-c54fa3ca397d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:21.353037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-168a3558-6551-4e87-8cf0-c54fa3ca397d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.353511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-168a3558-6551-4e87-8cf0-c54fa3ca397d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.353938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-168a3558-6551-4e87-8cf0-c54fa3ca397d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.354612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-168a3558-6551-4e87-8cf0-c54fa3ca397d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.355054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-168a3558-6551-4e87-8cf0-c54fa3ca397d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.355469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-168a3558-6551-4e87-8cf0-c54fa3ca397d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.418154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-168a3558-6551-4e87-8cf0-c54fa3ca397d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:21.426983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-168a3558-6551-4e87-8cf0-c54fa3ca397d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:21.428440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-168a3558-6551-4e87-8cf0-c54fa3ca397d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:21.429603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-168a3558-6551-4e87-8cf0-c54fa3ca397d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087779 Sep 01 05:33:21.430168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 979/1877] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:21 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:21.814142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-809faed1-ce6e-4bc8-84b0-24b38add0881 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:21.814743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-809faed1-ce6e-4bc8-84b0-24b38add0881 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:21.821719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-809faed1-ce6e-4bc8-84b0-24b38add0881 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.822192 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-809faed1-ce6e-4bc8-84b0-24b38add0881 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.822613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-809faed1-ce6e-4bc8-84b0-24b38add0881 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.823285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-809faed1-ce6e-4bc8-84b0-24b38add0881 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.823726 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-809faed1-ce6e-4bc8-84b0-24b38add0881 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.824141 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-809faed1-ce6e-4bc8-84b0-24b38add0881 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.950310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-809faed1-ce6e-4bc8-84b0-24b38add0881 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:21.958411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-809faed1-ce6e-4bc8-84b0-24b38add0881 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148137 Sep 01 05:33:21.958976 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 899/1878] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:21 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:22.451422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fe7b1309-f247-4703-abf0-06cf8c3acff2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:22.452037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fe7b1309-f247-4703-abf0-06cf8c3acff2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:22.458517 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe7b1309-f247-4703-abf0-06cf8c3acff2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.458998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe7b1309-f247-4703-abf0-06cf8c3acff2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.459434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe7b1309-f247-4703-abf0-06cf8c3acff2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:22.460122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe7b1309-f247-4703-abf0-06cf8c3acff2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.460575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe7b1309-f247-4703-abf0-06cf8c3acff2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.461031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fe7b1309-f247-4703-abf0-06cf8c3acff2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:22.521977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fe7b1309-f247-4703-abf0-06cf8c3acff2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:22.531079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fe7b1309-f247-4703-abf0-06cf8c3acff2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:22.532492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fe7b1309-f247-4703-abf0-06cf8c3acff2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:22.533649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fe7b1309-f247-4703-abf0-06cf8c3acff2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086253 Sep 01 05:33:22.534198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 980/1879] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:22.980569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c2c3d6c2-9035-45c8-80d6-7912bf8b5e46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:22.981200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c2c3d6c2-9035-45c8-80d6-7912bf8b5e46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:22.987586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2c3d6c2-9035-45c8-80d6-7912bf8b5e46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.988057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2c3d6c2-9035-45c8-80d6-7912bf8b5e46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.988483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2c3d6c2-9035-45c8-80d6-7912bf8b5e46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:22.989185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2c3d6c2-9035-45c8-80d6-7912bf8b5e46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.989630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2c3d6c2-9035-45c8-80d6-7912bf8b5e46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.990045 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2c3d6c2-9035-45c8-80d6-7912bf8b5e46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.120247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c2c3d6c2-9035-45c8-80d6-7912bf8b5e46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:23.128710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c2c3d6c2-9035-45c8-80d6-7912bf8b5e46 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152728 Sep 01 05:33:23.129319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 900/1880] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:22 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:23.556645 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-434c9ecd-1cc7-4069-a4f8-5666ca11ecd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:23.557333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-434c9ecd-1cc7-4069-a4f8-5666ca11ecd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:23.563749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-434c9ecd-1cc7-4069-a4f8-5666ca11ecd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.564220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-434c9ecd-1cc7-4069-a4f8-5666ca11ecd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.564653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-434c9ecd-1cc7-4069-a4f8-5666ca11ecd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.565360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-434c9ecd-1cc7-4069-a4f8-5666ca11ecd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.565801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-434c9ecd-1cc7-4069-a4f8-5666ca11ecd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.566215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-434c9ecd-1cc7-4069-a4f8-5666ca11ecd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.626351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-434c9ecd-1cc7-4069-a4f8-5666ca11ecd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:23.634829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-434c9ecd-1cc7-4069-a4f8-5666ca11ecd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:23.636251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-434c9ecd-1cc7-4069-a4f8-5666ca11ecd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:23.637412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-434c9ecd-1cc7-4069-a4f8-5666ca11ecd6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085560 Sep 01 05:33:23.637964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 981/1881] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:24.151150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-809c8f7d-f9ba-4bc4-8961-01301a50806e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:24.151764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-809c8f7d-f9ba-4bc4-8961-01301a50806e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:24.158272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-809c8f7d-f9ba-4bc4-8961-01301a50806e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:24.158750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-809c8f7d-f9ba-4bc4-8961-01301a50806e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:24.159185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-809c8f7d-f9ba-4bc4-8961-01301a50806e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:24.159870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-809c8f7d-f9ba-4bc4-8961-01301a50806e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:24.160318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-809c8f7d-f9ba-4bc4-8961-01301a50806e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:24.160739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-809c8f7d-f9ba-4bc4-8961-01301a50806e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:24.287945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-809c8f7d-f9ba-4bc4-8961-01301a50806e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:24.296098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-809c8f7d-f9ba-4bc4-8961-01301a50806e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149434 Sep 01 05:33:24.296965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 901/1882] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:24 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:24.660079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-365158e0-2e27-4bd5-bc61-8693e34b011d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:24.660690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-365158e0-2e27-4bd5-bc61-8693e34b011d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:24.667991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-365158e0-2e27-4bd5-bc61-8693e34b011d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:24.669139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-365158e0-2e27-4bd5-bc61-8693e34b011d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:24.669570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-365158e0-2e27-4bd5-bc61-8693e34b011d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:24.670246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-365158e0-2e27-4bd5-bc61-8693e34b011d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:24.670691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-365158e0-2e27-4bd5-bc61-8693e34b011d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:24.671106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-365158e0-2e27-4bd5-bc61-8693e34b011d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:24.733290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-365158e0-2e27-4bd5-bc61-8693e34b011d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:24.741944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-365158e0-2e27-4bd5-bc61-8693e34b011d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:24.743575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-365158e0-2e27-4bd5-bc61-8693e34b011d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:24.745085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-365158e0-2e27-4bd5-bc61-8693e34b011d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089011 Sep 01 05:33:24.745725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 982/1883] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:25.317605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ee5531e7-e5aa-4026-9875-056082f9677c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:25.318251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ee5531e7-e5aa-4026-9875-056082f9677c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:25.325711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee5531e7-e5aa-4026-9875-056082f9677c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:25.326191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee5531e7-e5aa-4026-9875-056082f9677c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:25.326623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee5531e7-e5aa-4026-9875-056082f9677c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:25.327305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee5531e7-e5aa-4026-9875-056082f9677c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:25.327756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee5531e7-e5aa-4026-9875-056082f9677c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:25.328177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee5531e7-e5aa-4026-9875-056082f9677c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:25.455265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ee5531e7-e5aa-4026-9875-056082f9677c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:25.463781 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ee5531e7-e5aa-4026-9875-056082f9677c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149962 Sep 01 05:33:25.464349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 902/1884] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:25 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:25.768576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d50f9778-1f86-4318-9c7c-4029ffabb701 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:25.769226 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d50f9778-1f86-4318-9c7c-4029ffabb701 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:25.775995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d50f9778-1f86-4318-9c7c-4029ffabb701 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:25.777125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d50f9778-1f86-4318-9c7c-4029ffabb701 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:25.777642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d50f9778-1f86-4318-9c7c-4029ffabb701 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:25.778265 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d50f9778-1f86-4318-9c7c-4029ffabb701 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:25.778717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d50f9778-1f86-4318-9c7c-4029ffabb701 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:25.779139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d50f9778-1f86-4318-9c7c-4029ffabb701 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:25.844024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d50f9778-1f86-4318-9c7c-4029ffabb701 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:25.852591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d50f9778-1f86-4318-9c7c-4029ffabb701 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:25.854073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d50f9778-1f86-4318-9c7c-4029ffabb701 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:25.855297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d50f9778-1f86-4318-9c7c-4029ffabb701 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090593 Sep 01 05:33:25.855903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 983/1885] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:26.485035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dcea649b-e9bf-4125-ae66-48f108e82cdb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:26.485627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dcea649b-e9bf-4125-ae66-48f108e82cdb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:26.492017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dcea649b-e9bf-4125-ae66-48f108e82cdb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:26.492488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dcea649b-e9bf-4125-ae66-48f108e82cdb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:26.492946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dcea649b-e9bf-4125-ae66-48f108e82cdb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:26.493621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dcea649b-e9bf-4125-ae66-48f108e82cdb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:26.494067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dcea649b-e9bf-4125-ae66-48f108e82cdb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:26.494483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dcea649b-e9bf-4125-ae66-48f108e82cdb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:26.626475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dcea649b-e9bf-4125-ae66-48f108e82cdb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:26.634770 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dcea649b-e9bf-4125-ae66-48f108e82cdb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153684 Sep 01 05:33:26.635340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 903/1886] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:26 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:26.877839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c5dbc6f8-1cf6-4a62-bb5d-da1f23dc97de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:26.878412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c5dbc6f8-1cf6-4a62-bb5d-da1f23dc97de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:26.885031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c5dbc6f8-1cf6-4a62-bb5d-da1f23dc97de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:26.885504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c5dbc6f8-1cf6-4a62-bb5d-da1f23dc97de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:26.885953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c5dbc6f8-1cf6-4a62-bb5d-da1f23dc97de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:26.886633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c5dbc6f8-1cf6-4a62-bb5d-da1f23dc97de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:26.887074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c5dbc6f8-1cf6-4a62-bb5d-da1f23dc97de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:26.887488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c5dbc6f8-1cf6-4a62-bb5d-da1f23dc97de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:26.951119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c5dbc6f8-1cf6-4a62-bb5d-da1f23dc97de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:26.959734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c5dbc6f8-1cf6-4a62-bb5d-da1f23dc97de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:26.961206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c5dbc6f8-1cf6-4a62-bb5d-da1f23dc97de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:26.962338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c5dbc6f8-1cf6-4a62-bb5d-da1f23dc97de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088492 Sep 01 05:33:26.962895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 984/1887] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:27.656321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b28b33e4-b73c-48e6-95c1-ec52f9eb411f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:27.656964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b28b33e4-b73c-48e6-95c1-ec52f9eb411f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:27.663380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b28b33e4-b73c-48e6-95c1-ec52f9eb411f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:27.663858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b28b33e4-b73c-48e6-95c1-ec52f9eb411f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:27.664291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b28b33e4-b73c-48e6-95c1-ec52f9eb411f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:27.665014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b28b33e4-b73c-48e6-95c1-ec52f9eb411f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:27.665460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b28b33e4-b73c-48e6-95c1-ec52f9eb411f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:27.665878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b28b33e4-b73c-48e6-95c1-ec52f9eb411f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:27.793673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b28b33e4-b73c-48e6-95c1-ec52f9eb411f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:27.802109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b28b33e4-b73c-48e6-95c1-ec52f9eb411f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149662 Sep 01 05:33:27.802675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 904/1888] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:27 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:27.985391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6ff0ad80-3f35-422c-957b-83a8a8a9489a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:27.985912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6ff0ad80-3f35-422c-957b-83a8a8a9489a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:27.992141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ff0ad80-3f35-422c-957b-83a8a8a9489a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:27.992608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ff0ad80-3f35-422c-957b-83a8a8a9489a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:27.993075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ff0ad80-3f35-422c-957b-83a8a8a9489a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:27.993757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ff0ad80-3f35-422c-957b-83a8a8a9489a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:27.994198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ff0ad80-3f35-422c-957b-83a8a8a9489a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:27.994608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6ff0ad80-3f35-422c-957b-83a8a8a9489a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:28.055571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ff0ad80-3f35-422c-957b-83a8a8a9489a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:28.064883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ff0ad80-3f35-422c-957b-83a8a8a9489a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:28.066315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6ff0ad80-3f35-422c-957b-83a8a8a9489a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:28.067461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6ff0ad80-3f35-422c-957b-83a8a8a9489a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086040 Sep 01 05:33:28.068020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 985/1889] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:27 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:28.824335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6b1ddfc3-9869-4df0-946a-08e10c0d72a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:28.824959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6b1ddfc3-9869-4df0-946a-08e10c0d72a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:28.831492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b1ddfc3-9869-4df0-946a-08e10c0d72a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:28.831962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b1ddfc3-9869-4df0-946a-08e10c0d72a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:28.832390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b1ddfc3-9869-4df0-946a-08e10c0d72a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:28.833096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b1ddfc3-9869-4df0-946a-08e10c0d72a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:28.833570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b1ddfc3-9869-4df0-946a-08e10c0d72a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:28.833989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6b1ddfc3-9869-4df0-946a-08e10c0d72a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:28.966391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6b1ddfc3-9869-4df0-946a-08e10c0d72a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:28.974487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6b1ddfc3-9869-4df0-946a-08e10c0d72a6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154246 Sep 01 05:33:28.975048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 905/1890] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:28 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:29.091281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-039f746f-2ab1-4c3b-b5e4-7d109abf013f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:29.091818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-039f746f-2ab1-4c3b-b5e4-7d109abf013f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:29.098229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039f746f-2ab1-4c3b-b5e4-7d109abf013f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:29.098712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039f746f-2ab1-4c3b-b5e4-7d109abf013f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:29.099140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039f746f-2ab1-4c3b-b5e4-7d109abf013f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:29.099823 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039f746f-2ab1-4c3b-b5e4-7d109abf013f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:29.100271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039f746f-2ab1-4c3b-b5e4-7d109abf013f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:29.100694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039f746f-2ab1-4c3b-b5e4-7d109abf013f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:29.163520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-039f746f-2ab1-4c3b-b5e4-7d109abf013f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:29.173082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-039f746f-2ab1-4c3b-b5e4-7d109abf013f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:29.174522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-039f746f-2ab1-4c3b-b5e4-7d109abf013f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:29.175665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-039f746f-2ab1-4c3b-b5e4-7d109abf013f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088917 Sep 01 05:33:29.176230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 986/1891] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:29 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:29.997440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-94a04674-9a87-4f5c-8560-49bc47274d22 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:29.998051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-94a04674-9a87-4f5c-8560-49bc47274d22 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:30.004470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94a04674-9a87-4f5c-8560-49bc47274d22 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:30.004983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94a04674-9a87-4f5c-8560-49bc47274d22 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:30.005442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94a04674-9a87-4f5c-8560-49bc47274d22 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:30.006124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94a04674-9a87-4f5c-8560-49bc47274d22 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:30.006571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94a04674-9a87-4f5c-8560-49bc47274d22 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:30.006991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94a04674-9a87-4f5c-8560-49bc47274d22 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:30.136763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-94a04674-9a87-4f5c-8560-49bc47274d22 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:30.145046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-94a04674-9a87-4f5c-8560-49bc47274d22 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152038 Sep 01 05:33:30.145550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 906/1892] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:29 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:30.198225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ad926474-120f-41aa-80f9-881a3326fdf8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:30.199033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ad926474-120f-41aa-80f9-881a3326fdf8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:30.205487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ad926474-120f-41aa-80f9-881a3326fdf8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:30.205964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ad926474-120f-41aa-80f9-881a3326fdf8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:30.206397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ad926474-120f-41aa-80f9-881a3326fdf8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:30.207081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ad926474-120f-41aa-80f9-881a3326fdf8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:30.207531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ad926474-120f-41aa-80f9-881a3326fdf8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:30.207953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ad926474-120f-41aa-80f9-881a3326fdf8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:30.272019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ad926474-120f-41aa-80f9-881a3326fdf8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:30.280646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ad926474-120f-41aa-80f9-881a3326fdf8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:30.282120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ad926474-120f-41aa-80f9-881a3326fdf8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:30.283264 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ad926474-120f-41aa-80f9-881a3326fdf8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088930 Sep 01 05:33:30.283824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 987/1893] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:30 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:31.166480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-259d31d1-15d2-47e0-9942-adc1eb2d1b2b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:31.167073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-259d31d1-15d2-47e0-9942-adc1eb2d1b2b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:31.173643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-259d31d1-15d2-47e0-9942-adc1eb2d1b2b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:31.174121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-259d31d1-15d2-47e0-9942-adc1eb2d1b2b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:31.174556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-259d31d1-15d2-47e0-9942-adc1eb2d1b2b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:31.175236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-259d31d1-15d2-47e0-9942-adc1eb2d1b2b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:31.175688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-259d31d1-15d2-47e0-9942-adc1eb2d1b2b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:31.176106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-259d31d1-15d2-47e0-9942-adc1eb2d1b2b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:31.306468 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-259d31d1-15d2-47e0-9942-adc1eb2d1b2b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:31.306628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d917f77b-d7f3-4cc8-9158-8c05ae94c94f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:31.307805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d917f77b-d7f3-4cc8-9158-8c05ae94c94f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:31.314187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d917f77b-d7f3-4cc8-9158-8c05ae94c94f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:31.314662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d917f77b-d7f3-4cc8-9158-8c05ae94c94f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:31.315114 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d917f77b-d7f3-4cc8-9158-8c05ae94c94f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:31.315351 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-259d31d1-15d2-47e0-9942-adc1eb2d1b2b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152825 Sep 01 05:33:31.315795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d917f77b-d7f3-4cc8-9158-8c05ae94c94f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:31.315921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 907/1894] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:31 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:31.316552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d917f77b-d7f3-4cc8-9158-8c05ae94c94f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:31.317007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d917f77b-d7f3-4cc8-9158-8c05ae94c94f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:31.377877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d917f77b-d7f3-4cc8-9158-8c05ae94c94f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:31.387086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d917f77b-d7f3-4cc8-9158-8c05ae94c94f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:31.388509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d917f77b-d7f3-4cc8-9158-8c05ae94c94f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:31.389662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d917f77b-d7f3-4cc8-9158-8c05ae94c94f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086979 Sep 01 05:33:31.390211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 988/1895] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:33:32.337809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-466ba5de-9a2e-46e6-ac6c-97fc8087ee81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:32.339011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-466ba5de-9a2e-46e6-ac6c-97fc8087ee81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:32.345552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-466ba5de-9a2e-46e6-ac6c-97fc8087ee81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:32.346026 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-466ba5de-9a2e-46e6-ac6c-97fc8087ee81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:32.346454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-466ba5de-9a2e-46e6-ac6c-97fc8087ee81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:32.347127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-466ba5de-9a2e-46e6-ac6c-97fc8087ee81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:32.347569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-466ba5de-9a2e-46e6-ac6c-97fc8087ee81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:32.347983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-466ba5de-9a2e-46e6-ac6c-97fc8087ee81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:32.411617 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f290de85-b6ef-48a8-b103-c53c9c1ff5de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:32.412295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f290de85-b6ef-48a8-b103-c53c9c1ff5de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:32.418931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f290de85-b6ef-48a8-b103-c53c9c1ff5de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:32.419404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f290de85-b6ef-48a8-b103-c53c9c1ff5de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:32.419830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f290de85-b6ef-48a8-b103-c53c9c1ff5de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:32.420511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f290de85-b6ef-48a8-b103-c53c9c1ff5de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:32.421253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f290de85-b6ef-48a8-b103-c53c9c1ff5de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:32.421664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f290de85-b6ef-48a8-b103-c53c9c1ff5de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:32.477621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-466ba5de-9a2e-46e6-ac6c-97fc8087ee81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:32.483141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f290de85-b6ef-48a8-b103-c53c9c1ff5de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:32.486146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-466ba5de-9a2e-46e6-ac6c-97fc8087ee81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152228 Sep 01 05:33:32.486800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 908/1896] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:32 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:32.491919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f290de85-b6ef-48a8-b103-c53c9c1ff5de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:32.493484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f290de85-b6ef-48a8-b103-c53c9c1ff5de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:32.494654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f290de85-b6ef-48a8-b103-c53c9c1ff5de tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086973 Sep 01 05:33:32.495199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 989/1897] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:33:33.507415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-88a58915-a834-41f6-8007-e31103bb5c44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:33.508034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-88a58915-a834-41f6-8007-e31103bb5c44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:33.515599 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88a58915-a834-41f6-8007-e31103bb5c44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:33.516111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88a58915-a834-41f6-8007-e31103bb5c44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:33.516544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88a58915-a834-41f6-8007-e31103bb5c44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:33.517260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88a58915-a834-41f6-8007-e31103bb5c44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:33.517539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0c5891fd-5b73-4c2d-b554-9967bac995f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:33.517971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88a58915-a834-41f6-8007-e31103bb5c44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:33.518110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88a58915-a834-41f6-8007-e31103bb5c44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:33.518217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0c5891fd-5b73-4c2d-b554-9967bac995f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:33.524447 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c5891fd-5b73-4c2d-b554-9967bac995f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:33.524976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c5891fd-5b73-4c2d-b554-9967bac995f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:33.525411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c5891fd-5b73-4c2d-b554-9967bac995f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:33.526352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c5891fd-5b73-4c2d-b554-9967bac995f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:33.526943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c5891fd-5b73-4c2d-b554-9967bac995f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:33.527370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c5891fd-5b73-4c2d-b554-9967bac995f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:33.592206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0c5891fd-5b73-4c2d-b554-9967bac995f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:33.600864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0c5891fd-5b73-4c2d-b554-9967bac995f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:33.602291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0c5891fd-5b73-4c2d-b554-9967bac995f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:33.603419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0c5891fd-5b73-4c2d-b554-9967bac995f3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089814 Sep 01 05:33:33.604167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 990/1898] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:33:33.650327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-88a58915-a834-41f6-8007-e31103bb5c44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:33.658526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-88a58915-a834-41f6-8007-e31103bb5c44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155100 Sep 01 05:33:33.659089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 909/1899] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:34.626297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b5d96c29-ced2-4f6a-acd6-fec13a1d97e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:34.626816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b5d96c29-ced2-4f6a-acd6-fec13a1d97e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:34.633212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5d96c29-ced2-4f6a-acd6-fec13a1d97e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:34.633687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5d96c29-ced2-4f6a-acd6-fec13a1d97e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:34.634125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5d96c29-ced2-4f6a-acd6-fec13a1d97e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:34.634795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5d96c29-ced2-4f6a-acd6-fec13a1d97e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:34.635775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5d96c29-ced2-4f6a-acd6-fec13a1d97e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:34.636389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5d96c29-ced2-4f6a-acd6-fec13a1d97e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:34.680158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7670b6e8-de7a-4eb8-a989-41fb1d5b8e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:34.680787 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7670b6e8-de7a-4eb8-a989-41fb1d5b8e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:34.687906 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7670b6e8-de7a-4eb8-a989-41fb1d5b8e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:34.688423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7670b6e8-de7a-4eb8-a989-41fb1d5b8e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:34.688889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7670b6e8-de7a-4eb8-a989-41fb1d5b8e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:34.689581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7670b6e8-de7a-4eb8-a989-41fb1d5b8e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:34.690031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7670b6e8-de7a-4eb8-a989-41fb1d5b8e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:34.690450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7670b6e8-de7a-4eb8-a989-41fb1d5b8e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:34.699967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b5d96c29-ced2-4f6a-acd6-fec13a1d97e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:34.708570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b5d96c29-ced2-4f6a-acd6-fec13a1d97e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:34.710055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b5d96c29-ced2-4f6a-acd6-fec13a1d97e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:34.711212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b5d96c29-ced2-4f6a-acd6-fec13a1d97e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089125 Sep 01 05:33:34.711766 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 991/1900] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:35.037238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7670b6e8-de7a-4eb8-a989-41fb1d5b8e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:35.045782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7670b6e8-de7a-4eb8-a989-41fb1d5b8e87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.369219 Sep 01 05:33:35.046356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 910/1901] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:35.735192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6298e76a-a2b4-4ecd-973a-ab6ce8ae8efc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:35.735899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6298e76a-a2b4-4ecd-973a-ab6ce8ae8efc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:35.742118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6298e76a-a2b4-4ecd-973a-ab6ce8ae8efc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:35.742590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6298e76a-a2b4-4ecd-973a-ab6ce8ae8efc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:35.743006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6298e76a-a2b4-4ecd-973a-ab6ce8ae8efc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:35.743680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6298e76a-a2b4-4ecd-973a-ab6ce8ae8efc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:35.744125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6298e76a-a2b4-4ecd-973a-ab6ce8ae8efc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:35.744539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6298e76a-a2b4-4ecd-973a-ab6ce8ae8efc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:35.806246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6298e76a-a2b4-4ecd-973a-ab6ce8ae8efc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:35.814635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6298e76a-a2b4-4ecd-973a-ab6ce8ae8efc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:35.816055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6298e76a-a2b4-4ecd-973a-ab6ce8ae8efc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:35.817214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6298e76a-a2b4-4ecd-973a-ab6ce8ae8efc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085903 Sep 01 05:33:35.817765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 992/1902] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:36.067793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-241eb7ea-e32f-4b0b-802d-af1d216cd20c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:36.068336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-241eb7ea-e32f-4b0b-802d-af1d216cd20c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:36.075744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-241eb7ea-e32f-4b0b-802d-af1d216cd20c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.076220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-241eb7ea-e32f-4b0b-802d-af1d216cd20c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.076650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-241eb7ea-e32f-4b0b-802d-af1d216cd20c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.077360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-241eb7ea-e32f-4b0b-802d-af1d216cd20c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.077805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-241eb7ea-e32f-4b0b-802d-af1d216cd20c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.078220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-241eb7ea-e32f-4b0b-802d-af1d216cd20c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.204441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-241eb7ea-e32f-4b0b-802d-af1d216cd20c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:36.212496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-241eb7ea-e32f-4b0b-802d-af1d216cd20c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148685 Sep 01 05:33:36.213757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 911/1903] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:36 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:36.840048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-59d31cdc-e55a-4ae6-821a-2006386a7779 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:36.840633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-59d31cdc-e55a-4ae6-821a-2006386a7779 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:36.847081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-59d31cdc-e55a-4ae6-821a-2006386a7779 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.847554 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-59d31cdc-e55a-4ae6-821a-2006386a7779 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.847982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-59d31cdc-e55a-4ae6-821a-2006386a7779 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.848666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-59d31cdc-e55a-4ae6-821a-2006386a7779 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.849138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-59d31cdc-e55a-4ae6-821a-2006386a7779 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.849558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-59d31cdc-e55a-4ae6-821a-2006386a7779 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.852064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:36.910945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-59d31cdc-e55a-4ae6-821a-2006386a7779 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:36.920203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-59d31cdc-e55a-4ae6-821a-2006386a7779 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:36.921917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-59d31cdc-e55a-4ae6-821a-2006386a7779 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:36.923048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-59d31cdc-e55a-4ae6-821a-2006386a7779 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087184 Sep 01 05:33:36.923602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 993/1904] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:37.234497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e59bf220-4123-4469-bb9d-44745d0c534d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:37.235105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e59bf220-4123-4469-bb9d-44745d0c534d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:37.241517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e59bf220-4123-4469-bb9d-44745d0c534d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:37.241991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e59bf220-4123-4469-bb9d-44745d0c534d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:37.242419 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e59bf220-4123-4469-bb9d-44745d0c534d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:37.243093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e59bf220-4123-4469-bb9d-44745d0c534d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:37.243537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e59bf220-4123-4469-bb9d-44745d0c534d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:37.243951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e59bf220-4123-4469-bb9d-44745d0c534d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:37.373084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e59bf220-4123-4469-bb9d-44745d0c534d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:37.381096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e59bf220-4123-4469-bb9d-44745d0c534d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150414 Sep 01 05:33:37.381658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 912/1905] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:37 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:37.946543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2f57f392-06ab-487a-953f-fa6ee6060659 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:37.947226 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2f57f392-06ab-487a-953f-fa6ee6060659 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:37.953324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f57f392-06ab-487a-953f-fa6ee6060659 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:37.953808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f57f392-06ab-487a-953f-fa6ee6060659 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:37.954242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f57f392-06ab-487a-953f-fa6ee6060659 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:37.954930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f57f392-06ab-487a-953f-fa6ee6060659 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:37.955381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f57f392-06ab-487a-953f-fa6ee6060659 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:37.955804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f57f392-06ab-487a-953f-fa6ee6060659 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:38.015979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2f57f392-06ab-487a-953f-fa6ee6060659 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:38.024457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2f57f392-06ab-487a-953f-fa6ee6060659 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:38.026641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2f57f392-06ab-487a-953f-fa6ee6060659 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:38.027765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2f57f392-06ab-487a-953f-fa6ee6060659 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085337 Sep 01 05:33:38.028316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 994/1906] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:37 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:38.403916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-edeee184-8b70-4a40-8ded-89415b93bf6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:38.405220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-edeee184-8b70-4a40-8ded-89415b93bf6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:38.411715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-edeee184-8b70-4a40-8ded-89415b93bf6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:38.412187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-edeee184-8b70-4a40-8ded-89415b93bf6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:38.412614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-edeee184-8b70-4a40-8ded-89415b93bf6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:38.413348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-edeee184-8b70-4a40-8ded-89415b93bf6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:38.413793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-edeee184-8b70-4a40-8ded-89415b93bf6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:38.414235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-edeee184-8b70-4a40-8ded-89415b93bf6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:38.545002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-edeee184-8b70-4a40-8ded-89415b93bf6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:38.553415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-edeee184-8b70-4a40-8ded-89415b93bf6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154350 Sep 01 05:33:38.553986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 913/1907] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:38 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:39.051754 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9eea7521-b945-4977-8899-1b2cee972a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:39.052367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9eea7521-b945-4977-8899-1b2cee972a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:39.059276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9eea7521-b945-4977-8899-1b2cee972a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:39.059769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9eea7521-b945-4977-8899-1b2cee972a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:39.060212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9eea7521-b945-4977-8899-1b2cee972a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:39.060945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9eea7521-b945-4977-8899-1b2cee972a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:39.061401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9eea7521-b945-4977-8899-1b2cee972a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:39.061824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9eea7521-b945-4977-8899-1b2cee972a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:39.125966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9eea7521-b945-4977-8899-1b2cee972a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:39.134503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9eea7521-b945-4977-8899-1b2cee972a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:39.136659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9eea7521-b945-4977-8899-1b2cee972a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:39.137851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9eea7521-b945-4977-8899-1b2cee972a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090063 Sep 01 05:33:39.138610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 995/1908] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:39 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:39.576180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6159ecea-9782-462a-b75d-4a4f233037e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:39.576837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6159ecea-9782-462a-b75d-4a4f233037e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:39.583345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6159ecea-9782-462a-b75d-4a4f233037e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:39.583819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6159ecea-9782-462a-b75d-4a4f233037e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:39.584249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6159ecea-9782-462a-b75d-4a4f233037e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:39.584962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6159ecea-9782-462a-b75d-4a4f233037e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:39.585414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6159ecea-9782-462a-b75d-4a4f233037e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:39.585834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6159ecea-9782-462a-b75d-4a4f233037e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:39.600694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:39.716725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6159ecea-9782-462a-b75d-4a4f233037e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:39.724943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6159ecea-9782-462a-b75d-4a4f233037e5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153495 Sep 01 05:33:39.725509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 914/1909] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:40.161699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cbe2db7b-0884-45ae-a346-aba6c264c073 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:40.162245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cbe2db7b-0884-45ae-a346-aba6c264c073 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:40.168641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cbe2db7b-0884-45ae-a346-aba6c264c073 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.169149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cbe2db7b-0884-45ae-a346-aba6c264c073 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.169585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cbe2db7b-0884-45ae-a346-aba6c264c073 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.170533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cbe2db7b-0884-45ae-a346-aba6c264c073 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.170984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cbe2db7b-0884-45ae-a346-aba6c264c073 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.171407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cbe2db7b-0884-45ae-a346-aba6c264c073 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.232143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cbe2db7b-0884-45ae-a346-aba6c264c073 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:40.240685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cbe2db7b-0884-45ae-a346-aba6c264c073 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:40.242135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cbe2db7b-0884-45ae-a346-aba6c264c073 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:40.243296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cbe2db7b-0884-45ae-a346-aba6c264c073 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085656 Sep 01 05:33:40.244355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 996/1910] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:40.747806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d507a5f2-a7f2-4cb3-a914-42472346deff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:40.748420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d507a5f2-a7f2-4cb3-a914-42472346deff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:40.754997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d507a5f2-a7f2-4cb3-a914-42472346deff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.755614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d507a5f2-a7f2-4cb3-a914-42472346deff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.756190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d507a5f2-a7f2-4cb3-a914-42472346deff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.756914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d507a5f2-a7f2-4cb3-a914-42472346deff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.757372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d507a5f2-a7f2-4cb3-a914-42472346deff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.757794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d507a5f2-a7f2-4cb3-a914-42472346deff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.884911 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d507a5f2-a7f2-4cb3-a914-42472346deff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:40.893438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d507a5f2-a7f2-4cb3-a914-42472346deff tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150558 Sep 01 05:33:40.894010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 915/1911] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:40 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:41.266388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d21e06f0-6346-4640-95c1-853cdc8dc203 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:41.266995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d21e06f0-6346-4640-95c1-853cdc8dc203 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:41.273509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d21e06f0-6346-4640-95c1-853cdc8dc203 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:41.273980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d21e06f0-6346-4640-95c1-853cdc8dc203 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:41.274404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d21e06f0-6346-4640-95c1-853cdc8dc203 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:41.275112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d21e06f0-6346-4640-95c1-853cdc8dc203 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:41.275570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d21e06f0-6346-4640-95c1-853cdc8dc203 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:41.276017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d21e06f0-6346-4640-95c1-853cdc8dc203 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:41.339256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d21e06f0-6346-4640-95c1-853cdc8dc203 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:41.347730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d21e06f0-6346-4640-95c1-853cdc8dc203 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:41.349170 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d21e06f0-6346-4640-95c1-853cdc8dc203 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:41.350293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d21e06f0-6346-4640-95c1-853cdc8dc203 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087923 Sep 01 05:33:41.350847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 997/1912] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:41.917194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2e6e0180-59a0-4ce5-b2fa-4ca2bcb4bb8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:41.917895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2e6e0180-59a0-4ce5-b2fa-4ca2bcb4bb8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:41.924634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e6e0180-59a0-4ce5-b2fa-4ca2bcb4bb8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:41.925138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e6e0180-59a0-4ce5-b2fa-4ca2bcb4bb8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:41.925566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e6e0180-59a0-4ce5-b2fa-4ca2bcb4bb8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:41.926247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e6e0180-59a0-4ce5-b2fa-4ca2bcb4bb8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:41.926693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e6e0180-59a0-4ce5-b2fa-4ca2bcb4bb8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:41.927105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e6e0180-59a0-4ce5-b2fa-4ca2bcb4bb8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.054682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2e6e0180-59a0-4ce5-b2fa-4ca2bcb4bb8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:42.062950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2e6e0180-59a0-4ce5-b2fa-4ca2bcb4bb8d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150456 Sep 01 05:33:42.063509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 916/1913] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:42.374437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a283bff6-3d1d-4abc-a346-b3d41f80d1b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:42.374983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a283bff6-3d1d-4abc-a346-b3d41f80d1b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:42.381254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a283bff6-3d1d-4abc-a346-b3d41f80d1b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:42.381725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a283bff6-3d1d-4abc-a346-b3d41f80d1b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:42.382151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a283bff6-3d1d-4abc-a346-b3d41f80d1b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.382826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a283bff6-3d1d-4abc-a346-b3d41f80d1b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:42.383266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a283bff6-3d1d-4abc-a346-b3d41f80d1b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:42.383679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a283bff6-3d1d-4abc-a346-b3d41f80d1b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.444691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a283bff6-3d1d-4abc-a346-b3d41f80d1b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:42.454179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a283bff6-3d1d-4abc-a346-b3d41f80d1b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:42.455603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a283bff6-3d1d-4abc-a346-b3d41f80d1b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:42.456723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a283bff6-3d1d-4abc-a346-b3d41f80d1b5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086375 Sep 01 05:33:42.457308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 998/1914] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:43.084993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-df4221d2-1a47-4d07-b420-09a8c8103e9a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:43.085640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-df4221d2-1a47-4d07-b420-09a8c8103e9a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:43.092829 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df4221d2-1a47-4d07-b420-09a8c8103e9a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.093319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df4221d2-1a47-4d07-b420-09a8c8103e9a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.093757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df4221d2-1a47-4d07-b420-09a8c8103e9a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:43.094446 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df4221d2-1a47-4d07-b420-09a8c8103e9a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.094898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df4221d2-1a47-4d07-b420-09a8c8103e9a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.095321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-df4221d2-1a47-4d07-b420-09a8c8103e9a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:43.300139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-df4221d2-1a47-4d07-b420-09a8c8103e9a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:43.308981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-df4221d2-1a47-4d07-b420-09a8c8103e9a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.228008 Sep 01 05:33:43.309547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 917/1915] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:43 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:43.480633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-411faae9-366a-424d-807c-dafe3f3770d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:43.481228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-411faae9-366a-424d-807c-dafe3f3770d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:43.487446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-411faae9-366a-424d-807c-dafe3f3770d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.487927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-411faae9-366a-424d-807c-dafe3f3770d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.488355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-411faae9-366a-424d-807c-dafe3f3770d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:43.489058 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-411faae9-366a-424d-807c-dafe3f3770d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.489503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-411faae9-366a-424d-807c-dafe3f3770d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.489918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-411faae9-366a-424d-807c-dafe3f3770d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:43.557788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-411faae9-366a-424d-807c-dafe3f3770d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:43.566428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-411faae9-366a-424d-807c-dafe3f3770d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:43.567859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-411faae9-366a-424d-807c-dafe3f3770d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:43.569022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-411faae9-366a-424d-807c-dafe3f3770d2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.093159 Sep 01 05:33:43.569576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 999/1916] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:44.331043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-42e01c70-d8d7-41e9-8a1b-9194610adc81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:44.331651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-42e01c70-d8d7-41e9-8a1b-9194610adc81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:44.338658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42e01c70-d8d7-41e9-8a1b-9194610adc81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:44.339136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42e01c70-d8d7-41e9-8a1b-9194610adc81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:44.339574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42e01c70-d8d7-41e9-8a1b-9194610adc81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:44.340259 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42e01c70-d8d7-41e9-8a1b-9194610adc81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:44.340714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42e01c70-d8d7-41e9-8a1b-9194610adc81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:44.341180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-42e01c70-d8d7-41e9-8a1b-9194610adc81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:44.472762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-42e01c70-d8d7-41e9-8a1b-9194610adc81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:44.481147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-42e01c70-d8d7-41e9-8a1b-9194610adc81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153934 Sep 01 05:33:44.481733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 918/1917] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:44 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:44.591299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-eb6736b1-dfa8-40d4-972b-3c8b723867d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:44.591864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-eb6736b1-dfa8-40d4-972b-3c8b723867d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:44.598180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb6736b1-dfa8-40d4-972b-3c8b723867d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:44.598651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb6736b1-dfa8-40d4-972b-3c8b723867d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:44.599078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb6736b1-dfa8-40d4-972b-3c8b723867d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:44.599753 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb6736b1-dfa8-40d4-972b-3c8b723867d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:44.600201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb6736b1-dfa8-40d4-972b-3c8b723867d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:44.600615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb6736b1-dfa8-40d4-972b-3c8b723867d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:44.661723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-eb6736b1-dfa8-40d4-972b-3c8b723867d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:44.670741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-eb6736b1-dfa8-40d4-972b-3c8b723867d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:44.672161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-eb6736b1-dfa8-40d4-972b-3c8b723867d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:44.673321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-eb6736b1-dfa8-40d4-972b-3c8b723867d4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086304 Sep 01 05:33:44.673874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1000/1918] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:45.502350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-66851e60-bf53-493c-b5d9-d110ae1c534e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:45.502970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-66851e60-bf53-493c-b5d9-d110ae1c534e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:45.509558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66851e60-bf53-493c-b5d9-d110ae1c534e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:45.510031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66851e60-bf53-493c-b5d9-d110ae1c534e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:45.510470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66851e60-bf53-493c-b5d9-d110ae1c534e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.511159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66851e60-bf53-493c-b5d9-d110ae1c534e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:45.511612 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66851e60-bf53-493c-b5d9-d110ae1c534e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:45.512035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66851e60-bf53-493c-b5d9-d110ae1c534e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.645995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-66851e60-bf53-493c-b5d9-d110ae1c534e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:45.654858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-66851e60-bf53-493c-b5d9-d110ae1c534e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156417 Sep 01 05:33:45.655427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 919/1919] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:45.695381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4623b844-ffd3-41a3-90f8-d357b5df178d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:45.695995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4623b844-ffd3-41a3-90f8-d357b5df178d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:45.702985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4623b844-ffd3-41a3-90f8-d357b5df178d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:45.703466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4623b844-ffd3-41a3-90f8-d357b5df178d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:45.703897 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4623b844-ffd3-41a3-90f8-d357b5df178d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.704582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4623b844-ffd3-41a3-90f8-d357b5df178d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:45.705069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4623b844-ffd3-41a3-90f8-d357b5df178d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:45.705489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4623b844-ffd3-41a3-90f8-d357b5df178d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.765849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4623b844-ffd3-41a3-90f8-d357b5df178d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:45.774404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4623b844-ffd3-41a3-90f8-d357b5df178d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:45.776487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4623b844-ffd3-41a3-90f8-d357b5df178d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:45.777653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4623b844-ffd3-41a3-90f8-d357b5df178d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086172 Sep 01 05:33:45.778209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1001/1920] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:45 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:46.676766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-46361219-9b49-40ae-9eed-ee3df83275f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:46.677442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-46361219-9b49-40ae-9eed-ee3df83275f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:46.683977 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46361219-9b49-40ae-9eed-ee3df83275f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.684450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46361219-9b49-40ae-9eed-ee3df83275f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.684914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46361219-9b49-40ae-9eed-ee3df83275f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.685591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46361219-9b49-40ae-9eed-ee3df83275f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.686035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46361219-9b49-40ae-9eed-ee3df83275f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.686451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46361219-9b49-40ae-9eed-ee3df83275f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.799734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-497dd1ba-c153-4b09-a1c8-4cc75053bfeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:46.800340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-497dd1ba-c153-4b09-a1c8-4cc75053bfeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:46.807256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-497dd1ba-c153-4b09-a1c8-4cc75053bfeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.807736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-497dd1ba-c153-4b09-a1c8-4cc75053bfeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.808176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-497dd1ba-c153-4b09-a1c8-4cc75053bfeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.808940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-497dd1ba-c153-4b09-a1c8-4cc75053bfeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.809383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-497dd1ba-c153-4b09-a1c8-4cc75053bfeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.809800 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-497dd1ba-c153-4b09-a1c8-4cc75053bfeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.817694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-46361219-9b49-40ae-9eed-ee3df83275f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:46.826791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-46361219-9b49-40ae-9eed-ee3df83275f8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153827 Sep 01 05:33:46.827380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 920/1921] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:46 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:46.870568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-497dd1ba-c153-4b09-a1c8-4cc75053bfeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:46.879005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-497dd1ba-c153-4b09-a1c8-4cc75053bfeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:46.880431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-497dd1ba-c153-4b09-a1c8-4cc75053bfeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:46.881590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-497dd1ba-c153-4b09-a1c8-4cc75053bfeb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085841 Sep 01 05:33:46.882139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1002/1922] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:33:47.848483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f05b36a1-ae34-4907-9155-f4c37941005b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:47.849150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f05b36a1-ae34-4907-9155-f4c37941005b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:47.851462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=52 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:47.857671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f05b36a1-ae34-4907-9155-f4c37941005b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.858148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f05b36a1-ae34-4907-9155-f4c37941005b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.858579 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f05b36a1-ae34-4907-9155-f4c37941005b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.859263 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f05b36a1-ae34-4907-9155-f4c37941005b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.859714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f05b36a1-ae34-4907-9155-f4c37941005b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.860136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f05b36a1-ae34-4907-9155-f4c37941005b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.905577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-67a60670-f701-4b0a-ab72-8fe925c0a6ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:47.906483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-67a60670-f701-4b0a-ab72-8fe925c0a6ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:47.912890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67a60670-f701-4b0a-ab72-8fe925c0a6ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.913369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67a60670-f701-4b0a-ab72-8fe925c0a6ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.913799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67a60670-f701-4b0a-ab72-8fe925c0a6ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.914492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67a60670-f701-4b0a-ab72-8fe925c0a6ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.915097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67a60670-f701-4b0a-ab72-8fe925c0a6ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.916143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-67a60670-f701-4b0a-ab72-8fe925c0a6ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.985289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-67a60670-f701-4b0a-ab72-8fe925c0a6ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:48.005456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-67a60670-f701-4b0a-ab72-8fe925c0a6ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:48.005456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-67a60670-f701-4b0a-ab72-8fe925c0a6ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:48.005456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-67a60670-f701-4b0a-ab72-8fe925c0a6ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.096562 Sep 01 05:33:48.005760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1003/1923] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:47 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:33:48.018572 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f05b36a1-ae34-4907-9155-f4c37941005b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:48.026922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f05b36a1-ae34-4907-9155-f4c37941005b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.182301 Sep 01 05:33:48.027605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 921/1924] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:49.019708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f21e2505-c7c6-40a6-9d08-b95b486d863c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:49.020323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f21e2505-c7c6-40a6-9d08-b95b486d863c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:49.022658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=56 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:49.028104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f21e2505-c7c6-40a6-9d08-b95b486d863c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.028589 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f21e2505-c7c6-40a6-9d08-b95b486d863c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.029047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f21e2505-c7c6-40a6-9d08-b95b486d863c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.029734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f21e2505-c7c6-40a6-9d08-b95b486d863c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.030219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f21e2505-c7c6-40a6-9d08-b95b486d863c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.030644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f21e2505-c7c6-40a6-9d08-b95b486d863c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.049786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fcfc1317-ee8c-49bd-887d-60657dc6badc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:49.050405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fcfc1317-ee8c-49bd-887d-60657dc6badc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:49.057693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fcfc1317-ee8c-49bd-887d-60657dc6badc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.058186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fcfc1317-ee8c-49bd-887d-60657dc6badc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.058621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fcfc1317-ee8c-49bd-887d-60657dc6badc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.059312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fcfc1317-ee8c-49bd-887d-60657dc6badc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.059768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fcfc1317-ee8c-49bd-887d-60657dc6badc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.060193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fcfc1317-ee8c-49bd-887d-60657dc6badc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.098937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f21e2505-c7c6-40a6-9d08-b95b486d863c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:49.108454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f21e2505-c7c6-40a6-9d08-b95b486d863c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:49.109903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f21e2505-c7c6-40a6-9d08-b95b486d863c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:49.111074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f21e2505-c7c6-40a6-9d08-b95b486d863c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.095340 Sep 01 05:33:49.111660 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1004/1925] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:49 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:49.192321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fcfc1317-ee8c-49bd-887d-60657dc6badc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:49.201528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fcfc1317-ee8c-49bd-887d-60657dc6badc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155702 Sep 01 05:33:49.202088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 922/1926] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:49 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:50.134219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-42ab6b88-61de-4958-8b1d-b257dfc99614 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:50.134983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-42ab6b88-61de-4958-8b1d-b257dfc99614 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:50.141459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42ab6b88-61de-4958-8b1d-b257dfc99614 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.141942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42ab6b88-61de-4958-8b1d-b257dfc99614 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.142377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42ab6b88-61de-4958-8b1d-b257dfc99614 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.143059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42ab6b88-61de-4958-8b1d-b257dfc99614 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.143504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42ab6b88-61de-4958-8b1d-b257dfc99614 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.143922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42ab6b88-61de-4958-8b1d-b257dfc99614 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.204943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-42ab6b88-61de-4958-8b1d-b257dfc99614 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:50.213662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-42ab6b88-61de-4958-8b1d-b257dfc99614 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:50.215100 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-42ab6b88-61de-4958-8b1d-b257dfc99614 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:50.216244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-42ab6b88-61de-4958-8b1d-b257dfc99614 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086532 Sep 01 05:33:50.216822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1005/1927] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:50.222422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3222f205-ee07-435e-a74f-c982ce071544 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:50.223028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3222f205-ee07-435e-a74f-c982ce071544 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:50.232306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3222f205-ee07-435e-a74f-c982ce071544 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.232801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3222f205-ee07-435e-a74f-c982ce071544 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.233592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3222f205-ee07-435e-a74f-c982ce071544 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.234273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3222f205-ee07-435e-a74f-c982ce071544 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.234716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3222f205-ee07-435e-a74f-c982ce071544 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.235163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3222f205-ee07-435e-a74f-c982ce071544 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.366005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3222f205-ee07-435e-a74f-c982ce071544 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:50.375008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3222f205-ee07-435e-a74f-c982ce071544 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156374 Sep 01 05:33:50.375567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 923/1928] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:50 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:51.239525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-84349bf1-7157-49a9-8131-0f20c212046d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:51.240132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-84349bf1-7157-49a9-8131-0f20c212046d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:51.247638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-84349bf1-7157-49a9-8131-0f20c212046d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.248124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-84349bf1-7157-49a9-8131-0f20c212046d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.248592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-84349bf1-7157-49a9-8131-0f20c212046d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.249321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-84349bf1-7157-49a9-8131-0f20c212046d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.249773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-84349bf1-7157-49a9-8131-0f20c212046d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.250228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-84349bf1-7157-49a9-8131-0f20c212046d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.312178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-84349bf1-7157-49a9-8131-0f20c212046d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:51.320609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-84349bf1-7157-49a9-8131-0f20c212046d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:51.322438 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-84349bf1-7157-49a9-8131-0f20c212046d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:51.323628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-84349bf1-7157-49a9-8131-0f20c212046d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088004 Sep 01 05:33:51.324312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1006/1929] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:51 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:51.396903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-664674fd-4306-4bce-ae73-bfb0ed91d2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:51.397507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-664674fd-4306-4bce-ae73-bfb0ed91d2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:51.404690 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-664674fd-4306-4bce-ae73-bfb0ed91d2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.405205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-664674fd-4306-4bce-ae73-bfb0ed91d2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.405639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-664674fd-4306-4bce-ae73-bfb0ed91d2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.406325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-664674fd-4306-4bce-ae73-bfb0ed91d2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.406779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-664674fd-4306-4bce-ae73-bfb0ed91d2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.407203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-664674fd-4306-4bce-ae73-bfb0ed91d2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.537982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-664674fd-4306-4bce-ae73-bfb0ed91d2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:51.547165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-664674fd-4306-4bce-ae73-bfb0ed91d2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154171 Sep 01 05:33:51.547732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 924/1930] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:52.347193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2a036567-7181-46bb-87bd-328d8b9db309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:52.347805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2a036567-7181-46bb-87bd-328d8b9db309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:52.354731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a036567-7181-46bb-87bd-328d8b9db309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.355216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a036567-7181-46bb-87bd-328d8b9db309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.355645 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a036567-7181-46bb-87bd-328d8b9db309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.356332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a036567-7181-46bb-87bd-328d8b9db309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.356807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a036567-7181-46bb-87bd-328d8b9db309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.357227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a036567-7181-46bb-87bd-328d8b9db309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.422818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2a036567-7181-46bb-87bd-328d8b9db309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:52.432038 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2a036567-7181-46bb-87bd-328d8b9db309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:52.433509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2a036567-7181-46bb-87bd-328d8b9db309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:52.434651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2a036567-7181-46bb-87bd-328d8b9db309 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091717 Sep 01 05:33:52.435350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1007/1931] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:52.569606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6da83338-05cd-47e2-a5ff-4025f125b682 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:52.570220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6da83338-05cd-47e2-a5ff-4025f125b682 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:52.576597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6da83338-05cd-47e2-a5ff-4025f125b682 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.577117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6da83338-05cd-47e2-a5ff-4025f125b682 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.577554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6da83338-05cd-47e2-a5ff-4025f125b682 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.578235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6da83338-05cd-47e2-a5ff-4025f125b682 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.578687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6da83338-05cd-47e2-a5ff-4025f125b682 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.579109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6da83338-05cd-47e2-a5ff-4025f125b682 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.706742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6da83338-05cd-47e2-a5ff-4025f125b682 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:52.715493 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6da83338-05cd-47e2-a5ff-4025f125b682 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149991 Sep 01 05:33:52.716070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 925/1932] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:53.457825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-01cc974e-db1a-4be5-8a53-27be7f3d8cd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:53.458461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-01cc974e-db1a-4be5-8a53-27be7f3d8cd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:53.464988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01cc974e-db1a-4be5-8a53-27be7f3d8cd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.465459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01cc974e-db1a-4be5-8a53-27be7f3d8cd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.465886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01cc974e-db1a-4be5-8a53-27be7f3d8cd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.466561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01cc974e-db1a-4be5-8a53-27be7f3d8cd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.466995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01cc974e-db1a-4be5-8a53-27be7f3d8cd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.467405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01cc974e-db1a-4be5-8a53-27be7f3d8cd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.527937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-01cc974e-db1a-4be5-8a53-27be7f3d8cd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:53.536442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-01cc974e-db1a-4be5-8a53-27be7f3d8cd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:53.537901 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-01cc974e-db1a-4be5-8a53-27be7f3d8cd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:53.539031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-01cc974e-db1a-4be5-8a53-27be7f3d8cd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085083 Sep 01 05:33:53.540161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1008/1933] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:53.737099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e67bcfdd-ef60-42e1-a376-44748a86e270 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:53.737636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e67bcfdd-ef60-42e1-a376-44748a86e270 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:53.744162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e67bcfdd-ef60-42e1-a376-44748a86e270 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.744634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e67bcfdd-ef60-42e1-a376-44748a86e270 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.745090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e67bcfdd-ef60-42e1-a376-44748a86e270 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.745766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e67bcfdd-ef60-42e1-a376-44748a86e270 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.746209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e67bcfdd-ef60-42e1-a376-44748a86e270 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.746621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e67bcfdd-ef60-42e1-a376-44748a86e270 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.879179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e67bcfdd-ef60-42e1-a376-44748a86e270 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:53.887587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e67bcfdd-ef60-42e1-a376-44748a86e270 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154444 Sep 01 05:33:53.888147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 926/1934] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:54.562168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d59f1cb6-0842-43f9-ae86-411aa13e3973 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:54.562807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d59f1cb6-0842-43f9-ae86-411aa13e3973 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:54.569214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d59f1cb6-0842-43f9-ae86-411aa13e3973 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.569688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d59f1cb6-0842-43f9-ae86-411aa13e3973 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.570144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d59f1cb6-0842-43f9-ae86-411aa13e3973 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:54.571508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d59f1cb6-0842-43f9-ae86-411aa13e3973 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.571974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d59f1cb6-0842-43f9-ae86-411aa13e3973 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.572420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d59f1cb6-0842-43f9-ae86-411aa13e3973 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:54.633970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d59f1cb6-0842-43f9-ae86-411aa13e3973 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:54.636272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:54.643818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d59f1cb6-0842-43f9-ae86-411aa13e3973 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:54.645283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d59f1cb6-0842-43f9-ae86-411aa13e3973 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:54.646451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d59f1cb6-0842-43f9-ae86-411aa13e3973 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088163 Sep 01 05:33:54.647009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1009/1935] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:54.909574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c99cf139-fcb7-402a-9e1a-86785526454a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:54.910184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c99cf139-fcb7-402a-9e1a-86785526454a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:54.917294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c99cf139-fcb7-402a-9e1a-86785526454a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.917779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c99cf139-fcb7-402a-9e1a-86785526454a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.918214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c99cf139-fcb7-402a-9e1a-86785526454a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:54.918899 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c99cf139-fcb7-402a-9e1a-86785526454a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.919600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c99cf139-fcb7-402a-9e1a-86785526454a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.920023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c99cf139-fcb7-402a-9e1a-86785526454a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:55.049073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c99cf139-fcb7-402a-9e1a-86785526454a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:55.058975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c99cf139-fcb7-402a-9e1a-86785526454a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153312 Sep 01 05:33:55.059540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 927/1936] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:55.668835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bc582dc3-f58d-4bea-a637-4ebf4204890c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:55.669712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bc582dc3-f58d-4bea-a637-4ebf4204890c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:55.676035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc582dc3-f58d-4bea-a637-4ebf4204890c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:55.676507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc582dc3-f58d-4bea-a637-4ebf4204890c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:55.676968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc582dc3-f58d-4bea-a637-4ebf4204890c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:55.677647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc582dc3-f58d-4bea-a637-4ebf4204890c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:55.678091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc582dc3-f58d-4bea-a637-4ebf4204890c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:55.678505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc582dc3-f58d-4bea-a637-4ebf4204890c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:55.741130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bc582dc3-f58d-4bea-a637-4ebf4204890c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:55.749581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bc582dc3-f58d-4bea-a637-4ebf4204890c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:55.751006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bc582dc3-f58d-4bea-a637-4ebf4204890c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:55.752125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bc582dc3-f58d-4bea-a637-4ebf4204890c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087491 Sep 01 05:33:55.752675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1010/1937] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:56.080348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a14bd870-46d2-481c-b1cf-e65011940ee7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:56.080904 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a14bd870-46d2-481c-b1cf-e65011940ee7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:56.087353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a14bd870-46d2-481c-b1cf-e65011940ee7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:56.087824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a14bd870-46d2-481c-b1cf-e65011940ee7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:56.088251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a14bd870-46d2-481c-b1cf-e65011940ee7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:56.088955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a14bd870-46d2-481c-b1cf-e65011940ee7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:56.089403 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a14bd870-46d2-481c-b1cf-e65011940ee7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:56.089849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a14bd870-46d2-481c-b1cf-e65011940ee7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:56.220651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a14bd870-46d2-481c-b1cf-e65011940ee7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:56.229987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a14bd870-46d2-481c-b1cf-e65011940ee7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153558 Sep 01 05:33:56.230552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 928/1938] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:56.776318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-37e41caf-fba3-4f11-8c06-f092ea18ae31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:56.776950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-37e41caf-fba3-4f11-8c06-f092ea18ae31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:56.783348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37e41caf-fba3-4f11-8c06-f092ea18ae31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:56.783819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37e41caf-fba3-4f11-8c06-f092ea18ae31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:56.784251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37e41caf-fba3-4f11-8c06-f092ea18ae31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:56.784954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37e41caf-fba3-4f11-8c06-f092ea18ae31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:56.785399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37e41caf-fba3-4f11-8c06-f092ea18ae31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:56.785809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37e41caf-fba3-4f11-8c06-f092ea18ae31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:56.850518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-37e41caf-fba3-4f11-8c06-f092ea18ae31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:56.860039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-37e41caf-fba3-4f11-8c06-f092ea18ae31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:56.861513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-37e41caf-fba3-4f11-8c06-f092ea18ae31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:56.862656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-37e41caf-fba3-4f11-8c06-f092ea18ae31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090935 Sep 01 05:33:56.863210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1011/1939] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:57.251421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8f225aaa-b73b-4469-a5cd-4b9e8e496bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:57.252029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8f225aaa-b73b-4469-a5cd-4b9e8e496bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:57.258681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f225aaa-b73b-4469-a5cd-4b9e8e496bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:57.259155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f225aaa-b73b-4469-a5cd-4b9e8e496bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:57.259583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f225aaa-b73b-4469-a5cd-4b9e8e496bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:57.260257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f225aaa-b73b-4469-a5cd-4b9e8e496bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:57.260700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f225aaa-b73b-4469-a5cd-4b9e8e496bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:57.261138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8f225aaa-b73b-4469-a5cd-4b9e8e496bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:57.388980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8f225aaa-b73b-4469-a5cd-4b9e8e496bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:57.397162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8f225aaa-b73b-4469-a5cd-4b9e8e496bc1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149583 Sep 01 05:33:57.397738 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 929/1940] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:57 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:57.884694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-21c508c0-737d-4e33-a519-087cb08cd65d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:57.885364 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-21c508c0-737d-4e33-a519-087cb08cd65d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:57.891891 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21c508c0-737d-4e33-a519-087cb08cd65d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:57.892373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21c508c0-737d-4e33-a519-087cb08cd65d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:57.892823 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21c508c0-737d-4e33-a519-087cb08cd65d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:57.893521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21c508c0-737d-4e33-a519-087cb08cd65d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:57.893968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21c508c0-737d-4e33-a519-087cb08cd65d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:57.894387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21c508c0-737d-4e33-a519-087cb08cd65d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:57.956859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-21c508c0-737d-4e33-a519-087cb08cd65d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:57.965587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-21c508c0-737d-4e33-a519-087cb08cd65d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:57.967031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-21c508c0-737d-4e33-a519-087cb08cd65d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:57.968169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-21c508c0-737d-4e33-a519-087cb08cd65d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087416 Sep 01 05:33:57.968722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1012/1941] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:58.419024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-721c531c-65c5-4040-9a86-cb4358d4ea79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:58.419623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-721c531c-65c5-4040-9a86-cb4358d4ea79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:58.426080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-721c531c-65c5-4040-9a86-cb4358d4ea79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:58.426556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-721c531c-65c5-4040-9a86-cb4358d4ea79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:58.426983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-721c531c-65c5-4040-9a86-cb4358d4ea79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:58.427651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-721c531c-65c5-4040-9a86-cb4358d4ea79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:58.428102 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-721c531c-65c5-4040-9a86-cb4358d4ea79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:58.428515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-721c531c-65c5-4040-9a86-cb4358d4ea79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:58.556397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-721c531c-65c5-4040-9a86-cb4358d4ea79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:58.564488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-721c531c-65c5-4040-9a86-cb4358d4ea79 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149600 Sep 01 05:33:58.565081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 930/1942] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:58 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:58.991389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0a75edeb-6426-43b4-ac51-fcd8bbe06d36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:58.992025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0a75edeb-6426-43b4-ac51-fcd8bbe06d36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:58.998886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a75edeb-6426-43b4-ac51-fcd8bbe06d36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:58.999357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a75edeb-6426-43b4-ac51-fcd8bbe06d36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:58.999785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a75edeb-6426-43b4-ac51-fcd8bbe06d36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:59.000459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a75edeb-6426-43b4-ac51-fcd8bbe06d36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:59.000936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a75edeb-6426-43b4-ac51-fcd8bbe06d36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:59.001353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a75edeb-6426-43b4-ac51-fcd8bbe06d36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:59.062197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0a75edeb-6426-43b4-ac51-fcd8bbe06d36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:59.071804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0a75edeb-6426-43b4-ac51-fcd8bbe06d36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:59.073285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0a75edeb-6426-43b4-ac51-fcd8bbe06d36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:59.074425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0a75edeb-6426-43b4-ac51-fcd8bbe06d36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086996 Sep 01 05:33:59.074988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1013/1943] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:59.585540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f95af65b-94d7-4ca1-8a4d-4e000a0c5650 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:59.586799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f95af65b-94d7-4ca1-8a4d-4e000a0c5650 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:59.593189 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f95af65b-94d7-4ca1-8a4d-4e000a0c5650 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:59.593662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f95af65b-94d7-4ca1-8a4d-4e000a0c5650 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:59.594093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f95af65b-94d7-4ca1-8a4d-4e000a0c5650 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:59.594768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f95af65b-94d7-4ca1-8a4d-4e000a0c5650 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:59.595211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f95af65b-94d7-4ca1-8a4d-4e000a0c5650 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:59.595624 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f95af65b-94d7-4ca1-8a4d-4e000a0c5650 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:59.598126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:59.728041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f95af65b-94d7-4ca1-8a4d-4e000a0c5650 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:59.736151 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f95af65b-94d7-4ca1-8a4d-4e000a0c5650 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154477 Sep 01 05:33:59.736721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 931/1944] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:59 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:00.096239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3f070d12-119f-44d7-9918-7285b94ae638 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:00.096879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3f070d12-119f-44d7-9918-7285b94ae638 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:00.104094 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f070d12-119f-44d7-9918-7285b94ae638 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:00.104575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f070d12-119f-44d7-9918-7285b94ae638 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:00.105030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f070d12-119f-44d7-9918-7285b94ae638 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:00.105715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f070d12-119f-44d7-9918-7285b94ae638 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:00.106161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f070d12-119f-44d7-9918-7285b94ae638 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:00.106578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f070d12-119f-44d7-9918-7285b94ae638 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:00.167866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3f070d12-119f-44d7-9918-7285b94ae638 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:00.176583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3f070d12-119f-44d7-9918-7285b94ae638 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:00.178052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3f070d12-119f-44d7-9918-7285b94ae638 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:00.179191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3f070d12-119f-44d7-9918-7285b94ae638 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086909 Sep 01 05:34:00.180453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1014/1945] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:00 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:00.756919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0e8b402c-9a23-47d5-b6b6-82cc7f469b69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:00.757563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0e8b402c-9a23-47d5-b6b6-82cc7f469b69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:00.764871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e8b402c-9a23-47d5-b6b6-82cc7f469b69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:00.765354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e8b402c-9a23-47d5-b6b6-82cc7f469b69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:00.765788 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e8b402c-9a23-47d5-b6b6-82cc7f469b69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:00.766472 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e8b402c-9a23-47d5-b6b6-82cc7f469b69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:00.766922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e8b402c-9a23-47d5-b6b6-82cc7f469b69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:00.767339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e8b402c-9a23-47d5-b6b6-82cc7f469b69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:00.896111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0e8b402c-9a23-47d5-b6b6-82cc7f469b69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:00.905213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0e8b402c-9a23-47d5-b6b6-82cc7f469b69 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152207 Sep 01 05:34:00.905774 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 932/1946] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:01.202306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2c1c333c-820b-421c-a95b-32404841bf36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:01.202914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2c1c333c-820b-421c-a95b-32404841bf36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:01.209263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c1c333c-820b-421c-a95b-32404841bf36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:01.209733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c1c333c-820b-421c-a95b-32404841bf36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:01.210158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c1c333c-820b-421c-a95b-32404841bf36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:01.211338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c1c333c-820b-421c-a95b-32404841bf36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:01.211776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c1c333c-820b-421c-a95b-32404841bf36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:01.212187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c1c333c-820b-421c-a95b-32404841bf36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:01.276348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2c1c333c-820b-421c-a95b-32404841bf36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:01.284768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2c1c333c-820b-421c-a95b-32404841bf36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:01.286236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2c1c333c-820b-421c-a95b-32404841bf36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:01.287358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2c1c333c-820b-421c-a95b-32404841bf36 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088971 Sep 01 05:34:01.287906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1015/1947] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:01.926348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b6dcf4f7-5e67-47ea-9160-e974088003bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:01.926966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b6dcf4f7-5e67-47ea-9160-e974088003bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:01.934448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6dcf4f7-5e67-47ea-9160-e974088003bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:01.934932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6dcf4f7-5e67-47ea-9160-e974088003bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:01.935367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6dcf4f7-5e67-47ea-9160-e974088003bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:01.936047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6dcf4f7-5e67-47ea-9160-e974088003bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:01.936496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6dcf4f7-5e67-47ea-9160-e974088003bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:01.936957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6dcf4f7-5e67-47ea-9160-e974088003bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.072889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b6dcf4f7-5e67-47ea-9160-e974088003bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.081030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b6dcf4f7-5e67-47ea-9160-e974088003bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.158574 Sep 01 05:34:02.081589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 933/1948] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:01 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:02.311303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-25b7199c-c7d2-48ea-96e9-66f32011b989 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:02.311830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-25b7199c-c7d2-48ea-96e9-66f32011b989 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:02.318181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25b7199c-c7d2-48ea-96e9-66f32011b989 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.318657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25b7199c-c7d2-48ea-96e9-66f32011b989 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.319080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25b7199c-c7d2-48ea-96e9-66f32011b989 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.319754 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25b7199c-c7d2-48ea-96e9-66f32011b989 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.320194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25b7199c-c7d2-48ea-96e9-66f32011b989 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.320615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-25b7199c-c7d2-48ea-96e9-66f32011b989 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.381612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-25b7199c-c7d2-48ea-96e9-66f32011b989 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.390237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-25b7199c-c7d2-48ea-96e9-66f32011b989 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.391682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-25b7199c-c7d2-48ea-96e9-66f32011b989 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.392847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-25b7199c-c7d2-48ea-96e9-66f32011b989 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085539 Sep 01 05:34:02.393408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1016/1949] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:03.102668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6ab30a33-7ac0-479f-aefd-7f79ba691264 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:03.103305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6ab30a33-7ac0-479f-aefd-7f79ba691264 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:03.109750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ab30a33-7ac0-479f-aefd-7f79ba691264 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:03.110232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ab30a33-7ac0-479f-aefd-7f79ba691264 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:03.110668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ab30a33-7ac0-479f-aefd-7f79ba691264 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.111355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ab30a33-7ac0-479f-aefd-7f79ba691264 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:03.111809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ab30a33-7ac0-479f-aefd-7f79ba691264 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:03.112235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ab30a33-7ac0-479f-aefd-7f79ba691264 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.240755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6ab30a33-7ac0-479f-aefd-7f79ba691264 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:03.249650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6ab30a33-7ac0-479f-aefd-7f79ba691264 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151409 Sep 01 05:34:03.250226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 934/1950] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:03 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:03.416198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-62cafe61-ae01-4d2b-b085-ea04638410d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:03.416835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-62cafe61-ae01-4d2b-b085-ea04638410d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:03.423442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62cafe61-ae01-4d2b-b085-ea04638410d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:03.423926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62cafe61-ae01-4d2b-b085-ea04638410d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:03.424360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62cafe61-ae01-4d2b-b085-ea04638410d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.425072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62cafe61-ae01-4d2b-b085-ea04638410d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:03.425524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62cafe61-ae01-4d2b-b085-ea04638410d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:03.425950 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62cafe61-ae01-4d2b-b085-ea04638410d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.489611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-62cafe61-ae01-4d2b-b085-ea04638410d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:03.498073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-62cafe61-ae01-4d2b-b085-ea04638410d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:03.499495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-62cafe61-ae01-4d2b-b085-ea04638410d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:03.500615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-62cafe61-ae01-4d2b-b085-ea04638410d9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089219 Sep 01 05:34:03.501208 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1017/1951] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:04.271181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-392b207f-4057-4620-8774-f1fd54cbfd41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:04.271739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-392b207f-4057-4620-8774-f1fd54cbfd41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:04.278719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-392b207f-4057-4620-8774-f1fd54cbfd41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.279200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-392b207f-4057-4620-8774-f1fd54cbfd41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.279632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-392b207f-4057-4620-8774-f1fd54cbfd41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.280311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-392b207f-4057-4620-8774-f1fd54cbfd41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.280762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-392b207f-4057-4620-8774-f1fd54cbfd41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.281208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-392b207f-4057-4620-8774-f1fd54cbfd41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.412032 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-392b207f-4057-4620-8774-f1fd54cbfd41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:04.420562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-392b207f-4057-4620-8774-f1fd54cbfd41 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153363 Sep 01 05:34:04.421201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 935/1952] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:04.523131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3ecbc74d-fe5e-4be6-9941-0033cac537bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:04.523656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3ecbc74d-fe5e-4be6-9941-0033cac537bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:04.530562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ecbc74d-fe5e-4be6-9941-0033cac537bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.531039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ecbc74d-fe5e-4be6-9941-0033cac537bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.531465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ecbc74d-fe5e-4be6-9941-0033cac537bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.532145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ecbc74d-fe5e-4be6-9941-0033cac537bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.532588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ecbc74d-fe5e-4be6-9941-0033cac537bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.533237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ecbc74d-fe5e-4be6-9941-0033cac537bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.603603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3ecbc74d-fe5e-4be6-9941-0033cac537bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:04.614771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3ecbc74d-fe5e-4be6-9941-0033cac537bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:04.618374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3ecbc74d-fe5e-4be6-9941-0033cac537bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:04.620332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3ecbc74d-fe5e-4be6-9941-0033cac537bb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.100658 Sep 01 05:34:04.620947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1018/1953] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:05.442881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d584991b-63d0-4209-9882-6db99260dc45 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:05.443503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d584991b-63d0-4209-9882-6db99260dc45 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:05.450739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d584991b-63d0-4209-9882-6db99260dc45 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:05.451215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d584991b-63d0-4209-9882-6db99260dc45 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:05.451650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d584991b-63d0-4209-9882-6db99260dc45 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:05.452330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d584991b-63d0-4209-9882-6db99260dc45 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:05.452790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d584991b-63d0-4209-9882-6db99260dc45 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:05.453208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d584991b-63d0-4209-9882-6db99260dc45 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:05.587447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d584991b-63d0-4209-9882-6db99260dc45 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:05.595606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d584991b-63d0-4209-9882-6db99260dc45 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156731 Sep 01 05:34:05.596173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 936/1954] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:05 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:05.643431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-77a1b9dc-770f-43a5-998d-72b731f40d2a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:05.644058 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-77a1b9dc-770f-43a5-998d-72b731f40d2a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:05.650734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77a1b9dc-770f-43a5-998d-72b731f40d2a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:05.651218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77a1b9dc-770f-43a5-998d-72b731f40d2a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:05.651655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77a1b9dc-770f-43a5-998d-72b731f40d2a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:05.652357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77a1b9dc-770f-43a5-998d-72b731f40d2a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:05.652850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77a1b9dc-770f-43a5-998d-72b731f40d2a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:05.653276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77a1b9dc-770f-43a5-998d-72b731f40d2a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:05.719172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-77a1b9dc-770f-43a5-998d-72b731f40d2a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:05.728391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-77a1b9dc-770f-43a5-998d-72b731f40d2a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:05.729878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-77a1b9dc-770f-43a5-998d-72b731f40d2a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:05.731026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-77a1b9dc-770f-43a5-998d-72b731f40d2a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091544 Sep 01 05:34:05.731582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1019/1955] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:06.625062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5d98e433-0cff-453a-b7a2-4bc4aea7566d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:06.625703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5d98e433-0cff-453a-b7a2-4bc4aea7566d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:06.632086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d98e433-0cff-453a-b7a2-4bc4aea7566d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.633900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d98e433-0cff-453a-b7a2-4bc4aea7566d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.634354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d98e433-0cff-453a-b7a2-4bc4aea7566d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.635033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d98e433-0cff-453a-b7a2-4bc4aea7566d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.635485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d98e433-0cff-453a-b7a2-4bc4aea7566d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.635908 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d98e433-0cff-453a-b7a2-4bc4aea7566d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.752618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-72304ed9-b5ca-4f12-b0e0-b1e9772c4f92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:06.753254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-72304ed9-b5ca-4f12-b0e0-b1e9772c4f92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:06.759572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72304ed9-b5ca-4f12-b0e0-b1e9772c4f92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.760060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72304ed9-b5ca-4f12-b0e0-b1e9772c4f92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.760498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72304ed9-b5ca-4f12-b0e0-b1e9772c4f92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.761214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72304ed9-b5ca-4f12-b0e0-b1e9772c4f92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.761690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72304ed9-b5ca-4f12-b0e0-b1e9772c4f92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.762123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72304ed9-b5ca-4f12-b0e0-b1e9772c4f92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.764828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5d98e433-0cff-453a-b7a2-4bc4aea7566d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:06.772913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5d98e433-0cff-453a-b7a2-4bc4aea7566d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151872 Sep 01 05:34:06.773764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 937/1956] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:06 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:06.824014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72304ed9-b5ca-4f12-b0e0-b1e9772c4f92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:06.832515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72304ed9-b5ca-4f12-b0e0-b1e9772c4f92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:06.834002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72304ed9-b5ca-4f12-b0e0-b1e9772c4f92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:06.835143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-72304ed9-b5ca-4f12-b0e0-b1e9772c4f92 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086460 Sep 01 05:34:06.835711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1020/1957] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:34:07.793524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5338b470-5f04-474e-bad1-364b82a43066 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:07.794135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5338b470-5f04-474e-bad1-364b82a43066 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:07.800533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5338b470-5f04-474e-bad1-364b82a43066 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:07.801043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5338b470-5f04-474e-bad1-364b82a43066 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:07.801475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5338b470-5f04-474e-bad1-364b82a43066 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:07.802152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5338b470-5f04-474e-bad1-364b82a43066 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:07.802601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5338b470-5f04-474e-bad1-364b82a43066 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:07.803019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5338b470-5f04-474e-bad1-364b82a43066 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:07.858091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6f073a0f-40e9-48ac-9839-70602d51b37f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:07.858730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6f073a0f-40e9-48ac-9839-70602d51b37f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:07.864977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f073a0f-40e9-48ac-9839-70602d51b37f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:07.865453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f073a0f-40e9-48ac-9839-70602d51b37f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:07.865882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f073a0f-40e9-48ac-9839-70602d51b37f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:07.867086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f073a0f-40e9-48ac-9839-70602d51b37f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:07.867784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f073a0f-40e9-48ac-9839-70602d51b37f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:07.867941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f073a0f-40e9-48ac-9839-70602d51b37f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:07.931699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6f073a0f-40e9-48ac-9839-70602d51b37f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:07.940504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6f073a0f-40e9-48ac-9839-70602d51b37f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:07.941984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6f073a0f-40e9-48ac-9839-70602d51b37f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:07.943162 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6f073a0f-40e9-48ac-9839-70602d51b37f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089008 Sep 01 05:34:07.943613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5338b470-5f04-474e-bad1-364b82a43066 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:07.943745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1021/1958] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:07 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:34:07.952805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5338b470-5f04-474e-bad1-364b82a43066 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.163493 Sep 01 05:34:07.953446 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 938/1959] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:07 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:08.966516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-09db353a-a362-4dc8-914e-c4dd4d1879fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:08.967131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-09db353a-a362-4dc8-914e-c4dd4d1879fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:08.972537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c1d9da10-1f07-4f8a-830c-4cf24c18df92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:08.973175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c1d9da10-1f07-4f8a-830c-4cf24c18df92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:08.973737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09db353a-a362-4dc8-914e-c4dd4d1879fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:08.974220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09db353a-a362-4dc8-914e-c4dd4d1879fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:08.974655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09db353a-a362-4dc8-914e-c4dd4d1879fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:08.975351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09db353a-a362-4dc8-914e-c4dd4d1879fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:08.976313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09db353a-a362-4dc8-914e-c4dd4d1879fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:08.976739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09db353a-a362-4dc8-914e-c4dd4d1879fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:08.980723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1d9da10-1f07-4f8a-830c-4cf24c18df92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:08.981244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1d9da10-1f07-4f8a-830c-4cf24c18df92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:08.981680 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1d9da10-1f07-4f8a-830c-4cf24c18df92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:08.982367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1d9da10-1f07-4f8a-830c-4cf24c18df92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:08.982817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1d9da10-1f07-4f8a-830c-4cf24c18df92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:08.983239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c1d9da10-1f07-4f8a-830c-4cf24c18df92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:09.039544 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-09db353a-a362-4dc8-914e-c4dd4d1879fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:09.048355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-09db353a-a362-4dc8-914e-c4dd4d1879fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:09.050308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-09db353a-a362-4dc8-914e-c4dd4d1879fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:09.050957 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-09db353a-a362-4dc8-914e-c4dd4d1879fa tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088418 Sep 01 05:34:09.051522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1022/1960] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:09.115228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c1d9da10-1f07-4f8a-830c-4cf24c18df92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:09.124031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c1d9da10-1f07-4f8a-830c-4cf24c18df92 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155293 Sep 01 05:34:09.124816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 939/1961] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:08 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:10.076078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-64dc9645-5037-4484-a413-cd30e6df4f38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:10.076685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-64dc9645-5037-4484-a413-cd30e6df4f38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:10.083019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-64dc9645-5037-4484-a413-cd30e6df4f38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:10.083488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-64dc9645-5037-4484-a413-cd30e6df4f38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:10.083914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-64dc9645-5037-4484-a413-cd30e6df4f38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:10.084583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-64dc9645-5037-4484-a413-cd30e6df4f38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:10.085049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-64dc9645-5037-4484-a413-cd30e6df4f38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:10.085467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-64dc9645-5037-4484-a413-cd30e6df4f38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:10.145828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6877942c-f267-4d87-a22e-1b5ce5c511a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:10.146387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6877942c-f267-4d87-a22e-1b5ce5c511a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:10.150764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-64dc9645-5037-4484-a413-cd30e6df4f38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:10.152874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6877942c-f267-4d87-a22e-1b5ce5c511a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:10.153354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6877942c-f267-4d87-a22e-1b5ce5c511a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:10.153782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6877942c-f267-4d87-a22e-1b5ce5c511a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:10.154486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6877942c-f267-4d87-a22e-1b5ce5c511a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:10.154909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6877942c-f267-4d87-a22e-1b5ce5c511a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:10.155322 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6877942c-f267-4d87-a22e-1b5ce5c511a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:10.159471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-64dc9645-5037-4484-a413-cd30e6df4f38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:10.160945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-64dc9645-5037-4484-a413-cd30e6df4f38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:10.162097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-64dc9645-5037-4484-a413-cd30e6df4f38 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089996 Sep 01 05:34:10.162659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1023/1962] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:10 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:10.285403 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6877942c-f267-4d87-a22e-1b5ce5c511a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:10.294191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6877942c-f267-4d87-a22e-1b5ce5c511a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152384 Sep 01 05:34:10.294756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 940/1963] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:11.185278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0303c050-4cb6-435f-93ce-348462baa11b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:11.185826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0303c050-4cb6-435f-93ce-348462baa11b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:11.192082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0303c050-4cb6-435f-93ce-348462baa11b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:11.192555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0303c050-4cb6-435f-93ce-348462baa11b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:11.193029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0303c050-4cb6-435f-93ce-348462baa11b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:11.193701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0303c050-4cb6-435f-93ce-348462baa11b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:11.194142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0303c050-4cb6-435f-93ce-348462baa11b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:11.194555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0303c050-4cb6-435f-93ce-348462baa11b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:11.257240 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0303c050-4cb6-435f-93ce-348462baa11b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:11.266443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0303c050-4cb6-435f-93ce-348462baa11b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:11.267860 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0303c050-4cb6-435f-93ce-348462baa11b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:11.269024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0303c050-4cb6-435f-93ce-348462baa11b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087819 Sep 01 05:34:11.269580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1024/1964] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:11.315701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2089d94f-b835-4a91-a45f-fb4029cacbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:11.316303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2089d94f-b835-4a91-a45f-fb4029cacbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:11.323748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2089d94f-b835-4a91-a45f-fb4029cacbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:11.324227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2089d94f-b835-4a91-a45f-fb4029cacbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:11.324657 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2089d94f-b835-4a91-a45f-fb4029cacbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:11.325359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2089d94f-b835-4a91-a45f-fb4029cacbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:11.325804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2089d94f-b835-4a91-a45f-fb4029cacbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:11.326219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2089d94f-b835-4a91-a45f-fb4029cacbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:11.454234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2089d94f-b835-4a91-a45f-fb4029cacbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:11.462927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2089d94f-b835-4a91-a45f-fb4029cacbc9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151006 Sep 01 05:34:11.463476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 941/1965] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:11 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:12.294170 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a7445f3b-5b92-4255-96ee-501fbd615114 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:12.294743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a7445f3b-5b92-4255-96ee-501fbd615114 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:12.301154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7445f3b-5b92-4255-96ee-501fbd615114 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:12.301628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7445f3b-5b92-4255-96ee-501fbd615114 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:12.302055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7445f3b-5b92-4255-96ee-501fbd615114 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:12.302733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7445f3b-5b92-4255-96ee-501fbd615114 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:12.303171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7445f3b-5b92-4255-96ee-501fbd615114 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:12.303580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7445f3b-5b92-4255-96ee-501fbd615114 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:12.365055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a7445f3b-5b92-4255-96ee-501fbd615114 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:12.374222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a7445f3b-5b92-4255-96ee-501fbd615114 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:12.375639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a7445f3b-5b92-4255-96ee-501fbd615114 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:12.376758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a7445f3b-5b92-4255-96ee-501fbd615114 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087479 Sep 01 05:34:12.377419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1025/1966] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:12 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:12.484124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c3093e1c-e043-4db1-8505-d7a645f5bcf9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:12.484736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c3093e1c-e043-4db1-8505-d7a645f5bcf9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:12.491084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3093e1c-e043-4db1-8505-d7a645f5bcf9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:12.491554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3093e1c-e043-4db1-8505-d7a645f5bcf9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:12.491980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3093e1c-e043-4db1-8505-d7a645f5bcf9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:12.493271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3093e1c-e043-4db1-8505-d7a645f5bcf9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:12.493743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3093e1c-e043-4db1-8505-d7a645f5bcf9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:12.494159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c3093e1c-e043-4db1-8505-d7a645f5bcf9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:12.622126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c3093e1c-e043-4db1-8505-d7a645f5bcf9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:12.630209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c3093e1c-e043-4db1-8505-d7a645f5bcf9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150137 Sep 01 05:34:12.630790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 942/1967] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:12 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:13.400482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bfba5ee2-f65a-494c-aecd-4bb4c2355a84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:13.401191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bfba5ee2-f65a-494c-aecd-4bb4c2355a84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:13.407585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfba5ee2-f65a-494c-aecd-4bb4c2355a84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:13.408061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfba5ee2-f65a-494c-aecd-4bb4c2355a84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:13.408494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfba5ee2-f65a-494c-aecd-4bb4c2355a84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:13.409205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfba5ee2-f65a-494c-aecd-4bb4c2355a84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:13.409656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfba5ee2-f65a-494c-aecd-4bb4c2355a84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:13.410077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bfba5ee2-f65a-494c-aecd-4bb4c2355a84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:13.425465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:13.472734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bfba5ee2-f65a-494c-aecd-4bb4c2355a84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:13.481379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bfba5ee2-f65a-494c-aecd-4bb4c2355a84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:13.482794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bfba5ee2-f65a-494c-aecd-4bb4c2355a84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:13.483954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bfba5ee2-f65a-494c-aecd-4bb4c2355a84 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088387 Sep 01 05:34:13.484507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1026/1968] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:13 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:13.652686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b9ab345d-0ffc-49cd-a5ef-835176bcacf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:13.653261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b9ab345d-0ffc-49cd-a5ef-835176bcacf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:13.659133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9ab345d-0ffc-49cd-a5ef-835176bcacf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:13.659605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9ab345d-0ffc-49cd-a5ef-835176bcacf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:13.660034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9ab345d-0ffc-49cd-a5ef-835176bcacf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:13.660706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9ab345d-0ffc-49cd-a5ef-835176bcacf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:13.661179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9ab345d-0ffc-49cd-a5ef-835176bcacf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:13.661596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b9ab345d-0ffc-49cd-a5ef-835176bcacf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:13.793480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b9ab345d-0ffc-49cd-a5ef-835176bcacf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:13.801698 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b9ab345d-0ffc-49cd-a5ef-835176bcacf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153976 Sep 01 05:34:13.802264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 943/1969] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:14.505558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8b4b74da-8111-4b6a-9548-a594415a4843 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:14.506173 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8b4b74da-8111-4b6a-9548-a594415a4843 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:14.513115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b4b74da-8111-4b6a-9548-a594415a4843 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:14.513593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b4b74da-8111-4b6a-9548-a594415a4843 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:14.514042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b4b74da-8111-4b6a-9548-a594415a4843 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:14.514719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b4b74da-8111-4b6a-9548-a594415a4843 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:14.515176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b4b74da-8111-4b6a-9548-a594415a4843 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:14.515600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b4b74da-8111-4b6a-9548-a594415a4843 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:14.579622 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8b4b74da-8111-4b6a-9548-a594415a4843 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:14.588694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8b4b74da-8111-4b6a-9548-a594415a4843 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:14.590193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8b4b74da-8111-4b6a-9548-a594415a4843 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:14.591310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8b4b74da-8111-4b6a-9548-a594415a4843 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089771 Sep 01 05:34:14.591872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1027/1970] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:34:14.823889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fc76b3a5-a648-48dd-896a-4e9caf150d7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:14.824442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fc76b3a5-a648-48dd-896a-4e9caf150d7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:14.830821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fc76b3a5-a648-48dd-896a-4e9caf150d7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:14.831305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fc76b3a5-a648-48dd-896a-4e9caf150d7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:14.831737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fc76b3a5-a648-48dd-896a-4e9caf150d7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:14.832423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fc76b3a5-a648-48dd-896a-4e9caf150d7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:14.832905 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fc76b3a5-a648-48dd-896a-4e9caf150d7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:14.833327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fc76b3a5-a648-48dd-896a-4e9caf150d7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:14.963163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fc76b3a5-a648-48dd-896a-4e9caf150d7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:14.971327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fc76b3a5-a648-48dd-896a-4e9caf150d7f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151964 Sep 01 05:34:14.971894 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 944/1971] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:14 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:15.613957 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-58e9fef4-9418-4c6b-ae21-b0cae755b809 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:15.614596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-58e9fef4-9418-4c6b-ae21-b0cae755b809 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:15.622025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58e9fef4-9418-4c6b-ae21-b0cae755b809 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:15.622503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58e9fef4-9418-4c6b-ae21-b0cae755b809 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:15.622934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58e9fef4-9418-4c6b-ae21-b0cae755b809 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:15.623619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58e9fef4-9418-4c6b-ae21-b0cae755b809 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:15.624067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58e9fef4-9418-4c6b-ae21-b0cae755b809 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:15.624486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58e9fef4-9418-4c6b-ae21-b0cae755b809 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:15.687199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-58e9fef4-9418-4c6b-ae21-b0cae755b809 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:15.696346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-58e9fef4-9418-4c6b-ae21-b0cae755b809 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:15.697847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-58e9fef4-9418-4c6b-ae21-b0cae755b809 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:15.698983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-58e9fef4-9418-4c6b-ae21-b0cae755b809 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088944 Sep 01 05:34:15.699539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1028/1972] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:15.991832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3f613f1c-2c71-4c46-ac95-8d2992e5f8db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:15.992839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3f613f1c-2c71-4c46-ac95-8d2992e5f8db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:15.999277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f613f1c-2c71-4c46-ac95-8d2992e5f8db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:15.999747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f613f1c-2c71-4c46-ac95-8d2992e5f8db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:16.000172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f613f1c-2c71-4c46-ac95-8d2992e5f8db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:16.000867 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f613f1c-2c71-4c46-ac95-8d2992e5f8db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:16.001314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f613f1c-2c71-4c46-ac95-8d2992e5f8db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:16.001730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f613f1c-2c71-4c46-ac95-8d2992e5f8db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:16.132313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3f613f1c-2c71-4c46-ac95-8d2992e5f8db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:16.141238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3f613f1c-2c71-4c46-ac95-8d2992e5f8db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153260 Sep 01 05:34:16.141820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 945/1973] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:16.722421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b6be8c32-f132-4726-a877-e4d27159e314 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:16.723098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b6be8c32-f132-4726-a877-e4d27159e314 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:16.730615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6be8c32-f132-4726-a877-e4d27159e314 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:16.730819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6be8c32-f132-4726-a877-e4d27159e314 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:16.731172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6be8c32-f132-4726-a877-e4d27159e314 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:16.731991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6be8c32-f132-4726-a877-e4d27159e314 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:16.732418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6be8c32-f132-4726-a877-e4d27159e314 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:16.733570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6be8c32-f132-4726-a877-e4d27159e314 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:16.797762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b6be8c32-f132-4726-a877-e4d27159e314 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:16.806569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b6be8c32-f132-4726-a877-e4d27159e314 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:16.808007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b6be8c32-f132-4726-a877-e4d27159e314 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:16.809177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b6be8c32-f132-4726-a877-e4d27159e314 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090818 Sep 01 05:34:16.809741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1029/1974] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:16 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:17.162958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d54649e1-23f6-4085-82df-3efc235362ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:17.163610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d54649e1-23f6-4085-82df-3efc235362ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:17.171062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d54649e1-23f6-4085-82df-3efc235362ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:17.171546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d54649e1-23f6-4085-82df-3efc235362ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:17.171983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d54649e1-23f6-4085-82df-3efc235362ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:17.172672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d54649e1-23f6-4085-82df-3efc235362ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:17.173152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d54649e1-23f6-4085-82df-3efc235362ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:17.173577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d54649e1-23f6-4085-82df-3efc235362ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:17.304461 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d54649e1-23f6-4085-82df-3efc235362ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:17.312643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d54649e1-23f6-4085-82df-3efc235362ac tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153532 Sep 01 05:34:17.313238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 946/1975] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:17 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:17.831766 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6f500188-f4dd-4b4c-a990-24a50a8f8a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:17.832385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6f500188-f4dd-4b4c-a990-24a50a8f8a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:17.838973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f500188-f4dd-4b4c-a990-24a50a8f8a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:17.839453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f500188-f4dd-4b4c-a990-24a50a8f8a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:17.839896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f500188-f4dd-4b4c-a990-24a50a8f8a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:17.840579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f500188-f4dd-4b4c-a990-24a50a8f8a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:17.841053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f500188-f4dd-4b4c-a990-24a50a8f8a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:17.841477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6f500188-f4dd-4b4c-a990-24a50a8f8a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:17.907783 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6f500188-f4dd-4b4c-a990-24a50a8f8a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:17.917160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6f500188-f4dd-4b4c-a990-24a50a8f8a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:17.918906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6f500188-f4dd-4b4c-a990-24a50a8f8a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:17.920071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6f500188-f4dd-4b4c-a990-24a50a8f8a30 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.092200 Sep 01 05:34:17.926157 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1030/1976] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:17 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:18.334582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-80766998-3559-40ac-a034-526f5f04e6c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:18.335199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-80766998-3559-40ac-a034-526f5f04e6c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:18.338099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=52 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:18.343403 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80766998-3559-40ac-a034-526f5f04e6c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:18.343887 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80766998-3559-40ac-a034-526f5f04e6c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:18.344327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80766998-3559-40ac-a034-526f5f04e6c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:18.345029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80766998-3559-40ac-a034-526f5f04e6c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:18.345482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80766998-3559-40ac-a034-526f5f04e6c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:18.345908 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-80766998-3559-40ac-a034-526f5f04e6c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:18.475778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-80766998-3559-40ac-a034-526f5f04e6c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:18.478122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:18.485645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-80766998-3559-40ac-a034-526f5f04e6c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154846 Sep 01 05:34:18.488472 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 947/1977] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:18 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:18.943662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-af2e8cf6-213e-4c80-875f-275daa395aea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:18.944056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-af2e8cf6-213e-4c80-875f-275daa395aea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:18.951902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2e8cf6-213e-4c80-875f-275daa395aea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:18.952377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2e8cf6-213e-4c80-875f-275daa395aea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:18.952850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2e8cf6-213e-4c80-875f-275daa395aea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:18.953525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2e8cf6-213e-4c80-875f-275daa395aea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:18.953961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2e8cf6-213e-4c80-875f-275daa395aea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:18.954372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2e8cf6-213e-4c80-875f-275daa395aea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:19.019111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-af2e8cf6-213e-4c80-875f-275daa395aea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:19.028552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-af2e8cf6-213e-4c80-875f-275daa395aea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:19.030023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-af2e8cf6-213e-4c80-875f-275daa395aea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:19.031160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-af2e8cf6-213e-4c80-875f-275daa395aea tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.092755 Sep 01 05:34:19.031714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1031/1978] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:18 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:19.508684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f257d1b4-f33d-42ac-83a8-9e308e709021 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:19.509332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f257d1b4-f33d-42ac-83a8-9e308e709021 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:19.515839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f257d1b4-f33d-42ac-83a8-9e308e709021 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:19.516339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f257d1b4-f33d-42ac-83a8-9e308e709021 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:19.516757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f257d1b4-f33d-42ac-83a8-9e308e709021 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:19.517465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f257d1b4-f33d-42ac-83a8-9e308e709021 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:19.517912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f257d1b4-f33d-42ac-83a8-9e308e709021 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:19.518329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f257d1b4-f33d-42ac-83a8-9e308e709021 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:19.649313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f257d1b4-f33d-42ac-83a8-9e308e709021 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:19.657429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f257d1b4-f33d-42ac-83a8-9e308e709021 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153105 Sep 01 05:34:19.657992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 948/1979] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:19 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:20.054236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b6b60c2a-06be-46e2-8bdf-ed4c68be6e9e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:20.054863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b6b60c2a-06be-46e2-8bdf-ed4c68be6e9e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:20.057437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=56 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:20.062755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6b60c2a-06be-46e2-8bdf-ed4c68be6e9e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:20.063228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6b60c2a-06be-46e2-8bdf-ed4c68be6e9e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:20.063657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6b60c2a-06be-46e2-8bdf-ed4c68be6e9e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:20.064331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6b60c2a-06be-46e2-8bdf-ed4c68be6e9e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:20.064797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6b60c2a-06be-46e2-8bdf-ed4c68be6e9e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:20.065607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6b60c2a-06be-46e2-8bdf-ed4c68be6e9e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:20.130679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b6b60c2a-06be-46e2-8bdf-ed4c68be6e9e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:20.139202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b6b60c2a-06be-46e2-8bdf-ed4c68be6e9e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:20.140620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b6b60c2a-06be-46e2-8bdf-ed4c68be6e9e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:20.141777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b6b60c2a-06be-46e2-8bdf-ed4c68be6e9e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091502 Sep 01 05:34:20.142349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1032/1980] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:20.679870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a7888ac1-6cf2-44fb-8beb-9004821405a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:20.680480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a7888ac1-6cf2-44fb-8beb-9004821405a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:20.687153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7888ac1-6cf2-44fb-8beb-9004821405a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:20.687631 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7888ac1-6cf2-44fb-8beb-9004821405a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:20.688067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7888ac1-6cf2-44fb-8beb-9004821405a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:20.688747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7888ac1-6cf2-44fb-8beb-9004821405a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:20.689217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7888ac1-6cf2-44fb-8beb-9004821405a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:20.689632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7888ac1-6cf2-44fb-8beb-9004821405a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:20.819340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a7888ac1-6cf2-44fb-8beb-9004821405a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:20.828283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a7888ac1-6cf2-44fb-8beb-9004821405a4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152860 Sep 01 05:34:20.828863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 949/1981] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:20 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:21.165587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a579fdc0-3fe1-431e-bcd9-c5b99df74825 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:21.166222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a579fdc0-3fe1-431e-bcd9-c5b99df74825 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:21.173218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a579fdc0-3fe1-431e-bcd9-c5b99df74825 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:21.173687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a579fdc0-3fe1-431e-bcd9-c5b99df74825 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:21.174113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a579fdc0-3fe1-431e-bcd9-c5b99df74825 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:21.174977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a579fdc0-3fe1-431e-bcd9-c5b99df74825 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:21.175421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a579fdc0-3fe1-431e-bcd9-c5b99df74825 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:21.175835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a579fdc0-3fe1-431e-bcd9-c5b99df74825 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:21.237752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a579fdc0-3fe1-431e-bcd9-c5b99df74825 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:21.247307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a579fdc0-3fe1-431e-bcd9-c5b99df74825 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:21.248734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a579fdc0-3fe1-431e-bcd9-c5b99df74825 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:21.249887 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a579fdc0-3fe1-431e-bcd9-c5b99df74825 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088955 Sep 01 05:34:21.250441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1033/1982] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:21 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:21.849523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-41d190c2-2703-43b0-81bd-7e92fd29fdd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:21.850132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-41d190c2-2703-43b0-81bd-7e92fd29fdd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:21.856798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-41d190c2-2703-43b0-81bd-7e92fd29fdd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:21.857295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-41d190c2-2703-43b0-81bd-7e92fd29fdd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:21.857727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-41d190c2-2703-43b0-81bd-7e92fd29fdd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:21.858409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-41d190c2-2703-43b0-81bd-7e92fd29fdd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:21.858879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-41d190c2-2703-43b0-81bd-7e92fd29fdd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:21.859298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-41d190c2-2703-43b0-81bd-7e92fd29fdd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:21.991525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-41d190c2-2703-43b0-81bd-7e92fd29fdd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:21.999645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-41d190c2-2703-43b0-81bd-7e92fd29fdd5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154015 Sep 01 05:34:22.000208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 950/1983] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:21 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:22.272656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-75c4bcf8-e4f4-4a9f-be54-26164206c931 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:22.273633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-75c4bcf8-e4f4-4a9f-be54-26164206c931 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:22.279988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-75c4bcf8-e4f4-4a9f-be54-26164206c931 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:22.280461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-75c4bcf8-e4f4-4a9f-be54-26164206c931 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:22.280921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-75c4bcf8-e4f4-4a9f-be54-26164206c931 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:22.281600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-75c4bcf8-e4f4-4a9f-be54-26164206c931 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:22.282052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-75c4bcf8-e4f4-4a9f-be54-26164206c931 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:22.282473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-75c4bcf8-e4f4-4a9f-be54-26164206c931 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:22.346088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-75c4bcf8-e4f4-4a9f-be54-26164206c931 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:22.355342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-75c4bcf8-e4f4-4a9f-be54-26164206c931 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:22.356830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-75c4bcf8-e4f4-4a9f-be54-26164206c931 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:22.357972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-75c4bcf8-e4f4-4a9f-be54-26164206c931 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089209 Sep 01 05:34:22.358526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1034/1984] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:23.021701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-631b0c7f-2d90-456f-ace1-3f628e1d875b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:23.022314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-631b0c7f-2d90-456f-ace1-3f628e1d875b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:23.028934 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-631b0c7f-2d90-456f-ace1-3f628e1d875b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:23.029409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-631b0c7f-2d90-456f-ace1-3f628e1d875b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:23.029838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-631b0c7f-2d90-456f-ace1-3f628e1d875b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:23.030512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-631b0c7f-2d90-456f-ace1-3f628e1d875b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:23.030958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-631b0c7f-2d90-456f-ace1-3f628e1d875b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:23.031376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-631b0c7f-2d90-456f-ace1-3f628e1d875b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:23.159752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-631b0c7f-2d90-456f-ace1-3f628e1d875b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:23.168923 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-631b0c7f-2d90-456f-ace1-3f628e1d875b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151075 Sep 01 05:34:23.169491 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 951/1985] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:23 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:23.380969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8652f59c-b23a-475e-9fcb-b30da672ee5b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:23.381581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8652f59c-b23a-475e-9fcb-b30da672ee5b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:23.388049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8652f59c-b23a-475e-9fcb-b30da672ee5b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:23.388536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8652f59c-b23a-475e-9fcb-b30da672ee5b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:23.389017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8652f59c-b23a-475e-9fcb-b30da672ee5b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:23.389703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8652f59c-b23a-475e-9fcb-b30da672ee5b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:23.390155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8652f59c-b23a-475e-9fcb-b30da672ee5b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:23.390579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8652f59c-b23a-475e-9fcb-b30da672ee5b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:23.455045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8652f59c-b23a-475e-9fcb-b30da672ee5b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:23.463760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8652f59c-b23a-475e-9fcb-b30da672ee5b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:23.465234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8652f59c-b23a-475e-9fcb-b30da672ee5b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:23.466394 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8652f59c-b23a-475e-9fcb-b30da672ee5b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089427 Sep 01 05:34:23.466951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1035/1986] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:24.190819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-46566aa8-5d26-43a8-b35b-fc3d9c1cf4b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:24.191427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-46566aa8-5d26-43a8-b35b-fc3d9c1cf4b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:24.198496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46566aa8-5d26-43a8-b35b-fc3d9c1cf4b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:24.198975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46566aa8-5d26-43a8-b35b-fc3d9c1cf4b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:24.199399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46566aa8-5d26-43a8-b35b-fc3d9c1cf4b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:24.200071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46566aa8-5d26-43a8-b35b-fc3d9c1cf4b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:24.200511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46566aa8-5d26-43a8-b35b-fc3d9c1cf4b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:24.200958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46566aa8-5d26-43a8-b35b-fc3d9c1cf4b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:24.333987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-46566aa8-5d26-43a8-b35b-fc3d9c1cf4b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:24.342329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-46566aa8-5d26-43a8-b35b-fc3d9c1cf4b0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155341 Sep 01 05:34:24.342891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 952/1987] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:24 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:24.488740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0400b2e9-1e1b-4d98-bd6f-1fde2f9af7d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:24.489292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0400b2e9-1e1b-4d98-bd6f-1fde2f9af7d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:24.496739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0400b2e9-1e1b-4d98-bd6f-1fde2f9af7d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:24.497239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0400b2e9-1e1b-4d98-bd6f-1fde2f9af7d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:24.497671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0400b2e9-1e1b-4d98-bd6f-1fde2f9af7d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:24.498351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0400b2e9-1e1b-4d98-bd6f-1fde2f9af7d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:24.498799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0400b2e9-1e1b-4d98-bd6f-1fde2f9af7d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:24.499214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0400b2e9-1e1b-4d98-bd6f-1fde2f9af7d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:24.560900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0400b2e9-1e1b-4d98-bd6f-1fde2f9af7d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:24.569464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0400b2e9-1e1b-4d98-bd6f-1fde2f9af7d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:24.572045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0400b2e9-1e1b-4d98-bd6f-1fde2f9af7d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:24.573212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0400b2e9-1e1b-4d98-bd6f-1fde2f9af7d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088396 Sep 01 05:34:24.573763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1036/1988] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:25.363467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d02641f2-cedd-473e-a2bf-aac9a76995c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:25.364075 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d02641f2-cedd-473e-a2bf-aac9a76995c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:25.371290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d02641f2-cedd-473e-a2bf-aac9a76995c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:25.371769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d02641f2-cedd-473e-a2bf-aac9a76995c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:25.372201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d02641f2-cedd-473e-a2bf-aac9a76995c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:25.372910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d02641f2-cedd-473e-a2bf-aac9a76995c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:25.373360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d02641f2-cedd-473e-a2bf-aac9a76995c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:25.373777 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d02641f2-cedd-473e-a2bf-aac9a76995c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:25.502584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d02641f2-cedd-473e-a2bf-aac9a76995c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:25.511068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d02641f2-cedd-473e-a2bf-aac9a76995c8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151505 Sep 01 05:34:25.511641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 953/1989] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:25 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:25.596027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3d32ec59-4b2d-401a-959f-b88052ece662 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:25.596645 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3d32ec59-4b2d-401a-959f-b88052ece662 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:25.603508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3d32ec59-4b2d-401a-959f-b88052ece662 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:25.603987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3d32ec59-4b2d-401a-959f-b88052ece662 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:25.604418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3d32ec59-4b2d-401a-959f-b88052ece662 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:25.605126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3d32ec59-4b2d-401a-959f-b88052ece662 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:25.605576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3d32ec59-4b2d-401a-959f-b88052ece662 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:25.605995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3d32ec59-4b2d-401a-959f-b88052ece662 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:25.669339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3d32ec59-4b2d-401a-959f-b88052ece662 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:25.678328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3d32ec59-4b2d-401a-959f-b88052ece662 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:25.680364 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3d32ec59-4b2d-401a-959f-b88052ece662 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:25.681537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3d32ec59-4b2d-401a-959f-b88052ece662 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089429 Sep 01 05:34:25.682090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1037/1990] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:26.532647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7e093d7a-efb2-4f8e-82ce-d98cb30b79fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:26.533291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7e093d7a-efb2-4f8e-82ce-d98cb30b79fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:26.539884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e093d7a-efb2-4f8e-82ce-d98cb30b79fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:26.540363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e093d7a-efb2-4f8e-82ce-d98cb30b79fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:26.540819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e093d7a-efb2-4f8e-82ce-d98cb30b79fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:26.541502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e093d7a-efb2-4f8e-82ce-d98cb30b79fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:26.542220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e093d7a-efb2-4f8e-82ce-d98cb30b79fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:26.542645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e093d7a-efb2-4f8e-82ce-d98cb30b79fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:26.671943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7e093d7a-efb2-4f8e-82ce-d98cb30b79fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:26.680982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7e093d7a-efb2-4f8e-82ce-d98cb30b79fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152160 Sep 01 05:34:26.681545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 954/1991] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:26 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:26.703266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2e5e11f9-d1a3-466a-997d-fc61654d971c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:26.703899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2e5e11f9-d1a3-466a-997d-fc61654d971c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:26.710534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e5e11f9-d1a3-466a-997d-fc61654d971c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:26.711085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e5e11f9-d1a3-466a-997d-fc61654d971c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:26.711517 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e5e11f9-d1a3-466a-997d-fc61654d971c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:26.712189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e5e11f9-d1a3-466a-997d-fc61654d971c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:26.712635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e5e11f9-d1a3-466a-997d-fc61654d971c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:26.713076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2e5e11f9-d1a3-466a-997d-fc61654d971c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:26.773422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2e5e11f9-d1a3-466a-997d-fc61654d971c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:26.785198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2e5e11f9-d1a3-466a-997d-fc61654d971c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:26.788052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2e5e11f9-d1a3-466a-997d-fc61654d971c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:26.789981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2e5e11f9-d1a3-466a-997d-fc61654d971c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090321 Sep 01 05:34:26.790665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1038/1992] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:27.702851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e2e03a95-72bd-4c85-b845-e9b06ee5617b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:27.703458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e2e03a95-72bd-4c85-b845-e9b06ee5617b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:27.709832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e2e03a95-72bd-4c85-b845-e9b06ee5617b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:27.710943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e2e03a95-72bd-4c85-b845-e9b06ee5617b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:27.711374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e2e03a95-72bd-4c85-b845-e9b06ee5617b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:27.712053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e2e03a95-72bd-4c85-b845-e9b06ee5617b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:27.712497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e2e03a95-72bd-4c85-b845-e9b06ee5617b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:27.712947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e2e03a95-72bd-4c85-b845-e9b06ee5617b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:27.813296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6efe0b1a-e68f-4093-890d-cf0e8e35c37a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:27.814047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6efe0b1a-e68f-4093-890d-cf0e8e35c37a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:27.821005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6efe0b1a-e68f-4093-890d-cf0e8e35c37a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:27.821560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6efe0b1a-e68f-4093-890d-cf0e8e35c37a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:27.822063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6efe0b1a-e68f-4093-890d-cf0e8e35c37a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:27.822819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6efe0b1a-e68f-4093-890d-cf0e8e35c37a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:27.823338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6efe0b1a-e68f-4093-890d-cf0e8e35c37a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:27.823829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6efe0b1a-e68f-4093-890d-cf0e8e35c37a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:27.844005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e2e03a95-72bd-4c85-b845-e9b06ee5617b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:27.852228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e2e03a95-72bd-4c85-b845-e9b06ee5617b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153223 Sep 01 05:34:27.852820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 955/1993] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:27 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:27.889734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6efe0b1a-e68f-4093-890d-cf0e8e35c37a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:27.901415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6efe0b1a-e68f-4093-890d-cf0e8e35c37a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:27.902864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6efe0b1a-e68f-4093-890d-cf0e8e35c37a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:27.904014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6efe0b1a-e68f-4093-890d-cf0e8e35c37a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.094646 Sep 01 05:34:27.904566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1039/1994] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:27 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:34:28.873115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-31f406f3-63ee-4d58-b791-c19b7b7b6dc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:28.873668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-31f406f3-63ee-4d58-b791-c19b7b7b6dc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:28.880117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31f406f3-63ee-4d58-b791-c19b7b7b6dc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:28.880598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31f406f3-63ee-4d58-b791-c19b7b7b6dc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:28.881074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31f406f3-63ee-4d58-b791-c19b7b7b6dc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:28.881763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31f406f3-63ee-4d58-b791-c19b7b7b6dc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:28.882214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31f406f3-63ee-4d58-b791-c19b7b7b6dc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:28.882635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-31f406f3-63ee-4d58-b791-c19b7b7b6dc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:28.926574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6bb872d6-3098-485b-887e-da2042fbaf71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:28.927387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6bb872d6-3098-485b-887e-da2042fbaf71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:28.933714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6bb872d6-3098-485b-887e-da2042fbaf71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:28.934206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6bb872d6-3098-485b-887e-da2042fbaf71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:28.934622 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6bb872d6-3098-485b-887e-da2042fbaf71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:28.935300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6bb872d6-3098-485b-887e-da2042fbaf71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:28.935741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6bb872d6-3098-485b-887e-da2042fbaf71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:28.936157 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6bb872d6-3098-485b-887e-da2042fbaf71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:29.001578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6bb872d6-3098-485b-887e-da2042fbaf71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:29.010931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6bb872d6-3098-485b-887e-da2042fbaf71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:29.012420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6bb872d6-3098-485b-887e-da2042fbaf71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:29.013639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6bb872d6-3098-485b-887e-da2042fbaf71 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090968 Sep 01 05:34:29.014095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-31f406f3-63ee-4d58-b791-c19b7b7b6dc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:29.014216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1040/1995] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:28 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:34:29.022755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-31f406f3-63ee-4d58-b791-c19b7b7b6dc8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153103 Sep 01 05:34:29.023450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 956/1996] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:28 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:30.036861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-32f97c2a-e38d-4fb9-87eb-005d01b23c78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:30.037400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-32f97c2a-e38d-4fb9-87eb-005d01b23c78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:30.044181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-34ae5a32-4875-45f7-a3ed-8fc42d26f232 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:30.044817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-34ae5a32-4875-45f7-a3ed-8fc42d26f232 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:30.045175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32f97c2a-e38d-4fb9-87eb-005d01b23c78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:30.045657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32f97c2a-e38d-4fb9-87eb-005d01b23c78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:30.046091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32f97c2a-e38d-4fb9-87eb-005d01b23c78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:30.046776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32f97c2a-e38d-4fb9-87eb-005d01b23c78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:30.047222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32f97c2a-e38d-4fb9-87eb-005d01b23c78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:30.047639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32f97c2a-e38d-4fb9-87eb-005d01b23c78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:30.051280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34ae5a32-4875-45f7-a3ed-8fc42d26f232 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:30.051763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34ae5a32-4875-45f7-a3ed-8fc42d26f232 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:30.052202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34ae5a32-4875-45f7-a3ed-8fc42d26f232 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:30.052936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34ae5a32-4875-45f7-a3ed-8fc42d26f232 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:30.053395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34ae5a32-4875-45f7-a3ed-8fc42d26f232 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:30.054421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34ae5a32-4875-45f7-a3ed-8fc42d26f232 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:30.110312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-32f97c2a-e38d-4fb9-87eb-005d01b23c78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:30.119459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-32f97c2a-e38d-4fb9-87eb-005d01b23c78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:30.120903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-32f97c2a-e38d-4fb9-87eb-005d01b23c78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:30.122032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-32f97c2a-e38d-4fb9-87eb-005d01b23c78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089162 Sep 01 05:34:30.122818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1041/1997] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:30 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:30.189747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-34ae5a32-4875-45f7-a3ed-8fc42d26f232 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:30.198366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-34ae5a32-4875-45f7-a3ed-8fc42d26f232 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.158254 Sep 01 05:34:30.198926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 957/1998] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:30 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:31.144281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-48839927-978a-457e-ae4b-c546caaa6f78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:31.144955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-48839927-978a-457e-ae4b-c546caaa6f78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:31.151794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48839927-978a-457e-ae4b-c546caaa6f78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:31.152213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48839927-978a-457e-ae4b-c546caaa6f78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:31.152646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48839927-978a-457e-ae4b-c546caaa6f78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:31.153357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48839927-978a-457e-ae4b-c546caaa6f78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:31.153806 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48839927-978a-457e-ae4b-c546caaa6f78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:31.154224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48839927-978a-457e-ae4b-c546caaa6f78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:31.217667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-48839927-978a-457e-ae4b-c546caaa6f78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:31.219497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9d4f56cc-1179-4e54-b8b6-6aa21202f017 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:31.220258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9d4f56cc-1179-4e54-b8b6-6aa21202f017 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:31.226758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-48839927-978a-457e-ae4b-c546caaa6f78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:31.226966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d4f56cc-1179-4e54-b8b6-6aa21202f017 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:31.227233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d4f56cc-1179-4e54-b8b6-6aa21202f017 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:31.227664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d4f56cc-1179-4e54-b8b6-6aa21202f017 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:31.228274 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-48839927-978a-457e-ae4b-c546caaa6f78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:31.228396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d4f56cc-1179-4e54-b8b6-6aa21202f017 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:31.228804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d4f56cc-1179-4e54-b8b6-6aa21202f017 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:31.229218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9d4f56cc-1179-4e54-b8b6-6aa21202f017 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:31.229452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-48839927-978a-457e-ae4b-c546caaa6f78 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089094 Sep 01 05:34:31.230019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1042/1999] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:31.354864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9d4f56cc-1179-4e54-b8b6-6aa21202f017 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:31.362941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9d4f56cc-1179-4e54-b8b6-6aa21202f017 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.147427 Sep 01 05:34:31.363502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 958/2000] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:31 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:32.252680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-01ea1448-16c9-46c6-9d45-f671744f89eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:32.253278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-01ea1448-16c9-46c6-9d45-f671744f89eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:32.255195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:34:32.255339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:34:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf (ip 10.222.0.49) !!! Sep 01 05:34:32.263514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01ea1448-16c9-46c6-9d45-f671744f89eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:32.263996 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01ea1448-16c9-46c6-9d45-f671744f89eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:32.264456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01ea1448-16c9-46c6-9d45-f671744f89eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:32.265194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01ea1448-16c9-46c6-9d45-f671744f89eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:32.265645 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01ea1448-16c9-46c6-9d45-f671744f89eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:32.266063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01ea1448-16c9-46c6-9d45-f671744f89eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:32.270019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:32.335350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-01ea1448-16c9-46c6-9d45-f671744f89eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:32.343828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-01ea1448-16c9-46c6-9d45-f671744f89eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:32.345296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-01ea1448-16c9-46c6-9d45-f671744f89eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:32.346429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-01ea1448-16c9-46c6-9d45-f671744f89eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.097678 Sep 01 05:34:32.346978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1043/2001] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:32.384554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-91566072-ff17-43e2-819a-b0635f9499fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:32.385184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-91566072-ff17-43e2-819a-b0635f9499fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:32.391691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91566072-ff17-43e2-819a-b0635f9499fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:32.392162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91566072-ff17-43e2-819a-b0635f9499fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:32.392589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91566072-ff17-43e2-819a-b0635f9499fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:32.393290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91566072-ff17-43e2-819a-b0635f9499fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:32.393736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91566072-ff17-43e2-819a-b0635f9499fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:32.394150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91566072-ff17-43e2-819a-b0635f9499fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:32.523055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-91566072-ff17-43e2-819a-b0635f9499fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:32.531130 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-91566072-ff17-43e2-819a-b0635f9499fa tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150568 Sep 01 05:34:32.531691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 959/2002] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:32 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:33.370367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0b737b03-8ea6-44f9-af98-7d428fa53148 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:33.370893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0b737b03-8ea6-44f9-af98-7d428fa53148 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:33.377259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b737b03-8ea6-44f9-af98-7d428fa53148 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:33.377730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b737b03-8ea6-44f9-af98-7d428fa53148 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:33.378157 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b737b03-8ea6-44f9-af98-7d428fa53148 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:33.378825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b737b03-8ea6-44f9-af98-7d428fa53148 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:33.379272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b737b03-8ea6-44f9-af98-7d428fa53148 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:33.379684 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0b737b03-8ea6-44f9-af98-7d428fa53148 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:33.440936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0b737b03-8ea6-44f9-af98-7d428fa53148 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:33.450193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0b737b03-8ea6-44f9-af98-7d428fa53148 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:33.451613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0b737b03-8ea6-44f9-af98-7d428fa53148 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:33.452735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0b737b03-8ea6-44f9-af98-7d428fa53148 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087079 Sep 01 05:34:33.453320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1044/2003] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:33.552470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-88df4679-85c9-4b57-a45b-3d9672562a71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:33.553641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-88df4679-85c9-4b57-a45b-3d9672562a71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:33.560042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88df4679-85c9-4b57-a45b-3d9672562a71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:33.560526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88df4679-85c9-4b57-a45b-3d9672562a71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:33.561004 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88df4679-85c9-4b57-a45b-3d9672562a71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:33.561722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88df4679-85c9-4b57-a45b-3d9672562a71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:33.562172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88df4679-85c9-4b57-a45b-3d9672562a71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:33.562596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-88df4679-85c9-4b57-a45b-3d9672562a71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:33.693438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-88df4679-85c9-4b57-a45b-3d9672562a71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:33.702227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-88df4679-85c9-4b57-a45b-3d9672562a71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153571 Sep 01 05:34:33.702784 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 960/2004] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:34.475831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-acf0b0c4-e84c-440b-8ad0-13f181a8c075 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:34.476484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-acf0b0c4-e84c-440b-8ad0-13f181a8c075 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:34.483021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acf0b0c4-e84c-440b-8ad0-13f181a8c075 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:34.483492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acf0b0c4-e84c-440b-8ad0-13f181a8c075 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:34.483920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acf0b0c4-e84c-440b-8ad0-13f181a8c075 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:34.484590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acf0b0c4-e84c-440b-8ad0-13f181a8c075 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:34.485059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acf0b0c4-e84c-440b-8ad0-13f181a8c075 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:34.485475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acf0b0c4-e84c-440b-8ad0-13f181a8c075 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:34.547247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-acf0b0c4-e84c-440b-8ad0-13f181a8c075 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:34.556802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-acf0b0c4-e84c-440b-8ad0-13f181a8c075 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:34.558244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-acf0b0c4-e84c-440b-8ad0-13f181a8c075 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:34.559375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-acf0b0c4-e84c-440b-8ad0-13f181a8c075 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088053 Sep 01 05:34:34.559941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1045/2005] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:34.723370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b6c4418c-5649-4962-8ae3-621a357ad05f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:34.723978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b6c4418c-5649-4962-8ae3-621a357ad05f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:34.730543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6c4418c-5649-4962-8ae3-621a357ad05f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:34.731021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6c4418c-5649-4962-8ae3-621a357ad05f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:34.731450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6c4418c-5649-4962-8ae3-621a357ad05f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:34.732127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6c4418c-5649-4962-8ae3-621a357ad05f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:34.732571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6c4418c-5649-4962-8ae3-621a357ad05f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:34.733018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6c4418c-5649-4962-8ae3-621a357ad05f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:34.860932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b6c4418c-5649-4962-8ae3-621a357ad05f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:34.869853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b6c4418c-5649-4962-8ae3-621a357ad05f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150353 Sep 01 05:34:34.870549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 961/2006] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:35.582701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-91a0d66c-9d6a-4197-96aa-3170fef7e4e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:35.583310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-91a0d66c-9d6a-4197-96aa-3170fef7e4e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:35.589804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91a0d66c-9d6a-4197-96aa-3170fef7e4e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:35.590274 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91a0d66c-9d6a-4197-96aa-3170fef7e4e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:35.590700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91a0d66c-9d6a-4197-96aa-3170fef7e4e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:35.591366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91a0d66c-9d6a-4197-96aa-3170fef7e4e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:35.591809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91a0d66c-9d6a-4197-96aa-3170fef7e4e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:35.592219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-91a0d66c-9d6a-4197-96aa-3170fef7e4e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:35.653199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-91a0d66c-9d6a-4197-96aa-3170fef7e4e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:35.661585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-91a0d66c-9d6a-4197-96aa-3170fef7e4e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:35.663374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-91a0d66c-9d6a-4197-96aa-3170fef7e4e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:35.664505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-91a0d66c-9d6a-4197-96aa-3170fef7e4e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085916 Sep 01 05:34:35.665106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1046/2007] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:35.892136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b190de09-a5ef-40b5-b230-0eadaf390975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:35.892749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b190de09-a5ef-40b5-b230-0eadaf390975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:35.899309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b190de09-a5ef-40b5-b230-0eadaf390975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:35.899791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b190de09-a5ef-40b5-b230-0eadaf390975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:35.900225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b190de09-a5ef-40b5-b230-0eadaf390975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:35.900948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b190de09-a5ef-40b5-b230-0eadaf390975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:35.901397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b190de09-a5ef-40b5-b230-0eadaf390975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:35.901816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b190de09-a5ef-40b5-b230-0eadaf390975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:36.033258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b190de09-a5ef-40b5-b230-0eadaf390975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:36.042411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b190de09-a5ef-40b5-b230-0eadaf390975 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154238 Sep 01 05:34:36.042972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 962/2008] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:35 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:36.687765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cdf42d30-835b-4054-bc11-aa99683b53e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:36.688422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cdf42d30-835b-4054-bc11-aa99683b53e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:36.695332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdf42d30-835b-4054-bc11-aa99683b53e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:36.695802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdf42d30-835b-4054-bc11-aa99683b53e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:36.696231 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdf42d30-835b-4054-bc11-aa99683b53e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:36.696935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdf42d30-835b-4054-bc11-aa99683b53e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:36.697376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdf42d30-835b-4054-bc11-aa99683b53e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:36.697788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cdf42d30-835b-4054-bc11-aa99683b53e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:36.761057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cdf42d30-835b-4054-bc11-aa99683b53e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:36.769539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cdf42d30-835b-4054-bc11-aa99683b53e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:36.770978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cdf42d30-835b-4054-bc11-aa99683b53e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:36.772766 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cdf42d30-835b-4054-bc11-aa99683b53e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088871 Sep 01 05:34:36.773349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1047/2009] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:37.063390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ca096cb1-50bc-4d2d-ab1b-d8fe4951919f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:37.063963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ca096cb1-50bc-4d2d-ab1b-d8fe4951919f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:37.071360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca096cb1-50bc-4d2d-ab1b-d8fe4951919f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:37.071835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca096cb1-50bc-4d2d-ab1b-d8fe4951919f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:37.072268 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca096cb1-50bc-4d2d-ab1b-d8fe4951919f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.072997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca096cb1-50bc-4d2d-ab1b-d8fe4951919f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:37.073448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca096cb1-50bc-4d2d-ab1b-d8fe4951919f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:37.073869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca096cb1-50bc-4d2d-ab1b-d8fe4951919f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.200048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ca096cb1-50bc-4d2d-ab1b-d8fe4951919f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:37.208165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ca096cb1-50bc-4d2d-ab1b-d8fe4951919f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148737 Sep 01 05:34:37.208735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 963/2010] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:37 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:37.794835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e04bb5f3-f3d8-4e1d-83a1-7fb07e3d073c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:37.795437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e04bb5f3-f3d8-4e1d-83a1-7fb07e3d073c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:37.801980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e04bb5f3-f3d8-4e1d-83a1-7fb07e3d073c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:37.802458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e04bb5f3-f3d8-4e1d-83a1-7fb07e3d073c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:37.802890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e04bb5f3-f3d8-4e1d-83a1-7fb07e3d073c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.803866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e04bb5f3-f3d8-4e1d-83a1-7fb07e3d073c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:37.804319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e04bb5f3-f3d8-4e1d-83a1-7fb07e3d073c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:37.804737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e04bb5f3-f3d8-4e1d-83a1-7fb07e3d073c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.865940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e04bb5f3-f3d8-4e1d-83a1-7fb07e3d073c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:37.874477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e04bb5f3-f3d8-4e1d-83a1-7fb07e3d073c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:37.875899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e04bb5f3-f3d8-4e1d-83a1-7fb07e3d073c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:37.877055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e04bb5f3-f3d8-4e1d-83a1-7fb07e3d073c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086317 Sep 01 05:34:37.877614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1048/2011] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:37 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:38.229802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-71cc8671-08be-47cf-ac35-f7473ab09d3c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:38.230415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-71cc8671-08be-47cf-ac35-f7473ab09d3c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:38.236890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71cc8671-08be-47cf-ac35-f7473ab09d3c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.237371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71cc8671-08be-47cf-ac35-f7473ab09d3c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.237804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71cc8671-08be-47cf-ac35-f7473ab09d3c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.238494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71cc8671-08be-47cf-ac35-f7473ab09d3c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.238944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71cc8671-08be-47cf-ac35-f7473ab09d3c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.239365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71cc8671-08be-47cf-ac35-f7473ab09d3c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.253950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:38.372048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-71cc8671-08be-47cf-ac35-f7473ab09d3c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:38.380163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-71cc8671-08be-47cf-ac35-f7473ab09d3c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154193 Sep 01 05:34:38.380724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 964/2012] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:38 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:38.902078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-616396f5-cd02-491a-8932-07a2439dfdd7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:38.902689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-616396f5-cd02-491a-8932-07a2439dfdd7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:38.909096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-616396f5-cd02-491a-8932-07a2439dfdd7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.909577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-616396f5-cd02-491a-8932-07a2439dfdd7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.910013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-616396f5-cd02-491a-8932-07a2439dfdd7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.910688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-616396f5-cd02-491a-8932-07a2439dfdd7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.911136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-616396f5-cd02-491a-8932-07a2439dfdd7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.911554 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-616396f5-cd02-491a-8932-07a2439dfdd7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.975800 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-616396f5-cd02-491a-8932-07a2439dfdd7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:38.984469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-616396f5-cd02-491a-8932-07a2439dfdd7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:38.985926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-616396f5-cd02-491a-8932-07a2439dfdd7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:38.987055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-616396f5-cd02-491a-8932-07a2439dfdd7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088858 Sep 01 05:34:38.987615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1049/2013] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:38 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:39.401561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7192a2e9-b3c2-4a3c-93bd-b31910214d03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:39.402167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7192a2e9-b3c2-4a3c-93bd-b31910214d03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:39.408499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7192a2e9-b3c2-4a3c-93bd-b31910214d03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.409011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7192a2e9-b3c2-4a3c-93bd-b31910214d03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.409470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7192a2e9-b3c2-4a3c-93bd-b31910214d03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:39.410146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7192a2e9-b3c2-4a3c-93bd-b31910214d03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.410589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7192a2e9-b3c2-4a3c-93bd-b31910214d03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.411007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7192a2e9-b3c2-4a3c-93bd-b31910214d03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:39.538307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7192a2e9-b3c2-4a3c-93bd-b31910214d03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:39.546731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7192a2e9-b3c2-4a3c-93bd-b31910214d03 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148974 Sep 01 05:34:39.547291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 965/2014] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:40.009338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-46b53799-8740-4eda-aab5-f36837a5a9ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:40.009948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-46b53799-8740-4eda-aab5-f36837a5a9ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:40.016321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46b53799-8740-4eda-aab5-f36837a5a9ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:40.016819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46b53799-8740-4eda-aab5-f36837a5a9ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:40.017257 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46b53799-8740-4eda-aab5-f36837a5a9ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:40.017934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46b53799-8740-4eda-aab5-f36837a5a9ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:40.018380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46b53799-8740-4eda-aab5-f36837a5a9ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:40.018794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46b53799-8740-4eda-aab5-f36837a5a9ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:40.080222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-46b53799-8740-4eda-aab5-f36837a5a9ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:40.089032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-46b53799-8740-4eda-aab5-f36837a5a9ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:40.090463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-46b53799-8740-4eda-aab5-f36837a5a9ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:40.091589 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-46b53799-8740-4eda-aab5-f36837a5a9ce tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087040 Sep 01 05:34:40.092145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1050/2015] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:40.567314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-eba070a8-9fdc-4a20-a63f-fb29a5488ee1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:40.567928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-eba070a8-9fdc-4a20-a63f-fb29a5488ee1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:40.575259 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eba070a8-9fdc-4a20-a63f-fb29a5488ee1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:40.575774 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eba070a8-9fdc-4a20-a63f-fb29a5488ee1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:40.576211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eba070a8-9fdc-4a20-a63f-fb29a5488ee1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:40.576958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eba070a8-9fdc-4a20-a63f-fb29a5488ee1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:40.577415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eba070a8-9fdc-4a20-a63f-fb29a5488ee1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:40.577832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-eba070a8-9fdc-4a20-a63f-fb29a5488ee1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:40.712258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-eba070a8-9fdc-4a20-a63f-fb29a5488ee1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:40.720523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-eba070a8-9fdc-4a20-a63f-fb29a5488ee1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157015 Sep 01 05:34:40.721147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 966/2016] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:40 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:41.114459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9ce45cc0-2469-4bae-88fa-476e309c4bc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:41.115599 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9ce45cc0-2469-4bae-88fa-476e309c4bc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:41.122601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ce45cc0-2469-4bae-88fa-476e309c4bc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:41.123079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ce45cc0-2469-4bae-88fa-476e309c4bc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:41.123509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ce45cc0-2469-4bae-88fa-476e309c4bc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:41.124190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ce45cc0-2469-4bae-88fa-476e309c4bc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:41.124637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ce45cc0-2469-4bae-88fa-476e309c4bc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:41.125089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ce45cc0-2469-4bae-88fa-476e309c4bc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:41.190690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ce45cc0-2469-4bae-88fa-476e309c4bc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:41.199462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ce45cc0-2469-4bae-88fa-476e309c4bc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:41.200944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ce45cc0-2469-4bae-88fa-476e309c4bc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:41.202089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9ce45cc0-2469-4bae-88fa-476e309c4bc5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091567 Sep 01 05:34:41.202642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1051/2017] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:41.742360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-20a4c653-3618-4319-954f-a6eff3abfd8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:41.742968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-20a4c653-3618-4319-954f-a6eff3abfd8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:41.749471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20a4c653-3618-4319-954f-a6eff3abfd8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:41.749945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20a4c653-3618-4319-954f-a6eff3abfd8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:41.750509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20a4c653-3618-4319-954f-a6eff3abfd8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:41.751178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20a4c653-3618-4319-954f-a6eff3abfd8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:41.751620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20a4c653-3618-4319-954f-a6eff3abfd8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:41.752031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20a4c653-3618-4319-954f-a6eff3abfd8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:41.880957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-20a4c653-3618-4319-954f-a6eff3abfd8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:41.889041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-20a4c653-3618-4319-954f-a6eff3abfd8b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150545 Sep 01 05:34:41.889623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 967/2018] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:42.224794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0fd63a23-0412-41bf-893f-1e2f5d264cdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:42.225593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0fd63a23-0412-41bf-893f-1e2f5d264cdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:42.231940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0fd63a23-0412-41bf-893f-1e2f5d264cdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.232420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0fd63a23-0412-41bf-893f-1e2f5d264cdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.232948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0fd63a23-0412-41bf-893f-1e2f5d264cdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.233633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0fd63a23-0412-41bf-893f-1e2f5d264cdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.234081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0fd63a23-0412-41bf-893f-1e2f5d264cdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.234499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0fd63a23-0412-41bf-893f-1e2f5d264cdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.297261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0fd63a23-0412-41bf-893f-1e2f5d264cdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:42.306857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0fd63a23-0412-41bf-893f-1e2f5d264cdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:42.308283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0fd63a23-0412-41bf-893f-1e2f5d264cdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:42.309464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0fd63a23-0412-41bf-893f-1e2f5d264cdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088781 Sep 01 05:34:42.310027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1052/2019] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:42.910864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1d2120f7-e94b-47e2-9212-dec54890e6d9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:42.911510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1d2120f7-e94b-47e2-9212-dec54890e6d9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:42.918197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d2120f7-e94b-47e2-9212-dec54890e6d9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.918678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d2120f7-e94b-47e2-9212-dec54890e6d9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.919109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d2120f7-e94b-47e2-9212-dec54890e6d9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.919803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d2120f7-e94b-47e2-9212-dec54890e6d9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.920250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d2120f7-e94b-47e2-9212-dec54890e6d9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.920668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d2120f7-e94b-47e2-9212-dec54890e6d9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:43.049022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1d2120f7-e94b-47e2-9212-dec54890e6d9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:43.057889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1d2120f7-e94b-47e2-9212-dec54890e6d9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151010 Sep 01 05:34:43.058396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 968/2020] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:42 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:43.332743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ac1ea554-5e2a-4fb7-8305-f25d4fcfc3a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:43.333413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ac1ea554-5e2a-4fb7-8305-f25d4fcfc3a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:43.339682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac1ea554-5e2a-4fb7-8305-f25d4fcfc3a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:43.340165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac1ea554-5e2a-4fb7-8305-f25d4fcfc3a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:43.340607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac1ea554-5e2a-4fb7-8305-f25d4fcfc3a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:43.341333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac1ea554-5e2a-4fb7-8305-f25d4fcfc3a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:43.341784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac1ea554-5e2a-4fb7-8305-f25d4fcfc3a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:43.342209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac1ea554-5e2a-4fb7-8305-f25d4fcfc3a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:43.403236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ac1ea554-5e2a-4fb7-8305-f25d4fcfc3a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:43.411691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ac1ea554-5e2a-4fb7-8305-f25d4fcfc3a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:43.413842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ac1ea554-5e2a-4fb7-8305-f25d4fcfc3a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:43.414959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ac1ea554-5e2a-4fb7-8305-f25d4fcfc3a5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086292 Sep 01 05:34:43.415513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1053/2021] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:44.079571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6d87c532-f846-4ce5-8da6-745017a00e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:44.080182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6d87c532-f846-4ce5-8da6-745017a00e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:44.087183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d87c532-f846-4ce5-8da6-745017a00e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:44.087665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d87c532-f846-4ce5-8da6-745017a00e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:44.088097 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d87c532-f846-4ce5-8da6-745017a00e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.088915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d87c532-f846-4ce5-8da6-745017a00e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:44.089247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d87c532-f846-4ce5-8da6-745017a00e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:44.089661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d87c532-f846-4ce5-8da6-745017a00e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.220388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6d87c532-f846-4ce5-8da6-745017a00e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:44.228710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6d87c532-f846-4ce5-8da6-745017a00e27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153055 Sep 01 05:34:44.229303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 969/2022] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:44 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:44.438867 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-83409fd2-32c9-4caf-b1a1-f1b35ec350e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:44.439446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-83409fd2-32c9-4caf-b1a1-f1b35ec350e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:44.446005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-83409fd2-32c9-4caf-b1a1-f1b35ec350e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:44.446536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-83409fd2-32c9-4caf-b1a1-f1b35ec350e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:44.446964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-83409fd2-32c9-4caf-b1a1-f1b35ec350e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.447634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-83409fd2-32c9-4caf-b1a1-f1b35ec350e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:44.448071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-83409fd2-32c9-4caf-b1a1-f1b35ec350e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:44.448487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-83409fd2-32c9-4caf-b1a1-f1b35ec350e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.509206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-83409fd2-32c9-4caf-b1a1-f1b35ec350e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:44.517575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-83409fd2-32c9-4caf-b1a1-f1b35ec350e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:44.518998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-83409fd2-32c9-4caf-b1a1-f1b35ec350e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:44.520124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-83409fd2-32c9-4caf-b1a1-f1b35ec350e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085266 Sep 01 05:34:44.520668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1054/2023] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:45.249591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-806bacf7-aac8-478e-a23f-afee2dd5ef51 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:45.250133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-806bacf7-aac8-478e-a23f-afee2dd5ef51 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:45.256536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806bacf7-aac8-478e-a23f-afee2dd5ef51 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.257050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806bacf7-aac8-478e-a23f-afee2dd5ef51 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.257482 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806bacf7-aac8-478e-a23f-afee2dd5ef51 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.258162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806bacf7-aac8-478e-a23f-afee2dd5ef51 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.258612 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806bacf7-aac8-478e-a23f-afee2dd5ef51 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.259038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-806bacf7-aac8-478e-a23f-afee2dd5ef51 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.388335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-806bacf7-aac8-478e-a23f-afee2dd5ef51 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:45.397116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-806bacf7-aac8-478e-a23f-afee2dd5ef51 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151380 Sep 01 05:34:45.397670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 970/2024] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:45.544162 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-65744b0e-668f-4299-ad40-bda786b3b485 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:45.544685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-65744b0e-668f-4299-ad40-bda786b3b485 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:45.551041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65744b0e-668f-4299-ad40-bda786b3b485 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.551518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65744b0e-668f-4299-ad40-bda786b3b485 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.551949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65744b0e-668f-4299-ad40-bda786b3b485 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.553093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65744b0e-668f-4299-ad40-bda786b3b485 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.553549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65744b0e-668f-4299-ad40-bda786b3b485 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.553972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65744b0e-668f-4299-ad40-bda786b3b485 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.618127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-65744b0e-668f-4299-ad40-bda786b3b485 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:45.626695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-65744b0e-668f-4299-ad40-bda786b3b485 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:45.628132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-65744b0e-668f-4299-ad40-bda786b3b485 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:45.629298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-65744b0e-668f-4299-ad40-bda786b3b485 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089335 Sep 01 05:34:45.629855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1055/2025] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:45 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:46.418156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-58fde0a4-fdac-484d-b22a-4e74a83fab87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:46.418803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-58fde0a4-fdac-484d-b22a-4e74a83fab87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:46.425246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-58fde0a4-fdac-484d-b22a-4e74a83fab87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.425727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-58fde0a4-fdac-484d-b22a-4e74a83fab87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.426165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-58fde0a4-fdac-484d-b22a-4e74a83fab87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.426846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-58fde0a4-fdac-484d-b22a-4e74a83fab87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.428118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-58fde0a4-fdac-484d-b22a-4e74a83fab87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.428928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-58fde0a4-fdac-484d-b22a-4e74a83fab87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.557697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-58fde0a4-fdac-484d-b22a-4e74a83fab87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:46.565789 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-58fde0a4-fdac-484d-b22a-4e74a83fab87 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151772 Sep 01 05:34:46.566354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 971/2026] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:46 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:46.651809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0f746ea9-c797-4291-9f83-5069d2e480a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:46.652414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0f746ea9-c797-4291-9f83-5069d2e480a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:46.658881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f746ea9-c797-4291-9f83-5069d2e480a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.659351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f746ea9-c797-4291-9f83-5069d2e480a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.659782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f746ea9-c797-4291-9f83-5069d2e480a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.660452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f746ea9-c797-4291-9f83-5069d2e480a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.660930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f746ea9-c797-4291-9f83-5069d2e480a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.661345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f746ea9-c797-4291-9f83-5069d2e480a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.724542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0f746ea9-c797-4291-9f83-5069d2e480a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:46.733092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0f746ea9-c797-4291-9f83-5069d2e480a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:46.734548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0f746ea9-c797-4291-9f83-5069d2e480a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:46.735674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0f746ea9-c797-4291-9f83-5069d2e480a7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087797 Sep 01 05:34:46.736231 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1056/2027] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:47.695574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a64cac11-c99a-4025-9246-ec4e527927db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:47.696179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a64cac11-c99a-4025-9246-ec4e527927db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:47.701930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a64cac11-c99a-4025-9246-ec4e527927db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.702405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a64cac11-c99a-4025-9246-ec4e527927db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.702833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a64cac11-c99a-4025-9246-ec4e527927db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.703509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a64cac11-c99a-4025-9246-ec4e527927db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.703952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a64cac11-c99a-4025-9246-ec4e527927db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.704371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a64cac11-c99a-4025-9246-ec4e527927db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.830764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b40f2761-5e3a-4a5c-8028-d0d9c46c6976 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:47.831375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b40f2761-5e3a-4a5c-8028-d0d9c46c6976 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:47.837675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b40f2761-5e3a-4a5c-8028-d0d9c46c6976 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.838153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b40f2761-5e3a-4a5c-8028-d0d9c46c6976 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.838585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b40f2761-5e3a-4a5c-8028-d0d9c46c6976 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.839318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b40f2761-5e3a-4a5c-8028-d0d9c46c6976 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.839713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b40f2761-5e3a-4a5c-8028-d0d9c46c6976 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.840131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b40f2761-5e3a-4a5c-8028-d0d9c46c6976 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.908999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a64cac11-c99a-4025-9246-ec4e527927db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:47.918581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a64cac11-c99a-4025-9246-ec4e527927db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.335471 Sep 01 05:34:47.919163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 972/2028] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:47.961040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b40f2761-5e3a-4a5c-8028-d0d9c46c6976 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:47.969537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b40f2761-5e3a-4a5c-8028-d0d9c46c6976 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:47.970956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b40f2761-5e3a-4a5c-8028-d0d9c46c6976 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:47.972081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b40f2761-5e3a-4a5c-8028-d0d9c46c6976 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.217357 Sep 01 05:34:47.972631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1057/2029] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:47 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:34:48.940673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-745e3096-45ae-43e5-ac16-9bc417ca964e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:48.941404 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-745e3096-45ae-43e5-ac16-9bc417ca964e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:48.945205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=52 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:48.950728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-745e3096-45ae-43e5-ac16-9bc417ca964e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:48.951211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-745e3096-45ae-43e5-ac16-9bc417ca964e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:48.951644 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-745e3096-45ae-43e5-ac16-9bc417ca964e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:48.952332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-745e3096-45ae-43e5-ac16-9bc417ca964e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:48.952793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-745e3096-45ae-43e5-ac16-9bc417ca964e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:48.953296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-745e3096-45ae-43e5-ac16-9bc417ca964e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:48.995474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2cb4ed68-83e5-4a06-a5b5-81f69d9e7b43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:48.996099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2cb4ed68-83e5-4a06-a5b5-81f69d9e7b43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:49.003015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cb4ed68-83e5-4a06-a5b5-81f69d9e7b43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:49.003506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cb4ed68-83e5-4a06-a5b5-81f69d9e7b43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:49.003936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cb4ed68-83e5-4a06-a5b5-81f69d9e7b43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:49.004665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cb4ed68-83e5-4a06-a5b5-81f69d9e7b43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:49.005148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cb4ed68-83e5-4a06-a5b5-81f69d9e7b43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:49.006069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cb4ed68-83e5-4a06-a5b5-81f69d9e7b43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:49.072801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2cb4ed68-83e5-4a06-a5b5-81f69d9e7b43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:49.082413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2cb4ed68-83e5-4a06-a5b5-81f69d9e7b43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:49.084133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2cb4ed68-83e5-4a06-a5b5-81f69d9e7b43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:49.085502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2cb4ed68-83e5-4a06-a5b5-81f69d9e7b43 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.094314 Sep 01 05:34:49.086067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1058/2030] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:34:49.236890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-745e3096-45ae-43e5-ac16-9bc417ca964e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:49.245030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-745e3096-45ae-43e5-ac16-9bc417ca964e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.308204 Sep 01 05:34:49.245592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 973/2031] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:48 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:50.108678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-689de826-7c32-431f-8be0-f2e3138c1543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:50.109311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-689de826-7c32-431f-8be0-f2e3138c1543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:50.111611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=54 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:50.116838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-689de826-7c32-431f-8be0-f2e3138c1543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.117317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-689de826-7c32-431f-8be0-f2e3138c1543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.117744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-689de826-7c32-431f-8be0-f2e3138c1543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:50.118414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-689de826-7c32-431f-8be0-f2e3138c1543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.118858 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-689de826-7c32-431f-8be0-f2e3138c1543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.119271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-689de826-7c32-431f-8be0-f2e3138c1543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:50.186422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-689de826-7c32-431f-8be0-f2e3138c1543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:50.188555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:50.196882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-689de826-7c32-431f-8be0-f2e3138c1543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:50.198336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-689de826-7c32-431f-8be0-f2e3138c1543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:50.199462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-689de826-7c32-431f-8be0-f2e3138c1543 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.094804 Sep 01 05:34:50.200018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1059/2032] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:50.265830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6d4a5ee9-e69c-42b6-a311-68b5a0ee1e1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:50.266427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6d4a5ee9-e69c-42b6-a311-68b5a0ee1e1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:50.273529 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d4a5ee9-e69c-42b6-a311-68b5a0ee1e1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.274000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d4a5ee9-e69c-42b6-a311-68b5a0ee1e1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.274429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d4a5ee9-e69c-42b6-a311-68b5a0ee1e1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:50.275099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d4a5ee9-e69c-42b6-a311-68b5a0ee1e1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.275540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d4a5ee9-e69c-42b6-a311-68b5a0ee1e1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.275955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6d4a5ee9-e69c-42b6-a311-68b5a0ee1e1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:50.408085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6d4a5ee9-e69c-42b6-a311-68b5a0ee1e1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:50.416965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6d4a5ee9-e69c-42b6-a311-68b5a0ee1e1b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154864 Sep 01 05:34:50.417452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 974/2033] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:50 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:51.222382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-62fd13ea-db73-40f7-a412-7cf9a523f83e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:51.222992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-62fd13ea-db73-40f7-a412-7cf9a523f83e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:51.230141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62fd13ea-db73-40f7-a412-7cf9a523f83e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:51.230659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62fd13ea-db73-40f7-a412-7cf9a523f83e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:51.231159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62fd13ea-db73-40f7-a412-7cf9a523f83e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:51.231814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62fd13ea-db73-40f7-a412-7cf9a523f83e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:51.232264 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62fd13ea-db73-40f7-a412-7cf9a523f83e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:51.232713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62fd13ea-db73-40f7-a412-7cf9a523f83e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:51.296518 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-62fd13ea-db73-40f7-a412-7cf9a523f83e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:51.305422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-62fd13ea-db73-40f7-a412-7cf9a523f83e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:51.306860 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-62fd13ea-db73-40f7-a412-7cf9a523f83e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:51.307995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-62fd13ea-db73-40f7-a412-7cf9a523f83e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089561 Sep 01 05:34:51.308559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1060/2034] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:51 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:51.438386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0b3d3aec-1efe-4cd1-82cf-1c258783eea5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:51.438982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0b3d3aec-1efe-4cd1-82cf-1c258783eea5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:51.445603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b3d3aec-1efe-4cd1-82cf-1c258783eea5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:51.446116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b3d3aec-1efe-4cd1-82cf-1c258783eea5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:51.446544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b3d3aec-1efe-4cd1-82cf-1c258783eea5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:51.447225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b3d3aec-1efe-4cd1-82cf-1c258783eea5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:51.447667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b3d3aec-1efe-4cd1-82cf-1c258783eea5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:51.448078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b3d3aec-1efe-4cd1-82cf-1c258783eea5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:51.575350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0b3d3aec-1efe-4cd1-82cf-1c258783eea5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:51.584310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0b3d3aec-1efe-4cd1-82cf-1c258783eea5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148881 Sep 01 05:34:51.584883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 975/2035] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:52.330681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-24106e2f-33f6-45dc-a322-138ae5f54837 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:52.331256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-24106e2f-33f6-45dc-a322-138ae5f54837 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:52.338522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-24106e2f-33f6-45dc-a322-138ae5f54837 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.339006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-24106e2f-33f6-45dc-a322-138ae5f54837 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.339442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-24106e2f-33f6-45dc-a322-138ae5f54837 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.340131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-24106e2f-33f6-45dc-a322-138ae5f54837 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.340583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-24106e2f-33f6-45dc-a322-138ae5f54837 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.341030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-24106e2f-33f6-45dc-a322-138ae5f54837 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.403364 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-24106e2f-33f6-45dc-a322-138ae5f54837 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:52.413269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-24106e2f-33f6-45dc-a322-138ae5f54837 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:52.414739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-24106e2f-33f6-45dc-a322-138ae5f54837 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:52.416130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-24106e2f-33f6-45dc-a322-138ae5f54837 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089451 Sep 01 05:34:52.416686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1061/2036] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:52.605638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5fb1b65f-4a19-4e0e-9b4f-57c2bfeaa6d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:52.606204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5fb1b65f-4a19-4e0e-9b4f-57c2bfeaa6d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:52.612623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5fb1b65f-4a19-4e0e-9b4f-57c2bfeaa6d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.613141 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5fb1b65f-4a19-4e0e-9b4f-57c2bfeaa6d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.613577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5fb1b65f-4a19-4e0e-9b4f-57c2bfeaa6d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.614279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5fb1b65f-4a19-4e0e-9b4f-57c2bfeaa6d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.614884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5fb1b65f-4a19-4e0e-9b4f-57c2bfeaa6d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.615396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5fb1b65f-4a19-4e0e-9b4f-57c2bfeaa6d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.744002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5fb1b65f-4a19-4e0e-9b4f-57c2bfeaa6d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:52.752152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5fb1b65f-4a19-4e0e-9b4f-57c2bfeaa6d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150463 Sep 01 05:34:52.752715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 976/2037] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:53.439210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-38aec541-1f7b-4189-8c72-fcb25d47777a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:53.439817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-38aec541-1f7b-4189-8c72-fcb25d47777a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:53.448396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38aec541-1f7b-4189-8c72-fcb25d47777a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.449261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38aec541-1f7b-4189-8c72-fcb25d47777a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.450018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38aec541-1f7b-4189-8c72-fcb25d47777a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.450796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38aec541-1f7b-4189-8c72-fcb25d47777a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.451253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38aec541-1f7b-4189-8c72-fcb25d47777a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.451676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38aec541-1f7b-4189-8c72-fcb25d47777a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.515565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-38aec541-1f7b-4189-8c72-fcb25d47777a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:53.525363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-38aec541-1f7b-4189-8c72-fcb25d47777a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:53.526805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-38aec541-1f7b-4189-8c72-fcb25d47777a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:53.527966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-38aec541-1f7b-4189-8c72-fcb25d47777a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.092635 Sep 01 05:34:53.528527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1062/2038] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:53.774267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-adbf8397-fc46-46db-a50b-e16f3ea98bf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:53.774804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-adbf8397-fc46-46db-a50b-e16f3ea98bf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:53.781352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adbf8397-fc46-46db-a50b-e16f3ea98bf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.781838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adbf8397-fc46-46db-a50b-e16f3ea98bf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.782297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adbf8397-fc46-46db-a50b-e16f3ea98bf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.782981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adbf8397-fc46-46db-a50b-e16f3ea98bf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.783435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adbf8397-fc46-46db-a50b-e16f3ea98bf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.783860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adbf8397-fc46-46db-a50b-e16f3ea98bf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.916445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-adbf8397-fc46-46db-a50b-e16f3ea98bf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:53.925052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-adbf8397-fc46-46db-a50b-e16f3ea98bf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154853 Sep 01 05:34:53.925629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 977/2039] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:54.550407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5551a310-c3be-4fb9-9631-487e824b13b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:54.550959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5551a310-c3be-4fb9-9631-487e824b13b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:54.557952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5551a310-c3be-4fb9-9631-487e824b13b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.558430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5551a310-c3be-4fb9-9631-487e824b13b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.558864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5551a310-c3be-4fb9-9631-487e824b13b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.559643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5551a310-c3be-4fb9-9631-487e824b13b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.560094 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5551a310-c3be-4fb9-9631-487e824b13b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.560513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5551a310-c3be-4fb9-9631-487e824b13b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.623975 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5551a310-c3be-4fb9-9631-487e824b13b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:54.633155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5551a310-c3be-4fb9-9631-487e824b13b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:54.634589 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5551a310-c3be-4fb9-9631-487e824b13b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:54.635725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5551a310-c3be-4fb9-9631-487e824b13b8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089315 Sep 01 05:34:54.636276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1063/2040] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:54.947888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4c27d1f4-b64f-4112-a845-2fcac1f69f1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:54.948507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4c27d1f4-b64f-4112-a845-2fcac1f69f1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:54.954950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c27d1f4-b64f-4112-a845-2fcac1f69f1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.955437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c27d1f4-b64f-4112-a845-2fcac1f69f1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.955907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c27d1f4-b64f-4112-a845-2fcac1f69f1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.956700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c27d1f4-b64f-4112-a845-2fcac1f69f1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.957185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c27d1f4-b64f-4112-a845-2fcac1f69f1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.957610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c27d1f4-b64f-4112-a845-2fcac1f69f1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:55.085050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4c27d1f4-b64f-4112-a845-2fcac1f69f1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:55.093243 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4c27d1f4-b64f-4112-a845-2fcac1f69f1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149179 Sep 01 05:34:55.093805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 978/2041] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:55.657615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8a855d07-de11-4082-a512-0178faf1dc13 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:55.658282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8a855d07-de11-4082-a512-0178faf1dc13 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:55.665709 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a855d07-de11-4082-a512-0178faf1dc13 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:55.666181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a855d07-de11-4082-a512-0178faf1dc13 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:55.666612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a855d07-de11-4082-a512-0178faf1dc13 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:55.667286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a855d07-de11-4082-a512-0178faf1dc13 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:55.667728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a855d07-de11-4082-a512-0178faf1dc13 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:55.668145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a855d07-de11-4082-a512-0178faf1dc13 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:55.729656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8a855d07-de11-4082-a512-0178faf1dc13 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:55.738083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8a855d07-de11-4082-a512-0178faf1dc13 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:55.739538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8a855d07-de11-4082-a512-0178faf1dc13 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:55.740869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8a855d07-de11-4082-a512-0178faf1dc13 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087125 Sep 01 05:34:55.741561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1064/2042] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:56.113911 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f5831a4a-1749-4ab1-a9c9-f4a0539e3600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:56.115227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f5831a4a-1749-4ab1-a9c9-f4a0539e3600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:56.122338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f5831a4a-1749-4ab1-a9c9-f4a0539e3600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.122814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f5831a4a-1749-4ab1-a9c9-f4a0539e3600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.123241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f5831a4a-1749-4ab1-a9c9-f4a0539e3600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.123920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f5831a4a-1749-4ab1-a9c9-f4a0539e3600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.124360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f5831a4a-1749-4ab1-a9c9-f4a0539e3600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.124802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f5831a4a-1749-4ab1-a9c9-f4a0539e3600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.257604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f5831a4a-1749-4ab1-a9c9-f4a0539e3600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:56.265761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f5831a4a-1749-4ab1-a9c9-f4a0539e3600 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155663 Sep 01 05:34:56.266323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 979/2043] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:56.763800 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3e3d93a3-edde-4ed5-9fb9-b8b7ab025eaf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:56.764408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3e3d93a3-edde-4ed5-9fb9-b8b7ab025eaf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:56.771296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3e3d93a3-edde-4ed5-9fb9-b8b7ab025eaf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.771762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3e3d93a3-edde-4ed5-9fb9-b8b7ab025eaf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.772186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3e3d93a3-edde-4ed5-9fb9-b8b7ab025eaf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.772882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3e3d93a3-edde-4ed5-9fb9-b8b7ab025eaf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.773320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3e3d93a3-edde-4ed5-9fb9-b8b7ab025eaf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.773773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3e3d93a3-edde-4ed5-9fb9-b8b7ab025eaf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.834541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3e3d93a3-edde-4ed5-9fb9-b8b7ab025eaf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:56.843015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3e3d93a3-edde-4ed5-9fb9-b8b7ab025eaf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:56.844456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3e3d93a3-edde-4ed5-9fb9-b8b7ab025eaf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:56.845627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3e3d93a3-edde-4ed5-9fb9-b8b7ab025eaf tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085765 Sep 01 05:34:56.846181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1065/2044] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:57.287524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b059184e-e30d-484f-b5c0-fda345d3e816 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:57.288140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b059184e-e30d-484f-b5c0-fda345d3e816 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:57.290890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:34:57.291029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:34:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 (ip 10.222.0.49) !!! Sep 01 05:34:57.296960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b059184e-e30d-484f-b5c0-fda345d3e816 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:57.297446 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b059184e-e30d-484f-b5c0-fda345d3e816 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:57.297884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b059184e-e30d-484f-b5c0-fda345d3e816 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:57.298576 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b059184e-e30d-484f-b5c0-fda345d3e816 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:57.299029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b059184e-e30d-484f-b5c0-fda345d3e816 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:57.299453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b059184e-e30d-484f-b5c0-fda345d3e816 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:57.428258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b059184e-e30d-484f-b5c0-fda345d3e816 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:57.436356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b059184e-e30d-484f-b5c0-fda345d3e816 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153449 Sep 01 05:34:57.436940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 980/2045] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:57 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:57.868322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d151383b-6174-49ac-9f56-e66157db46bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:57.868953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d151383b-6174-49ac-9f56-e66157db46bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:57.875254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d151383b-6174-49ac-9f56-e66157db46bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:57.875720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d151383b-6174-49ac-9f56-e66157db46bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:57.876144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d151383b-6174-49ac-9f56-e66157db46bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:57.876833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d151383b-6174-49ac-9f56-e66157db46bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:57.877280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d151383b-6174-49ac-9f56-e66157db46bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:57.877692 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d151383b-6174-49ac-9f56-e66157db46bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:57.939848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d151383b-6174-49ac-9f56-e66157db46bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:57.948781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d151383b-6174-49ac-9f56-e66157db46bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:57.950230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d151383b-6174-49ac-9f56-e66157db46bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:57.951363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d151383b-6174-49ac-9f56-e66157db46bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087648 Sep 01 05:34:57.951918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1066/2046] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:58.459115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7113a123-0da5-459a-b22e-0eb2e5a689ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:58.459723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7113a123-0da5-459a-b22e-0eb2e5a689ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:58.466174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7113a123-0da5-459a-b22e-0eb2e5a689ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.466653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7113a123-0da5-459a-b22e-0eb2e5a689ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.467082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7113a123-0da5-459a-b22e-0eb2e5a689ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:58.467769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7113a123-0da5-459a-b22e-0eb2e5a689ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.468219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7113a123-0da5-459a-b22e-0eb2e5a689ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.468638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7113a123-0da5-459a-b22e-0eb2e5a689ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:58.472477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:58.598534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7113a123-0da5-459a-b22e-0eb2e5a689ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:58.606892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7113a123-0da5-459a-b22e-0eb2e5a689ec tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152329 Sep 01 05:34:58.607449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 981/2047] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:58 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:58.973754 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-40e927d3-0f54-481c-a7e8-99a702bd6b4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:58.974475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-40e927d3-0f54-481c-a7e8-99a702bd6b4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:58.980803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40e927d3-0f54-481c-a7e8-99a702bd6b4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.981261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40e927d3-0f54-481c-a7e8-99a702bd6b4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.981689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40e927d3-0f54-481c-a7e8-99a702bd6b4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:58.982360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40e927d3-0f54-481c-a7e8-99a702bd6b4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.982802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40e927d3-0f54-481c-a7e8-99a702bd6b4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.983213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40e927d3-0f54-481c-a7e8-99a702bd6b4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.047498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40e927d3-0f54-481c-a7e8-99a702bd6b4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:59.056572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40e927d3-0f54-481c-a7e8-99a702bd6b4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:59.058020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40e927d3-0f54-481c-a7e8-99a702bd6b4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:59.059141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-40e927d3-0f54-481c-a7e8-99a702bd6b4e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089329 Sep 01 05:34:59.059692 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1067/2048] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:59.627967 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1dc6f2f8-3ba5-449f-b1fd-8638bc2e4ccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:59.628579 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1dc6f2f8-3ba5-449f-b1fd-8638bc2e4ccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:59.634998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1dc6f2f8-3ba5-449f-b1fd-8638bc2e4ccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:59.635476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1dc6f2f8-3ba5-449f-b1fd-8638bc2e4ccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:59.635905 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1dc6f2f8-3ba5-449f-b1fd-8638bc2e4ccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.636583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1dc6f2f8-3ba5-449f-b1fd-8638bc2e4ccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:59.637052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1dc6f2f8-3ba5-449f-b1fd-8638bc2e4ccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:59.637470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1dc6f2f8-3ba5-449f-b1fd-8638bc2e4ccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.765941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1dc6f2f8-3ba5-449f-b1fd-8638bc2e4ccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:59.774445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1dc6f2f8-3ba5-449f-b1fd-8638bc2e4ccd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150314 Sep 01 05:34:59.775004 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 982/2049] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:59 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:00.082184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fb94ae7d-be81-4ad5-af7f-5503fa197742 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:00.082928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fb94ae7d-be81-4ad5-af7f-5503fa197742 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:00.089508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fb94ae7d-be81-4ad5-af7f-5503fa197742 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.090150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fb94ae7d-be81-4ad5-af7f-5503fa197742 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.090624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fb94ae7d-be81-4ad5-af7f-5503fa197742 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.091305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fb94ae7d-be81-4ad5-af7f-5503fa197742 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.091745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fb94ae7d-be81-4ad5-af7f-5503fa197742 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.092167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fb94ae7d-be81-4ad5-af7f-5503fa197742 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.154056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fb94ae7d-be81-4ad5-af7f-5503fa197742 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:00.162602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fb94ae7d-be81-4ad5-af7f-5503fa197742 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:00.164035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fb94ae7d-be81-4ad5-af7f-5503fa197742 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:00.165457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fb94ae7d-be81-4ad5-af7f-5503fa197742 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086965 Sep 01 05:35:00.166019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1068/2050] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:00 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:00.796409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-abcd9f76-56f6-49ea-80d1-287ad1a3908b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:00.797033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-abcd9f76-56f6-49ea-80d1-287ad1a3908b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:00.804097 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abcd9f76-56f6-49ea-80d1-287ad1a3908b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.804566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abcd9f76-56f6-49ea-80d1-287ad1a3908b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.805033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abcd9f76-56f6-49ea-80d1-287ad1a3908b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.805720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abcd9f76-56f6-49ea-80d1-287ad1a3908b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.806163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abcd9f76-56f6-49ea-80d1-287ad1a3908b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.806577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abcd9f76-56f6-49ea-80d1-287ad1a3908b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.936242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-abcd9f76-56f6-49ea-80d1-287ad1a3908b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:00.945308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-abcd9f76-56f6-49ea-80d1-287ad1a3908b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152797 Sep 01 05:35:00.945867 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 983/2051] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:01.187452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-067846aa-df17-49ef-ae0e-71c44902efdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:01.188060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-067846aa-df17-49ef-ae0e-71c44902efdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:01.195328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-067846aa-df17-49ef-ae0e-71c44902efdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.195803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-067846aa-df17-49ef-ae0e-71c44902efdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.196233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-067846aa-df17-49ef-ae0e-71c44902efdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.196942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-067846aa-df17-49ef-ae0e-71c44902efdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.197398 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-067846aa-df17-49ef-ae0e-71c44902efdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.197811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-067846aa-df17-49ef-ae0e-71c44902efdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.261339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-067846aa-df17-49ef-ae0e-71c44902efdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:01.269903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-067846aa-df17-49ef-ae0e-71c44902efdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:01.271340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-067846aa-df17-49ef-ae0e-71c44902efdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:01.272468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-067846aa-df17-49ef-ae0e-71c44902efdb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088912 Sep 01 05:35:01.273071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1069/2052] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:01.966441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e802deb6-e939-49fe-9e61-7fae5c7f2ef7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:01.967095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e802deb6-e939-49fe-9e61-7fae5c7f2ef7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:01.974420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e802deb6-e939-49fe-9e61-7fae5c7f2ef7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.974889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e802deb6-e939-49fe-9e61-7fae5c7f2ef7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.975314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e802deb6-e939-49fe-9e61-7fae5c7f2ef7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.975995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e802deb6-e939-49fe-9e61-7fae5c7f2ef7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.976436 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e802deb6-e939-49fe-9e61-7fae5c7f2ef7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.976887 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e802deb6-e939-49fe-9e61-7fae5c7f2ef7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.103976 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e802deb6-e939-49fe-9e61-7fae5c7f2ef7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:02.112096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e802deb6-e939-49fe-9e61-7fae5c7f2ef7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149577 Sep 01 05:35:02.112654 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 984/2053] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:01 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:02.295373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ff8804f8-436a-400c-975f-37304a8cd205 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:02.295910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ff8804f8-436a-400c-975f-37304a8cd205 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:02.302768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff8804f8-436a-400c-975f-37304a8cd205 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:02.303249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff8804f8-436a-400c-975f-37304a8cd205 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:02.303678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff8804f8-436a-400c-975f-37304a8cd205 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.304361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff8804f8-436a-400c-975f-37304a8cd205 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:02.304831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff8804f8-436a-400c-975f-37304a8cd205 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:02.305258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ff8804f8-436a-400c-975f-37304a8cd205 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.366513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ff8804f8-436a-400c-975f-37304a8cd205 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:02.374913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ff8804f8-436a-400c-975f-37304a8cd205 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:02.376344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ff8804f8-436a-400c-975f-37304a8cd205 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:02.377542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ff8804f8-436a-400c-975f-37304a8cd205 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086212 Sep 01 05:35:02.378103 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1070/2054] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:03.133062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bbb13184-8fcc-476e-ab54-2e79935930f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:03.133671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bbb13184-8fcc-476e-ab54-2e79935930f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:03.140213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbb13184-8fcc-476e-ab54-2e79935930f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.140689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbb13184-8fcc-476e-ab54-2e79935930f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.141163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbb13184-8fcc-476e-ab54-2e79935930f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.141943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbb13184-8fcc-476e-ab54-2e79935930f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.142443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbb13184-8fcc-476e-ab54-2e79935930f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.142896 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbb13184-8fcc-476e-ab54-2e79935930f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.275825 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bbb13184-8fcc-476e-ab54-2e79935930f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:03.284145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bbb13184-8fcc-476e-ab54-2e79935930f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155578 Sep 01 05:35:03.284823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 985/2055] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:03 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:03.400351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-80d7f4ae-8dfd-4f62-b07e-374627cf1161 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:03.400994 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-80d7f4ae-8dfd-4f62-b07e-374627cf1161 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:03.407253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80d7f4ae-8dfd-4f62-b07e-374627cf1161 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.407727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80d7f4ae-8dfd-4f62-b07e-374627cf1161 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.408152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80d7f4ae-8dfd-4f62-b07e-374627cf1161 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.408856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80d7f4ae-8dfd-4f62-b07e-374627cf1161 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.409301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80d7f4ae-8dfd-4f62-b07e-374627cf1161 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.409713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80d7f4ae-8dfd-4f62-b07e-374627cf1161 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.447921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3f0225b6-ec8f-48c9-97f1-19b63468f059 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:03.448423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3f0225b6-ec8f-48c9-97f1-19b63468f059 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:03.454636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f0225b6-ec8f-48c9-97f1-19b63468f059 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.455400 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f0225b6-ec8f-48c9-97f1-19b63468f059 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.455846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f0225b6-ec8f-48c9-97f1-19b63468f059 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.456547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f0225b6-ec8f-48c9-97f1-19b63468f059 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.457026 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f0225b6-ec8f-48c9-97f1-19b63468f059 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.457489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f0225b6-ec8f-48c9-97f1-19b63468f059 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.471144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-3f0225b6-ec8f-48c9-97f1-19b63468f059 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] HTTP exception thrown: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3f0225b6-ec8f-48c9-97f1-19b63468f059 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Request method failure captured: Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 HTTP/1.1 Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED-1ohArlcqyRQ3GM507mA8OeXhOwsTxgdizBpUNvCXmYXtRJMNdNMgvI2W73Djx5cuX-C6AuLvmhil688UiqvfZJECg1ycfiaSmD_FKvrkAwJR5Xs7U03aCnPlyNSCUltTGf9uM8U0IVZaVqbGURDD7lAhQ22x2H6IZ5nnsuIOeX5w Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 6c302f5c44be49e5ae6e7e6b8b1f6c1c Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:35:03.473205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:35:03.474878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6c302f5c44be49e5ae6e7e6b8b1f6c1c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}] Sep 01 05:35:03.474878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:35:03.474878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 6c302f5c44be49e5ae6e7e6b8b1f6c1c Sep 01 05:35:03.474878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:35:03.474878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-AttachVolumeTestJSON-846640785-project Sep 01 05:35:03.474878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:35:03.474878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:35:03.474878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 11f90807029244ecb6ad7cf6e4d2ad80 Sep 01 05:35:03.474878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-AttachVolumeTestJSON-846640785-project Sep 01 05:35:03.474878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:35:03.474878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:35:03.474878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': 'dbc80648-73e9-4ce0-9161-2a82c5634104'} Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:03.476408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:35:03.477822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:35:03.479284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3f0225b6-ec8f-48c9-97f1-19b63468f059 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Returning 404 to user: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:03.479284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3f0225b6-ec8f-48c9-97f1-19b63468f059 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 404 len: 111 microversion: 2.1 time: 0.030661 Sep 01 05:35:03.479434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-80d7f4ae-8dfd-4f62-b07e-374627cf1161 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:03.487023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-80d7f4ae-8dfd-4f62-b07e-374627cf1161 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:03.488475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-80d7f4ae-8dfd-4f62-b07e-374627cf1161 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:03.489203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 986/2056] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:35:03 2022] DELETE /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:35:03.491042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-80d7f4ae-8dfd-4f62-b07e-374627cf1161 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.094286 Sep 01 05:35:03.491914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1071/2057] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:03.497581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-66f93f9c-d75d-4a15-876a-2d95f090370b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:03.498198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-66f93f9c-d75d-4a15-876a-2d95f090370b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: dbc80648-73e9-4ce0-9161-2a82c5634104] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:03.504897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66f93f9c-d75d-4a15-876a-2d95f090370b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.505401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66f93f9c-d75d-4a15-876a-2d95f090370b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.506033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66f93f9c-d75d-4a15-876a-2d95f090370b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.506735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66f93f9c-d75d-4a15-876a-2d95f090370b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.507188 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66f93f9c-d75d-4a15-876a-2d95f090370b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.507609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66f93f9c-d75d-4a15-876a-2d95f090370b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.521330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-66f93f9c-d75d-4a15-876a-2d95f090370b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] HTTP exception thrown: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-66f93f9c-d75d-4a15-876a-2d95f090370b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Request method failure captured: Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 HTTP/1.1 Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED-1ohArlcqyRQ3GM507mA8OeXhOwsTxgdizBpUNvCXmYXtRJMNdNMgvI2W73Djx5cuX-C6AuLvmhil688UiqvfZJECg1ycfiaSmD_FKvrkAwJR5Xs7U03aCnPlyNSCUltTGf9uM8U0IVZaVqbGURDD7lAhQ22x2H6IZ5nnsuIOeX5w Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 6c302f5c44be49e5ae6e7e6b8b1f6c1c Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:35:03.522891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:35:03.524459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6c302f5c44be49e5ae6e7e6b8b1f6c1c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}] Sep 01 05:35:03.524459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:35:03.524459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 6c302f5c44be49e5ae6e7e6b8b1f6c1c Sep 01 05:35:03.524459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:35:03.524459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-AttachVolumeTestJSON-846640785-project Sep 01 05:35:03.524459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:35:03.524459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:35:03.524459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 11f90807029244ecb6ad7cf6e4d2ad80 Sep 01 05:35:03.524459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-AttachVolumeTestJSON-846640785-project Sep 01 05:35:03.524459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:35:03.524459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:35:03.524459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': 'dbc80648-73e9-4ce0-9161-2a82c5634104'} Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:03.525551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. Sep 01 05:35:03.527027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:35:03.528516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-66f93f9c-d75d-4a15-876a-2d95f090370b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Returning 404 to user: Instance dbc80648-73e9-4ce0-9161-2a82c5634104 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:03.528516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-66f93f9c-d75d-4a15-876a-2d95f090370b tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104" status: 404 len: 111 microversion: 2.1 time: 0.031171 Sep 01 05:35:03.528516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 987/2058] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:03 2022] GET /compute/v2.1/servers/dbc80648-73e9-4ce0-9161-2a82c5634104 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:35:04.306175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9453d9eb-e666-40c6-962f-5446429195bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:04.306794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9453d9eb-e666-40c6-962f-5446429195bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:04.312739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9453d9eb-e666-40c6-962f-5446429195bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:04.313253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9453d9eb-e666-40c6-962f-5446429195bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:04.313691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9453d9eb-e666-40c6-962f-5446429195bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.314371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9453d9eb-e666-40c6-962f-5446429195bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:04.314822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9453d9eb-e666-40c6-962f-5446429195bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:04.315245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9453d9eb-e666-40c6-962f-5446429195bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.447910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9453d9eb-e666-40c6-962f-5446429195bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:04.456183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9453d9eb-e666-40c6-962f-5446429195bc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153905 Sep 01 05:35:04.456744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1072/2059] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:04.514452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3a79d89b-3e59-4061-a7d6-5dfcc51eea91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:04.515092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3a79d89b-3e59-4061-a7d6-5dfcc51eea91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:04.523012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a79d89b-3e59-4061-a7d6-5dfcc51eea91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:04.523423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a79d89b-3e59-4061-a7d6-5dfcc51eea91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:04.523877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a79d89b-3e59-4061-a7d6-5dfcc51eea91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.524578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a79d89b-3e59-4061-a7d6-5dfcc51eea91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:04.525058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a79d89b-3e59-4061-a7d6-5dfcc51eea91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:04.525477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a79d89b-3e59-4061-a7d6-5dfcc51eea91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.602321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3a79d89b-3e59-4061-a7d6-5dfcc51eea91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:04.611852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3a79d89b-3e59-4061-a7d6-5dfcc51eea91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:04.614756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3a79d89b-3e59-4061-a7d6-5dfcc51eea91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:04.616483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3a79d89b-3e59-4061-a7d6-5dfcc51eea91 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.105689 Sep 01 05:35:04.617466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 988/2060] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:05.477176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c1fc9108-0960-48bc-b07b-4407015c2f34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:05.477824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c1fc9108-0960-48bc-b07b-4407015c2f34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:05.484215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1fc9108-0960-48bc-b07b-4407015c2f34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.484695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1fc9108-0960-48bc-b07b-4407015c2f34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.485163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1fc9108-0960-48bc-b07b-4407015c2f34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.485841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1fc9108-0960-48bc-b07b-4407015c2f34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.486294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1fc9108-0960-48bc-b07b-4407015c2f34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.486717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1fc9108-0960-48bc-b07b-4407015c2f34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.615413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c1fc9108-0960-48bc-b07b-4407015c2f34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:05.623535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c1fc9108-0960-48bc-b07b-4407015c2f34 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150249 Sep 01 05:35:05.624100 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1073/2061] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:05 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:05.641686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4ca3e877-f423-4c8a-8e1c-983f8fba63d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:05.642285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4ca3e877-f423-4c8a-8e1c-983f8fba63d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:05.649181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ca3e877-f423-4c8a-8e1c-983f8fba63d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.649656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ca3e877-f423-4c8a-8e1c-983f8fba63d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.650086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ca3e877-f423-4c8a-8e1c-983f8fba63d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.650759 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ca3e877-f423-4c8a-8e1c-983f8fba63d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.651200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ca3e877-f423-4c8a-8e1c-983f8fba63d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.651615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4ca3e877-f423-4c8a-8e1c-983f8fba63d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.713483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4ca3e877-f423-4c8a-8e1c-983f8fba63d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:05.721978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4ca3e877-f423-4c8a-8e1c-983f8fba63d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:05.723567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4ca3e877-f423-4c8a-8e1c-983f8fba63d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:05.724695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4ca3e877-f423-4c8a-8e1c-983f8fba63d5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086865 Sep 01 05:35:05.725285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 989/2062] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:06.646765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9c81b90d-8f3e-4f08-8503-6dac7029b0f2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:06.647380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9c81b90d-8f3e-4f08-8503-6dac7029b0f2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:06.653713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c81b90d-8f3e-4f08-8503-6dac7029b0f2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:06.654186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c81b90d-8f3e-4f08-8503-6dac7029b0f2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:06.654609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c81b90d-8f3e-4f08-8503-6dac7029b0f2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:06.655281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c81b90d-8f3e-4f08-8503-6dac7029b0f2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:06.655722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c81b90d-8f3e-4f08-8503-6dac7029b0f2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:06.656138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9c81b90d-8f3e-4f08-8503-6dac7029b0f2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:06.747431 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9552a916-c4af-4113-b146-1950983b569c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:06.748167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9552a916-c4af-4113-b146-1950983b569c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:06.755205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9552a916-c4af-4113-b146-1950983b569c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:06.755769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9552a916-c4af-4113-b146-1950983b569c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:06.756207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9552a916-c4af-4113-b146-1950983b569c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:06.756931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9552a916-c4af-4113-b146-1950983b569c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:06.757381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9552a916-c4af-4113-b146-1950983b569c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:06.757804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9552a916-c4af-4113-b146-1950983b569c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:06.791626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9c81b90d-8f3e-4f08-8503-6dac7029b0f2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:06.799936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9c81b90d-8f3e-4f08-8503-6dac7029b0f2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157394 Sep 01 05:35:06.800511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1074/2063] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:06 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:06.821761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9552a916-c4af-4113-b146-1950983b569c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:06.830242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9552a916-c4af-4113-b146-1950983b569c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:06.831684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9552a916-c4af-4113-b146-1950983b569c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:06.833560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9552a916-c4af-4113-b146-1950983b569c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090024 Sep 01 05:35:06.834116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 990/2064] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:35:07.821830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-116938dd-8b3e-4f7e-a6e4-8946a2be133c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:07.822564 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-116938dd-8b3e-4f7e-a6e4-8946a2be133c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:07.829017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-116938dd-8b3e-4f7e-a6e4-8946a2be133c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:07.829496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-116938dd-8b3e-4f7e-a6e4-8946a2be133c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:07.829931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-116938dd-8b3e-4f7e-a6e4-8946a2be133c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:07.830605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-116938dd-8b3e-4f7e-a6e4-8946a2be133c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:07.831085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-116938dd-8b3e-4f7e-a6e4-8946a2be133c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:07.831502 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-116938dd-8b3e-4f7e-a6e4-8946a2be133c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:07.856017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-34b15948-74e1-48e3-9a03-25361ff2bd5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:07.856623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-34b15948-74e1-48e3-9a03-25361ff2bd5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:07.863024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34b15948-74e1-48e3-9a03-25361ff2bd5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:07.864204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34b15948-74e1-48e3-9a03-25361ff2bd5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:07.864750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34b15948-74e1-48e3-9a03-25361ff2bd5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:07.865418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34b15948-74e1-48e3-9a03-25361ff2bd5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:07.865870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34b15948-74e1-48e3-9a03-25361ff2bd5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:07.866288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34b15948-74e1-48e3-9a03-25361ff2bd5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:07.929135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-34b15948-74e1-48e3-9a03-25361ff2bd5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:07.937904 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-34b15948-74e1-48e3-9a03-25361ff2bd5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:07.939388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-34b15948-74e1-48e3-9a03-25361ff2bd5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:07.940530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-34b15948-74e1-48e3-9a03-25361ff2bd5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088417 Sep 01 05:35:07.942088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 991/2065] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:07 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:35:07.967199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-116938dd-8b3e-4f7e-a6e4-8946a2be133c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:07.975699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-116938dd-8b3e-4f7e-a6e4-8946a2be133c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157778 Sep 01 05:35:07.976265 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1075/2066] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:07 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:08.963667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bbd6d5c8-2dd3-430c-a93f-3a731ad1fe1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:08.964274 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bbd6d5c8-2dd3-430c-a93f-3a731ad1fe1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:08.970673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbd6d5c8-2dd3-430c-a93f-3a731ad1fe1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:08.971153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbd6d5c8-2dd3-430c-a93f-3a731ad1fe1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:08.971609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbd6d5c8-2dd3-430c-a93f-3a731ad1fe1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:08.972273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbd6d5c8-2dd3-430c-a93f-3a731ad1fe1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:08.973718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbd6d5c8-2dd3-430c-a93f-3a731ad1fe1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:08.974156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbd6d5c8-2dd3-430c-a93f-3a731ad1fe1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:08.997387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e03b0357-c575-4b80-8439-a2871f9a8f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:08.998111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e03b0357-c575-4b80-8439-a2871f9a8f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:09.004564 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e03b0357-c575-4b80-8439-a2871f9a8f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:09.005093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e03b0357-c575-4b80-8439-a2871f9a8f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:09.005523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e03b0357-c575-4b80-8439-a2871f9a8f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:09.006201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e03b0357-c575-4b80-8439-a2871f9a8f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:09.006649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e03b0357-c575-4b80-8439-a2871f9a8f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:09.007062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e03b0357-c575-4b80-8439-a2871f9a8f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:09.022777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:09.040460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bbd6d5c8-2dd3-430c-a93f-3a731ad1fe1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:09.049375 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bbd6d5c8-2dd3-430c-a93f-3a731ad1fe1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:09.051584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bbd6d5c8-2dd3-430c-a93f-3a731ad1fe1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:09.053042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bbd6d5c8-2dd3-430c-a93f-3a731ad1fe1b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.093280 Sep 01 05:35:09.053610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 992/2067] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:09.141074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e03b0357-c575-4b80-8439-a2871f9a8f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:09.149967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e03b0357-c575-4b80-8439-a2871f9a8f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156262 Sep 01 05:35:09.150476 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1076/2068] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:08 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:10.075697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-898c7454-c215-4027-9515-73771bd736b7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:10.076306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-898c7454-c215-4027-9515-73771bd736b7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:10.083251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-898c7454-c215-4027-9515-73771bd736b7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:10.083724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-898c7454-c215-4027-9515-73771bd736b7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:10.084153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-898c7454-c215-4027-9515-73771bd736b7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:10.084855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-898c7454-c215-4027-9515-73771bd736b7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:10.085359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-898c7454-c215-4027-9515-73771bd736b7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:10.085776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-898c7454-c215-4027-9515-73771bd736b7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:10.148342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-898c7454-c215-4027-9515-73771bd736b7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:10.156842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-898c7454-c215-4027-9515-73771bd736b7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:10.158271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-898c7454-c215-4027-9515-73771bd736b7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:10.159401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-898c7454-c215-4027-9515-73771bd736b7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087641 Sep 01 05:35:10.159985 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 993/2069] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:10 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:10.171338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dc0beb5f-bf82-4037-b60b-e41171010521 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:10.171961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dc0beb5f-bf82-4037-b60b-e41171010521 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:10.178582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc0beb5f-bf82-4037-b60b-e41171010521 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:10.179095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc0beb5f-bf82-4037-b60b-e41171010521 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:10.179530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc0beb5f-bf82-4037-b60b-e41171010521 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:10.180218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc0beb5f-bf82-4037-b60b-e41171010521 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:10.180670 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc0beb5f-bf82-4037-b60b-e41171010521 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:10.181128 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc0beb5f-bf82-4037-b60b-e41171010521 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:10.308315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-dc0beb5f-bf82-4037-b60b-e41171010521 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:10.317746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dc0beb5f-bf82-4037-b60b-e41171010521 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149961 Sep 01 05:35:10.318522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1077/2070] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:11.182424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-19428350-6880-4e5b-ab8a-d27a84d69e7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:11.182959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-19428350-6880-4e5b-ab8a-d27a84d69e7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:11.189329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19428350-6880-4e5b-ab8a-d27a84d69e7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:11.189804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19428350-6880-4e5b-ab8a-d27a84d69e7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:11.190231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19428350-6880-4e5b-ab8a-d27a84d69e7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:11.190903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19428350-6880-4e5b-ab8a-d27a84d69e7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:11.191344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19428350-6880-4e5b-ab8a-d27a84d69e7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:11.191756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-19428350-6880-4e5b-ab8a-d27a84d69e7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:11.252086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-19428350-6880-4e5b-ab8a-d27a84d69e7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:11.260677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-19428350-6880-4e5b-ab8a-d27a84d69e7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:11.262142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-19428350-6880-4e5b-ab8a-d27a84d69e7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:11.263289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-19428350-6880-4e5b-ab8a-d27a84d69e7c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.084875 Sep 01 05:35:11.263834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 994/2071] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:11.339062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-87a77f38-b77b-4deb-88fe-c978728ad8bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:11.339672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-87a77f38-b77b-4deb-88fe-c978728ad8bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:11.346008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87a77f38-b77b-4deb-88fe-c978728ad8bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:11.346482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87a77f38-b77b-4deb-88fe-c978728ad8bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:11.346910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87a77f38-b77b-4deb-88fe-c978728ad8bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:11.347575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87a77f38-b77b-4deb-88fe-c978728ad8bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:11.348016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87a77f38-b77b-4deb-88fe-c978728ad8bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:11.349081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87a77f38-b77b-4deb-88fe-c978728ad8bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:11.479557 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-87a77f38-b77b-4deb-88fe-c978728ad8bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:11.487834 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-87a77f38-b77b-4deb-88fe-c978728ad8bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152556 Sep 01 05:35:11.488404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1078/2072] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:11 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:12.285486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f361f5f6-552f-4ceb-b8c3-5ede4f2e5ea0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:12.286041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f361f5f6-552f-4ceb-b8c3-5ede4f2e5ea0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:12.292681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f361f5f6-552f-4ceb-b8c3-5ede4f2e5ea0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:12.293200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f361f5f6-552f-4ceb-b8c3-5ede4f2e5ea0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:12.293626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f361f5f6-552f-4ceb-b8c3-5ede4f2e5ea0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:12.294297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f361f5f6-552f-4ceb-b8c3-5ede4f2e5ea0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:12.294740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f361f5f6-552f-4ceb-b8c3-5ede4f2e5ea0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:12.295154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f361f5f6-552f-4ceb-b8c3-5ede4f2e5ea0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:12.355310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f361f5f6-552f-4ceb-b8c3-5ede4f2e5ea0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:12.364498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f361f5f6-552f-4ceb-b8c3-5ede4f2e5ea0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:12.365995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f361f5f6-552f-4ceb-b8c3-5ede4f2e5ea0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:12.367170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f361f5f6-552f-4ceb-b8c3-5ede4f2e5ea0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085689 Sep 01 05:35:12.367724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 995/2073] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:12 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:12.511018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7c6f8fea-9e75-40c7-8a49-9b1984bbc364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:12.511656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7c6f8fea-9e75-40c7-8a49-9b1984bbc364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:12.518058 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7c6f8fea-9e75-40c7-8a49-9b1984bbc364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:12.518543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7c6f8fea-9e75-40c7-8a49-9b1984bbc364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:12.518978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7c6f8fea-9e75-40c7-8a49-9b1984bbc364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:12.519659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7c6f8fea-9e75-40c7-8a49-9b1984bbc364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:12.520171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7c6f8fea-9e75-40c7-8a49-9b1984bbc364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:12.520702 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7c6f8fea-9e75-40c7-8a49-9b1984bbc364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:12.645440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7c6f8fea-9e75-40c7-8a49-9b1984bbc364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:12.653495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7c6f8fea-9e75-40c7-8a49-9b1984bbc364 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.146419 Sep 01 05:35:12.654059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1079/2074] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:12 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:13.390231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a7d07199-d0e8-4ffe-b659-c29c00506474 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:13.390832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a7d07199-d0e8-4ffe-b659-c29c00506474 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:13.396958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7d07199-d0e8-4ffe-b659-c29c00506474 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:13.397429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7d07199-d0e8-4ffe-b659-c29c00506474 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:13.397856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7d07199-d0e8-4ffe-b659-c29c00506474 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:13.398525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7d07199-d0e8-4ffe-b659-c29c00506474 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:13.398972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7d07199-d0e8-4ffe-b659-c29c00506474 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:13.399383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7d07199-d0e8-4ffe-b659-c29c00506474 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:13.460487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a7d07199-d0e8-4ffe-b659-c29c00506474 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:13.468937 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a7d07199-d0e8-4ffe-b659-c29c00506474 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:13.470362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a7d07199-d0e8-4ffe-b659-c29c00506474 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:13.471490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a7d07199-d0e8-4ffe-b659-c29c00506474 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085121 Sep 01 05:35:13.472039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 996/2075] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:13 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:13.675160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-38f8c486-34cb-4ec2-bb14-a5af91f65c2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:13.675776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-38f8c486-34cb-4ec2-bb14-a5af91f65c2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:13.682601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38f8c486-34cb-4ec2-bb14-a5af91f65c2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:13.683075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38f8c486-34cb-4ec2-bb14-a5af91f65c2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:13.683510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38f8c486-34cb-4ec2-bb14-a5af91f65c2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:13.684182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38f8c486-34cb-4ec2-bb14-a5af91f65c2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:13.684627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38f8c486-34cb-4ec2-bb14-a5af91f65c2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:13.685066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38f8c486-34cb-4ec2-bb14-a5af91f65c2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:13.812375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-38f8c486-34cb-4ec2-bb14-a5af91f65c2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:13.821485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-38f8c486-34cb-4ec2-bb14-a5af91f65c2e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150139 Sep 01 05:35:13.822050 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1080/2076] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:14.494696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e748d20f-cff3-4a30-a520-2117e2f12e57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:14.495330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e748d20f-cff3-4a30-a520-2117e2f12e57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:14.501642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e748d20f-cff3-4a30-a520-2117e2f12e57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.502117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e748d20f-cff3-4a30-a520-2117e2f12e57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.502543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e748d20f-cff3-4a30-a520-2117e2f12e57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:14.503215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e748d20f-cff3-4a30-a520-2117e2f12e57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.503657 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e748d20f-cff3-4a30-a520-2117e2f12e57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.504069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e748d20f-cff3-4a30-a520-2117e2f12e57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:14.569713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e748d20f-cff3-4a30-a520-2117e2f12e57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:14.578130 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e748d20f-cff3-4a30-a520-2117e2f12e57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:14.579553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e748d20f-cff3-4a30-a520-2117e2f12e57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:14.580675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e748d20f-cff3-4a30-a520-2117e2f12e57 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089948 Sep 01 05:35:14.581252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 997/2077] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:14.842719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-45742fc2-3059-4b58-bb8d-4d5ec2887f06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:14.843417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-45742fc2-3059-4b58-bb8d-4d5ec2887f06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:14.850417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45742fc2-3059-4b58-bb8d-4d5ec2887f06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.850888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45742fc2-3059-4b58-bb8d-4d5ec2887f06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.851315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45742fc2-3059-4b58-bb8d-4d5ec2887f06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:14.851985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45742fc2-3059-4b58-bb8d-4d5ec2887f06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.852424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45742fc2-3059-4b58-bb8d-4d5ec2887f06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.852863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45742fc2-3059-4b58-bb8d-4d5ec2887f06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:14.986715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-45742fc2-3059-4b58-bb8d-4d5ec2887f06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:14.994915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-45742fc2-3059-4b58-bb8d-4d5ec2887f06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156073 Sep 01 05:35:14.995477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1081/2078] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:14 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:15.603964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-83817b92-be36-407f-9aa7-b1cf9d6a68c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:15.604560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-83817b92-be36-407f-9aa7-b1cf9d6a68c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:15.611346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-83817b92-be36-407f-9aa7-b1cf9d6a68c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:15.611826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-83817b92-be36-407f-9aa7-b1cf9d6a68c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:15.612261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-83817b92-be36-407f-9aa7-b1cf9d6a68c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:15.612983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-83817b92-be36-407f-9aa7-b1cf9d6a68c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:15.613434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-83817b92-be36-407f-9aa7-b1cf9d6a68c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:15.613854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-83817b92-be36-407f-9aa7-b1cf9d6a68c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:15.674150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-83817b92-be36-407f-9aa7-b1cf9d6a68c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:15.683552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-83817b92-be36-407f-9aa7-b1cf9d6a68c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:15.685025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-83817b92-be36-407f-9aa7-b1cf9d6a68c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:15.686171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-83817b92-be36-407f-9aa7-b1cf9d6a68c1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086196 Sep 01 05:35:15.686720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 998/2079] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:16.017197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5d9dd065-9276-42a6-a183-8542a350c3b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:16.017807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5d9dd065-9276-42a6-a183-8542a350c3b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:16.025105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d9dd065-9276-42a6-a183-8542a350c3b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.025586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d9dd065-9276-42a6-a183-8542a350c3b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.026016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d9dd065-9276-42a6-a183-8542a350c3b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.026688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d9dd065-9276-42a6-a183-8542a350c3b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.027161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d9dd065-9276-42a6-a183-8542a350c3b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.027573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5d9dd065-9276-42a6-a183-8542a350c3b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.159445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5d9dd065-9276-42a6-a183-8542a350c3b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:16.168378 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5d9dd065-9276-42a6-a183-8542a350c3b4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155010 Sep 01 05:35:16.168966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1082/2080] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:16 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:16.709008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f1b94672-2cc3-43ed-b8e6-2fff594f50c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:16.709627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f1b94672-2cc3-43ed-b8e6-2fff594f50c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:16.715988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f1b94672-2cc3-43ed-b8e6-2fff594f50c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.716461 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f1b94672-2cc3-43ed-b8e6-2fff594f50c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.716911 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f1b94672-2cc3-43ed-b8e6-2fff594f50c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.717594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f1b94672-2cc3-43ed-b8e6-2fff594f50c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.718044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f1b94672-2cc3-43ed-b8e6-2fff594f50c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.718462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f1b94672-2cc3-43ed-b8e6-2fff594f50c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.722271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:16.780825 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f1b94672-2cc3-43ed-b8e6-2fff594f50c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:16.790608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f1b94672-2cc3-43ed-b8e6-2fff594f50c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:16.792020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f1b94672-2cc3-43ed-b8e6-2fff594f50c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:16.793176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f1b94672-2cc3-43ed-b8e6-2fff594f50c6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088662 Sep 01 05:35:16.793734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 999/2081] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:16 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:17.189430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-da8f5336-f098-45a2-a2f2-abb50f6e0148 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:17.190043 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-da8f5336-f098-45a2-a2f2-abb50f6e0148 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:17.197172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-da8f5336-f098-45a2-a2f2-abb50f6e0148 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.197650 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-da8f5336-f098-45a2-a2f2-abb50f6e0148 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.198082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-da8f5336-f098-45a2-a2f2-abb50f6e0148 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.198798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-da8f5336-f098-45a2-a2f2-abb50f6e0148 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.199242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-da8f5336-f098-45a2-a2f2-abb50f6e0148 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.199661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-da8f5336-f098-45a2-a2f2-abb50f6e0148 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.328820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-da8f5336-f098-45a2-a2f2-abb50f6e0148 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:17.336943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-da8f5336-f098-45a2-a2f2-abb50f6e0148 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151359 Sep 01 05:35:17.337499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1083/2082] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:17 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:17.815393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b8019ea8-97c8-4b49-80bc-c267cdadb44e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:17.816003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b8019ea8-97c8-4b49-80bc-c267cdadb44e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:17.822462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8019ea8-97c8-4b49-80bc-c267cdadb44e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.822945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8019ea8-97c8-4b49-80bc-c267cdadb44e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.823382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8019ea8-97c8-4b49-80bc-c267cdadb44e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.824071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8019ea8-97c8-4b49-80bc-c267cdadb44e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.824520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8019ea8-97c8-4b49-80bc-c267cdadb44e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.824972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8019ea8-97c8-4b49-80bc-c267cdadb44e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.885833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b8019ea8-97c8-4b49-80bc-c267cdadb44e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:17.894475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b8019ea8-97c8-4b49-80bc-c267cdadb44e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:17.896525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b8019ea8-97c8-4b49-80bc-c267cdadb44e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:17.897696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b8019ea8-97c8-4b49-80bc-c267cdadb44e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086207 Sep 01 05:35:17.898251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1000/2083] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:17 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:18.358412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f7a89e39-3f5b-465d-8e52-437aff791da3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:18.359022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f7a89e39-3f5b-465d-8e52-437aff791da3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:18.366029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f7a89e39-3f5b-465d-8e52-437aff791da3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:18.366495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f7a89e39-3f5b-465d-8e52-437aff791da3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:18.366920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f7a89e39-3f5b-465d-8e52-437aff791da3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:18.367611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f7a89e39-3f5b-465d-8e52-437aff791da3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:18.368051 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f7a89e39-3f5b-465d-8e52-437aff791da3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:18.368470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f7a89e39-3f5b-465d-8e52-437aff791da3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:18.501898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f7a89e39-3f5b-465d-8e52-437aff791da3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:18.511215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f7a89e39-3f5b-465d-8e52-437aff791da3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156687 Sep 01 05:35:18.511874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1084/2084] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:18 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:18.919746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8d56a40d-8bfe-431f-a059-60b656e46e9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:18.920505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8d56a40d-8bfe-431f-a059-60b656e46e9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:18.927051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d56a40d-8bfe-431f-a059-60b656e46e9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:18.927560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d56a40d-8bfe-431f-a059-60b656e46e9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:18.928080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d56a40d-8bfe-431f-a059-60b656e46e9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:18.928801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d56a40d-8bfe-431f-a059-60b656e46e9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:18.929250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d56a40d-8bfe-431f-a059-60b656e46e9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:18.929675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d56a40d-8bfe-431f-a059-60b656e46e9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:18.997624 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8d56a40d-8bfe-431f-a059-60b656e46e9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:19.007066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8d56a40d-8bfe-431f-a059-60b656e46e9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:19.008506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8d56a40d-8bfe-431f-a059-60b656e46e9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:19.009703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8d56a40d-8bfe-431f-a059-60b656e46e9c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.093883 Sep 01 05:35:19.010258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1001/2085] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:18 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:19.533443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-350cd68d-9051-4464-8dcc-58208caee137 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:19.534107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-350cd68d-9051-4464-8dcc-58208caee137 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:19.541602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-350cd68d-9051-4464-8dcc-58208caee137 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:19.542076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-350cd68d-9051-4464-8dcc-58208caee137 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:19.542505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-350cd68d-9051-4464-8dcc-58208caee137 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:19.543211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-350cd68d-9051-4464-8dcc-58208caee137 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:19.543657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-350cd68d-9051-4464-8dcc-58208caee137 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:19.544076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-350cd68d-9051-4464-8dcc-58208caee137 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:19.670209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-350cd68d-9051-4464-8dcc-58208caee137 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:19.679363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-350cd68d-9051-4464-8dcc-58208caee137 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150231 Sep 01 05:35:19.679936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1085/2086] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:19 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:20.032088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-317b1dca-750d-4b8a-b98b-31deca76aa26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:20.032718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-317b1dca-750d-4b8a-b98b-31deca76aa26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:20.035039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=58 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:20.042018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-317b1dca-750d-4b8a-b98b-31deca76aa26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.042487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-317b1dca-750d-4b8a-b98b-31deca76aa26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.042926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-317b1dca-750d-4b8a-b98b-31deca76aa26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:20.043592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-317b1dca-750d-4b8a-b98b-31deca76aa26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.044034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-317b1dca-750d-4b8a-b98b-31deca76aa26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.044444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-317b1dca-750d-4b8a-b98b-31deca76aa26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:20.105687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-317b1dca-750d-4b8a-b98b-31deca76aa26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:20.114048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-317b1dca-750d-4b8a-b98b-31deca76aa26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:20.115738 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-317b1dca-750d-4b8a-b98b-31deca76aa26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:20.116888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-317b1dca-750d-4b8a-b98b-31deca76aa26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088648 Sep 01 05:35:20.117444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1002/2087] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:20.701357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e9cab120-2127-41e0-9103-cd7eb89bc007 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:20.701969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e9cab120-2127-41e0-9103-cd7eb89bc007 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:20.704217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=54 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:20.709930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9cab120-2127-41e0-9103-cd7eb89bc007 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.710399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9cab120-2127-41e0-9103-cd7eb89bc007 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.710828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9cab120-2127-41e0-9103-cd7eb89bc007 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:20.711496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9cab120-2127-41e0-9103-cd7eb89bc007 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.712071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9cab120-2127-41e0-9103-cd7eb89bc007 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.712363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9cab120-2127-41e0-9103-cd7eb89bc007 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:20.843071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e9cab120-2127-41e0-9103-cd7eb89bc007 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:20.851955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e9cab120-2127-41e0-9103-cd7eb89bc007 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154429 Sep 01 05:35:20.852507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1086/2088] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:20 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:21.139903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bb5b0a8c-4f2f-4fb8-bbd7-18610e966475 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:21.140652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bb5b0a8c-4f2f-4fb8-bbd7-18610e966475 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:21.148544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb5b0a8c-4f2f-4fb8-bbd7-18610e966475 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:21.149075 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb5b0a8c-4f2f-4fb8-bbd7-18610e966475 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:21.149535 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb5b0a8c-4f2f-4fb8-bbd7-18610e966475 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:21.150221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb5b0a8c-4f2f-4fb8-bbd7-18610e966475 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:21.150668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb5b0a8c-4f2f-4fb8-bbd7-18610e966475 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:21.151094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb5b0a8c-4f2f-4fb8-bbd7-18610e966475 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:21.212124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bb5b0a8c-4f2f-4fb8-bbd7-18610e966475 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:21.220939 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bb5b0a8c-4f2f-4fb8-bbd7-18610e966475 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:21.222396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bb5b0a8c-4f2f-4fb8-bbd7-18610e966475 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:21.223555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bb5b0a8c-4f2f-4fb8-bbd7-18610e966475 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087965 Sep 01 05:35:21.224129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1003/2089] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:21 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:21.873195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a70e5f59-7e06-4441-81e7-d09d2044b631 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:21.873785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a70e5f59-7e06-4441-81e7-d09d2044b631 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:21.880205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a70e5f59-7e06-4441-81e7-d09d2044b631 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:21.880912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a70e5f59-7e06-4441-81e7-d09d2044b631 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:21.881339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a70e5f59-7e06-4441-81e7-d09d2044b631 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:21.882010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a70e5f59-7e06-4441-81e7-d09d2044b631 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:21.882452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a70e5f59-7e06-4441-81e7-d09d2044b631 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:21.882866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a70e5f59-7e06-4441-81e7-d09d2044b631 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:22.010425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a70e5f59-7e06-4441-81e7-d09d2044b631 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:22.018785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a70e5f59-7e06-4441-81e7-d09d2044b631 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149371 Sep 01 05:35:22.019383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1087/2090] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:21 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:22.246094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-96e39fc1-69af-4a5e-95dc-11ac0fcf5ba6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:22.246705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-96e39fc1-69af-4a5e-95dc-11ac0fcf5ba6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:22.252835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96e39fc1-69af-4a5e-95dc-11ac0fcf5ba6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:22.253314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96e39fc1-69af-4a5e-95dc-11ac0fcf5ba6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:22.253747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96e39fc1-69af-4a5e-95dc-11ac0fcf5ba6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:22.254430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96e39fc1-69af-4a5e-95dc-11ac0fcf5ba6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:22.254878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96e39fc1-69af-4a5e-95dc-11ac0fcf5ba6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:22.255294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96e39fc1-69af-4a5e-95dc-11ac0fcf5ba6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:22.315450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-96e39fc1-69af-4a5e-95dc-11ac0fcf5ba6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:22.324052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-96e39fc1-69af-4a5e-95dc-11ac0fcf5ba6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:22.325537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-96e39fc1-69af-4a5e-95dc-11ac0fcf5ba6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:22.326675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-96e39fc1-69af-4a5e-95dc-11ac0fcf5ba6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.084560 Sep 01 05:35:22.327237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1004/2091] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:23.041329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-45c165b2-936a-42d7-9bf2-60ea392493ad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:23.041935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-45c165b2-936a-42d7-9bf2-60ea392493ad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:23.048408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45c165b2-936a-42d7-9bf2-60ea392493ad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.048918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45c165b2-936a-42d7-9bf2-60ea392493ad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.049358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45c165b2-936a-42d7-9bf2-60ea392493ad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.050038 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45c165b2-936a-42d7-9bf2-60ea392493ad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.050491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45c165b2-936a-42d7-9bf2-60ea392493ad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.050913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45c165b2-936a-42d7-9bf2-60ea392493ad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.183488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-45c165b2-936a-42d7-9bf2-60ea392493ad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:23.191664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-45c165b2-936a-42d7-9bf2-60ea392493ad tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154494 Sep 01 05:35:23.193149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1088/2092] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:23 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:23.349070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ee200642-e625-4e80-9f56-0477d2022929 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:23.349734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ee200642-e625-4e80-9f56-0477d2022929 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:23.356060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee200642-e625-4e80-9f56-0477d2022929 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.356575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee200642-e625-4e80-9f56-0477d2022929 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.357039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee200642-e625-4e80-9f56-0477d2022929 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.357731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee200642-e625-4e80-9f56-0477d2022929 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.358182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee200642-e625-4e80-9f56-0477d2022929 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.358607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee200642-e625-4e80-9f56-0477d2022929 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.424055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ee200642-e625-4e80-9f56-0477d2022929 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:23.433040 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ee200642-e625-4e80-9f56-0477d2022929 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:23.434423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ee200642-e625-4e80-9f56-0477d2022929 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:23.435559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ee200642-e625-4e80-9f56-0477d2022929 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090405 Sep 01 05:35:23.436111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1005/2093] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:24.213136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9b101315-275a-4b41-84f6-e53fa158a539 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:24.213714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9b101315-275a-4b41-84f6-e53fa158a539 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:24.219977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b101315-275a-4b41-84f6-e53fa158a539 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.220448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b101315-275a-4b41-84f6-e53fa158a539 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.220912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b101315-275a-4b41-84f6-e53fa158a539 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.221615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b101315-275a-4b41-84f6-e53fa158a539 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.222060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b101315-275a-4b41-84f6-e53fa158a539 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.222474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b101315-275a-4b41-84f6-e53fa158a539 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.349100 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9b101315-275a-4b41-84f6-e53fa158a539 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:24.357205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9b101315-275a-4b41-84f6-e53fa158a539 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.147848 Sep 01 05:35:24.357777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1089/2094] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:24 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:24.458525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4c98a9d2-f96f-453a-8349-c1c3dae2d16e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:24.459125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4c98a9d2-f96f-453a-8349-c1c3dae2d16e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:24.465534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c98a9d2-f96f-453a-8349-c1c3dae2d16e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.465948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c98a9d2-f96f-453a-8349-c1c3dae2d16e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.466375 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c98a9d2-f96f-453a-8349-c1c3dae2d16e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.467045 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c98a9d2-f96f-453a-8349-c1c3dae2d16e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.467484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c98a9d2-f96f-453a-8349-c1c3dae2d16e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.467896 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c98a9d2-f96f-453a-8349-c1c3dae2d16e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.528212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4c98a9d2-f96f-453a-8349-c1c3dae2d16e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:24.536834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4c98a9d2-f96f-453a-8349-c1c3dae2d16e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:24.538316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4c98a9d2-f96f-453a-8349-c1c3dae2d16e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:24.539727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4c98a9d2-f96f-453a-8349-c1c3dae2d16e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085150 Sep 01 05:35:24.540282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1006/2095] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:25.379372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-274ec660-2889-4247-8d27-362d44273192 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:25.379982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-274ec660-2889-4247-8d27-362d44273192 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:25.386385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-274ec660-2889-4247-8d27-362d44273192 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.386856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-274ec660-2889-4247-8d27-362d44273192 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.387283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-274ec660-2889-4247-8d27-362d44273192 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.387952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-274ec660-2889-4247-8d27-362d44273192 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.388395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-274ec660-2889-4247-8d27-362d44273192 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.388839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-274ec660-2889-4247-8d27-362d44273192 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.518870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-274ec660-2889-4247-8d27-362d44273192 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:25.527720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-274ec660-2889-4247-8d27-362d44273192 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152196 Sep 01 05:35:25.528282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1090/2096] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:25 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:25.562014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9750065d-87d7-4c2c-88e7-ada7b58d83cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:25.562617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9750065d-87d7-4c2c-88e7-ada7b58d83cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:25.569529 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9750065d-87d7-4c2c-88e7-ada7b58d83cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.570002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9750065d-87d7-4c2c-88e7-ada7b58d83cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.570430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9750065d-87d7-4c2c-88e7-ada7b58d83cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.571100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9750065d-87d7-4c2c-88e7-ada7b58d83cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.571542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9750065d-87d7-4c2c-88e7-ada7b58d83cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.572223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9750065d-87d7-4c2c-88e7-ada7b58d83cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.632837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9750065d-87d7-4c2c-88e7-ada7b58d83cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:25.642047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9750065d-87d7-4c2c-88e7-ada7b58d83cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:25.643510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9750065d-87d7-4c2c-88e7-ada7b58d83cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:25.644653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9750065d-87d7-4c2c-88e7-ada7b58d83cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086496 Sep 01 05:35:25.646854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1007/2097] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:26.549750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0bfdf26e-087c-415f-9179-ec0499f9d5b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:26.550381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0bfdf26e-087c-415f-9179-ec0499f9d5b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:26.556856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0bfdf26e-087c-415f-9179-ec0499f9d5b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.557336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0bfdf26e-087c-415f-9179-ec0499f9d5b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.557768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0bfdf26e-087c-415f-9179-ec0499f9d5b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.558445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0bfdf26e-087c-415f-9179-ec0499f9d5b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.558891 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0bfdf26e-087c-415f-9179-ec0499f9d5b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.559310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0bfdf26e-087c-415f-9179-ec0499f9d5b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.668443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3d8db59a-1a5c-46f9-92ed-c6a076eea3c7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:26.669179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3d8db59a-1a5c-46f9-92ed-c6a076eea3c7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:26.675563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3d8db59a-1a5c-46f9-92ed-c6a076eea3c7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.676110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3d8db59a-1a5c-46f9-92ed-c6a076eea3c7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.676730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3d8db59a-1a5c-46f9-92ed-c6a076eea3c7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.677961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3d8db59a-1a5c-46f9-92ed-c6a076eea3c7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.678412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3d8db59a-1a5c-46f9-92ed-c6a076eea3c7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.678829 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3d8db59a-1a5c-46f9-92ed-c6a076eea3c7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.690412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0bfdf26e-087c-415f-9179-ec0499f9d5b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:26.699181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0bfdf26e-087c-415f-9179-ec0499f9d5b7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153315 Sep 01 05:35:26.699757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1091/2098] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:26 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:26.741335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3d8db59a-1a5c-46f9-92ed-c6a076eea3c7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:26.749763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3d8db59a-1a5c-46f9-92ed-c6a076eea3c7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:26.751182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3d8db59a-1a5c-46f9-92ed-c6a076eea3c7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:26.752315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3d8db59a-1a5c-46f9-92ed-c6a076eea3c7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087797 Sep 01 05:35:26.752889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1008/2099] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:35:27.721561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bc11953f-540b-455c-a07a-e7e0e6345efb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:27.722172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bc11953f-540b-455c-a07a-e7e0e6345efb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:27.729746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc11953f-540b-455c-a07a-e7e0e6345efb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.730222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc11953f-540b-455c-a07a-e7e0e6345efb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.730651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc11953f-540b-455c-a07a-e7e0e6345efb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.731376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc11953f-540b-455c-a07a-e7e0e6345efb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.731815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc11953f-540b-455c-a07a-e7e0e6345efb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.732228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc11953f-540b-455c-a07a-e7e0e6345efb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.775386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9a4fc53d-7a5b-496e-b68a-975b8b392086 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:27.775995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9a4fc53d-7a5b-496e-b68a-975b8b392086 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:27.782434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a4fc53d-7a5b-496e-b68a-975b8b392086 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.782913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a4fc53d-7a5b-496e-b68a-975b8b392086 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.783339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a4fc53d-7a5b-496e-b68a-975b8b392086 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.784019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a4fc53d-7a5b-496e-b68a-975b8b392086 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.784466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a4fc53d-7a5b-496e-b68a-975b8b392086 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.784908 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a4fc53d-7a5b-496e-b68a-975b8b392086 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.850697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9a4fc53d-7a5b-496e-b68a-975b8b392086 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:27.860919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bc11953f-540b-455c-a07a-e7e0e6345efb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:27.861145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9a4fc53d-7a5b-496e-b68a-975b8b392086 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:27.863868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9a4fc53d-7a5b-496e-b68a-975b8b392086 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:27.865941 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9a4fc53d-7a5b-496e-b68a-975b8b392086 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.094439 Sep 01 05:35:27.866875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1009/2100] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:27 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:35:27.869593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bc11953f-540b-455c-a07a-e7e0e6345efb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151857 Sep 01 05:35:27.870227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1092/2101] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:27 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:28.892240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b715bb62-0d3c-4246-99c9-c5ded3947ac9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:28.893054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2c2265f6-600a-4d9c-9ded-43d8b8a6e538 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:28.893426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b715bb62-0d3c-4246-99c9-c5ded3947ac9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:28.893551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2c2265f6-600a-4d9c-9ded-43d8b8a6e538 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:28.899857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b715bb62-0d3c-4246-99c9-c5ded3947ac9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.900335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b715bb62-0d3c-4246-99c9-c5ded3947ac9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.900695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c2265f6-600a-4d9c-9ded-43d8b8a6e538 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.900839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b715bb62-0d3c-4246-99c9-c5ded3947ac9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.901207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c2265f6-600a-4d9c-9ded-43d8b8a6e538 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.901490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b715bb62-0d3c-4246-99c9-c5ded3947ac9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.901637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c2265f6-600a-4d9c-9ded-43d8b8a6e538 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.901933 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b715bb62-0d3c-4246-99c9-c5ded3947ac9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.902321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c2265f6-600a-4d9c-9ded-43d8b8a6e538 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.902445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b715bb62-0d3c-4246-99c9-c5ded3947ac9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.902763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c2265f6-600a-4d9c-9ded-43d8b8a6e538 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.903215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2c2265f6-600a-4d9c-9ded-43d8b8a6e538 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.907182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:28.967223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b715bb62-0d3c-4246-99c9-c5ded3947ac9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:28.976583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b715bb62-0d3c-4246-99c9-c5ded3947ac9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:28.978084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b715bb62-0d3c-4246-99c9-c5ded3947ac9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:28.979862 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b715bb62-0d3c-4246-99c9-c5ded3947ac9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090955 Sep 01 05:35:28.980433 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1010/2102] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:28 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:29.039416 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2c2265f6-600a-4d9c-9ded-43d8b8a6e538 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:29.047479 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2c2265f6-600a-4d9c-9ded-43d8b8a6e538 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.159188 Sep 01 05:35:29.048051 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1093/2103] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:28 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:30.003460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-735a5643-b5d9-4a53-8e7b-c35b7a46996b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:30.004071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-735a5643-b5d9-4a53-8e7b-c35b7a46996b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:30.011063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-735a5643-b5d9-4a53-8e7b-c35b7a46996b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.011543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-735a5643-b5d9-4a53-8e7b-c35b7a46996b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.011984 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-735a5643-b5d9-4a53-8e7b-c35b7a46996b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.012665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-735a5643-b5d9-4a53-8e7b-c35b7a46996b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.013145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-735a5643-b5d9-4a53-8e7b-c35b7a46996b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.013563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-735a5643-b5d9-4a53-8e7b-c35b7a46996b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.069281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b6402f6e-555f-4a17-a0d3-fa88f1843f20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:30.069924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b6402f6e-555f-4a17-a0d3-fa88f1843f20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:30.076095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6402f6e-555f-4a17-a0d3-fa88f1843f20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.076342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-735a5643-b5d9-4a53-8e7b-c35b7a46996b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:30.076570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6402f6e-555f-4a17-a0d3-fa88f1843f20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.077030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6402f6e-555f-4a17-a0d3-fa88f1843f20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.077711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6402f6e-555f-4a17-a0d3-fa88f1843f20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.078154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6402f6e-555f-4a17-a0d3-fa88f1843f20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.078567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b6402f6e-555f-4a17-a0d3-fa88f1843f20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.085214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-735a5643-b5d9-4a53-8e7b-c35b7a46996b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:30.086668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-735a5643-b5d9-4a53-8e7b-c35b7a46996b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:30.087821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-735a5643-b5d9-4a53-8e7b-c35b7a46996b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088264 Sep 01 05:35:30.088380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1011/2104] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:29 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:30.205465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b6402f6e-555f-4a17-a0d3-fa88f1843f20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:30.214541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b6402f6e-555f-4a17-a0d3-fa88f1843f20 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149527 Sep 01 05:35:30.215106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1094/2105] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:30 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:31.111138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b6c2e545-f12a-48b6-97a8-327117ff3516 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:31.111768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b6c2e545-f12a-48b6-97a8-327117ff3516 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:31.118994 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6c2e545-f12a-48b6-97a8-327117ff3516 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:31.119479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6c2e545-f12a-48b6-97a8-327117ff3516 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:31.119913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6c2e545-f12a-48b6-97a8-327117ff3516 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.120603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6c2e545-f12a-48b6-97a8-327117ff3516 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:31.121099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6c2e545-f12a-48b6-97a8-327117ff3516 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:31.121528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b6c2e545-f12a-48b6-97a8-327117ff3516 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.185066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b6c2e545-f12a-48b6-97a8-327117ff3516 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:31.193744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b6c2e545-f12a-48b6-97a8-327117ff3516 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:31.196142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b6c2e545-f12a-48b6-97a8-327117ff3516 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:31.197319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b6c2e545-f12a-48b6-97a8-327117ff3516 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090193 Sep 01 05:35:31.197872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1012/2106] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:31.236658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5ae013e5-1ab1-4c1f-8964-dc02550a0dda tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:31.237313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5ae013e5-1ab1-4c1f-8964-dc02550a0dda tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:31.244227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ae013e5-1ab1-4c1f-8964-dc02550a0dda tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:31.244707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ae013e5-1ab1-4c1f-8964-dc02550a0dda tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:31.245168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ae013e5-1ab1-4c1f-8964-dc02550a0dda tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.245847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ae013e5-1ab1-4c1f-8964-dc02550a0dda tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:31.246296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ae013e5-1ab1-4c1f-8964-dc02550a0dda tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:31.246715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5ae013e5-1ab1-4c1f-8964-dc02550a0dda tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.380045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5ae013e5-1ab1-4c1f-8964-dc02550a0dda tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:31.388191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5ae013e5-1ab1-4c1f-8964-dc02550a0dda tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155342 Sep 01 05:35:31.388756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1095/2107] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:31 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:32.221077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-576e0cba-087e-4285-98ce-d37be58b0823 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:32.221600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-576e0cba-087e-4285-98ce-d37be58b0823 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:32.228316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-576e0cba-087e-4285-98ce-d37be58b0823 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:32.228809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-576e0cba-087e-4285-98ce-d37be58b0823 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:32.229243 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-576e0cba-087e-4285-98ce-d37be58b0823 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:32.229929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-576e0cba-087e-4285-98ce-d37be58b0823 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:32.230378 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-576e0cba-087e-4285-98ce-d37be58b0823 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:32.230799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-576e0cba-087e-4285-98ce-d37be58b0823 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:32.295258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-576e0cba-087e-4285-98ce-d37be58b0823 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:32.303692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-576e0cba-087e-4285-98ce-d37be58b0823 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:32.305330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-576e0cba-087e-4285-98ce-d37be58b0823 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:32.306453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-576e0cba-087e-4285-98ce-d37be58b0823 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089500 Sep 01 05:35:32.307010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1013/2108] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:32.409654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-48be87be-ee7a-49ad-bb9c-b4ae5d39ce6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:32.410259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-48be87be-ee7a-49ad-bb9c-b4ae5d39ce6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:32.416852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48be87be-ee7a-49ad-bb9c-b4ae5d39ce6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:32.417328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48be87be-ee7a-49ad-bb9c-b4ae5d39ce6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:32.417759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48be87be-ee7a-49ad-bb9c-b4ae5d39ce6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:32.418424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48be87be-ee7a-49ad-bb9c-b4ae5d39ce6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:32.418866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48be87be-ee7a-49ad-bb9c-b4ae5d39ce6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:32.419279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-48be87be-ee7a-49ad-bb9c-b4ae5d39ce6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:32.546601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-48be87be-ee7a-49ad-bb9c-b4ae5d39ce6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:32.555240 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-48be87be-ee7a-49ad-bb9c-b4ae5d39ce6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149346 Sep 01 05:35:32.555794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1096/2109] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:32 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:33.330484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9339a0d2-6980-43dd-84fd-96d56df8f5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:33.331026 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9339a0d2-6980-43dd-84fd-96d56df8f5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:33.338029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9339a0d2-6980-43dd-84fd-96d56df8f5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:33.338502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9339a0d2-6980-43dd-84fd-96d56df8f5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:33.338927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9339a0d2-6980-43dd-84fd-96d56df8f5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:33.339598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9339a0d2-6980-43dd-84fd-96d56df8f5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:33.340036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9339a0d2-6980-43dd-84fd-96d56df8f5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:33.340445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9339a0d2-6980-43dd-84fd-96d56df8f5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:33.402067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9339a0d2-6980-43dd-84fd-96d56df8f5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:33.410568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9339a0d2-6980-43dd-84fd-96d56df8f5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:33.411995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9339a0d2-6980-43dd-84fd-96d56df8f5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:33.413173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9339a0d2-6980-43dd-84fd-96d56df8f5c5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086689 Sep 01 05:35:33.414022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1014/2110] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:33.576590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-56d40bc1-28e8-449e-8b50-755e2b8f736b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:33.577242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-56d40bc1-28e8-449e-8b50-755e2b8f736b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:33.583786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56d40bc1-28e8-449e-8b50-755e2b8f736b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:33.584214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56d40bc1-28e8-449e-8b50-755e2b8f736b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:33.584662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56d40bc1-28e8-449e-8b50-755e2b8f736b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:33.586171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56d40bc1-28e8-449e-8b50-755e2b8f736b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:33.586626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56d40bc1-28e8-449e-8b50-755e2b8f736b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:33.587054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-56d40bc1-28e8-449e-8b50-755e2b8f736b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:33.718333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-56d40bc1-28e8-449e-8b50-755e2b8f736b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:33.726655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-56d40bc1-28e8-449e-8b50-755e2b8f736b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154039 Sep 01 05:35:33.727227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1097/2111] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:34.436213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fa6850c3-9565-4fab-aa3f-ec7f24b57e67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:34.436880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fa6850c3-9565-4fab-aa3f-ec7f24b57e67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:34.443233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa6850c3-9565-4fab-aa3f-ec7f24b57e67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:34.443717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa6850c3-9565-4fab-aa3f-ec7f24b57e67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:34.444177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa6850c3-9565-4fab-aa3f-ec7f24b57e67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:34.445140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa6850c3-9565-4fab-aa3f-ec7f24b57e67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:34.445743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa6850c3-9565-4fab-aa3f-ec7f24b57e67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:34.446229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa6850c3-9565-4fab-aa3f-ec7f24b57e67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:34.507835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fa6850c3-9565-4fab-aa3f-ec7f24b57e67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:34.510011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:34.517642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fa6850c3-9565-4fab-aa3f-ec7f24b57e67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:34.519077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fa6850c3-9565-4fab-aa3f-ec7f24b57e67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:34.520201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fa6850c3-9565-4fab-aa3f-ec7f24b57e67 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087962 Sep 01 05:35:34.520792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1015/2112] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:34.748220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-58bd63dc-bb8c-446f-a54c-450af016e53b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:34.748745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-58bd63dc-bb8c-446f-a54c-450af016e53b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:34.755087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58bd63dc-bb8c-446f-a54c-450af016e53b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:34.755552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58bd63dc-bb8c-446f-a54c-450af016e53b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:34.755976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58bd63dc-bb8c-446f-a54c-450af016e53b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:34.756648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58bd63dc-bb8c-446f-a54c-450af016e53b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:34.757118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58bd63dc-bb8c-446f-a54c-450af016e53b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:34.757531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-58bd63dc-bb8c-446f-a54c-450af016e53b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:34.888096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-58bd63dc-bb8c-446f-a54c-450af016e53b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:34.896412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-58bd63dc-bb8c-446f-a54c-450af016e53b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152048 Sep 01 05:35:34.897009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1098/2113] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:35.543792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-39a7e61e-75ad-4777-b13c-56746f30e941 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:35.544389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-39a7e61e-75ad-4777-b13c-56746f30e941 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:35.551173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39a7e61e-75ad-4777-b13c-56746f30e941 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:35.551651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39a7e61e-75ad-4777-b13c-56746f30e941 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:35.552083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39a7e61e-75ad-4777-b13c-56746f30e941 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:35.552762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39a7e61e-75ad-4777-b13c-56746f30e941 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:35.553239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39a7e61e-75ad-4777-b13c-56746f30e941 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:35.553657 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-39a7e61e-75ad-4777-b13c-56746f30e941 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:35.614926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-39a7e61e-75ad-4777-b13c-56746f30e941 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:35.623447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-39a7e61e-75ad-4777-b13c-56746f30e941 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:35.624907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-39a7e61e-75ad-4777-b13c-56746f30e941 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:35.626036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-39a7e61e-75ad-4777-b13c-56746f30e941 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086310 Sep 01 05:35:35.626584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1016/2114] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:35.918401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2994fc59-3daa-483d-a3d8-0b234bd69839 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:35.919017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2994fc59-3daa-483d-a3d8-0b234bd69839 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:35.925444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2994fc59-3daa-483d-a3d8-0b234bd69839 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:35.925933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2994fc59-3daa-483d-a3d8-0b234bd69839 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:35.926369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2994fc59-3daa-483d-a3d8-0b234bd69839 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:35.927053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2994fc59-3daa-483d-a3d8-0b234bd69839 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:35.927506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2994fc59-3daa-483d-a3d8-0b234bd69839 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:35.927929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2994fc59-3daa-483d-a3d8-0b234bd69839 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:36.056063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2994fc59-3daa-483d-a3d8-0b234bd69839 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:36.064214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2994fc59-3daa-483d-a3d8-0b234bd69839 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149705 Sep 01 05:35:36.064798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1099/2115] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:35 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:36.648795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-30604b79-b415-42bb-a34b-201c14a89270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:36.649408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-30604b79-b415-42bb-a34b-201c14a89270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:36.655894 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30604b79-b415-42bb-a34b-201c14a89270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:36.656371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30604b79-b415-42bb-a34b-201c14a89270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:36.656811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30604b79-b415-42bb-a34b-201c14a89270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:36.657498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30604b79-b415-42bb-a34b-201c14a89270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:36.658033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30604b79-b415-42bb-a34b-201c14a89270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:36.658356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30604b79-b415-42bb-a34b-201c14a89270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:36.723693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-30604b79-b415-42bb-a34b-201c14a89270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:36.733260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-30604b79-b415-42bb-a34b-201c14a89270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:36.734683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-30604b79-b415-42bb-a34b-201c14a89270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:36.735806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-30604b79-b415-42bb-a34b-201c14a89270 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090929 Sep 01 05:35:36.736389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1017/2116] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:37.086798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-12131b8f-92ff-4907-9d60-2fd04595c5f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:37.087336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-12131b8f-92ff-4907-9d60-2fd04595c5f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:37.093729 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-12131b8f-92ff-4907-9d60-2fd04595c5f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:37.094198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-12131b8f-92ff-4907-9d60-2fd04595c5f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:37.094622 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-12131b8f-92ff-4907-9d60-2fd04595c5f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:37.095289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-12131b8f-92ff-4907-9d60-2fd04595c5f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:37.095733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-12131b8f-92ff-4907-9d60-2fd04595c5f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:37.096146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-12131b8f-92ff-4907-9d60-2fd04595c5f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:37.224304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-12131b8f-92ff-4907-9d60-2fd04595c5f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:37.233137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-12131b8f-92ff-4907-9d60-2fd04595c5f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150707 Sep 01 05:35:37.233699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1100/2117] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:37 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:37.759424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f867a749-becb-48cf-a037-7ef7f085a2cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:37.760023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f867a749-becb-48cf-a037-7ef7f085a2cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:37.766452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f867a749-becb-48cf-a037-7ef7f085a2cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:37.766931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f867a749-becb-48cf-a037-7ef7f085a2cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:37.767358 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f867a749-becb-48cf-a037-7ef7f085a2cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:37.768035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f867a749-becb-48cf-a037-7ef7f085a2cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:37.768475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f867a749-becb-48cf-a037-7ef7f085a2cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:37.768914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f867a749-becb-48cf-a037-7ef7f085a2cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:38.049692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f867a749-becb-48cf-a037-7ef7f085a2cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:38.058813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f867a749-becb-48cf-a037-7ef7f085a2cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:38.060243 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f867a749-becb-48cf-a037-7ef7f085a2cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:38.061415 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f867a749-becb-48cf-a037-7ef7f085a2cb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.306599 Sep 01 05:35:38.061960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1018/2118] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:37 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:38.254294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b702ef61-a83a-4b5e-877c-8464f72dddfb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:38.254956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b702ef61-a83a-4b5e-877c-8464f72dddfb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:38.261092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b702ef61-a83a-4b5e-877c-8464f72dddfb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:38.261575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b702ef61-a83a-4b5e-877c-8464f72dddfb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:38.262010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b702ef61-a83a-4b5e-877c-8464f72dddfb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:38.262685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b702ef61-a83a-4b5e-877c-8464f72dddfb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:38.263133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b702ef61-a83a-4b5e-877c-8464f72dddfb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:38.263552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b702ef61-a83a-4b5e-877c-8464f72dddfb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:38.392373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b702ef61-a83a-4b5e-877c-8464f72dddfb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:38.401361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b702ef61-a83a-4b5e-877c-8464f72dddfb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150988 Sep 01 05:35:38.401924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1101/2119] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:38 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:39.084052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cb614a2f-8778-4c0c-9ae8-cb7e1555df4c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:39.084679 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cb614a2f-8778-4c0c-9ae8-cb7e1555df4c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:39.091162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb614a2f-8778-4c0c-9ae8-cb7e1555df4c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:39.091637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb614a2f-8778-4c0c-9ae8-cb7e1555df4c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:39.092064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb614a2f-8778-4c0c-9ae8-cb7e1555df4c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:39.092740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb614a2f-8778-4c0c-9ae8-cb7e1555df4c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:39.093208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb614a2f-8778-4c0c-9ae8-cb7e1555df4c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:39.093632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb614a2f-8778-4c0c-9ae8-cb7e1555df4c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:39.154236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cb614a2f-8778-4c0c-9ae8-cb7e1555df4c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:39.162727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cb614a2f-8778-4c0c-9ae8-cb7e1555df4c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:39.165093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cb614a2f-8778-4c0c-9ae8-cb7e1555df4c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:39.166216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cb614a2f-8778-4c0c-9ae8-cb7e1555df4c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086099 Sep 01 05:35:39.166764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1019/2120] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:39 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:39.422881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-41f630ce-62fa-4319-ad04-b15d8d2ad93f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:39.423419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-41f630ce-62fa-4319-ad04-b15d8d2ad93f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:39.429622 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41f630ce-62fa-4319-ad04-b15d8d2ad93f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:39.430097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41f630ce-62fa-4319-ad04-b15d8d2ad93f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:39.430527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41f630ce-62fa-4319-ad04-b15d8d2ad93f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:39.431210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41f630ce-62fa-4319-ad04-b15d8d2ad93f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:39.431656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41f630ce-62fa-4319-ad04-b15d8d2ad93f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:39.432074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41f630ce-62fa-4319-ad04-b15d8d2ad93f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:39.561000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-41f630ce-62fa-4319-ad04-b15d8d2ad93f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:39.569582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-41f630ce-62fa-4319-ad04-b15d8d2ad93f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150147 Sep 01 05:35:39.570153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1102/2121] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:40.189400 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e2327c5a-165c-42ae-9ce1-3b35cb3bd01e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:40.189967 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e2327c5a-165c-42ae-9ce1-3b35cb3bd01e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:40.197096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e2327c5a-165c-42ae-9ce1-3b35cb3bd01e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:40.197577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e2327c5a-165c-42ae-9ce1-3b35cb3bd01e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:40.198001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e2327c5a-165c-42ae-9ce1-3b35cb3bd01e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:40.198678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e2327c5a-165c-42ae-9ce1-3b35cb3bd01e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:40.199121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e2327c5a-165c-42ae-9ce1-3b35cb3bd01e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:40.199539 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e2327c5a-165c-42ae-9ce1-3b35cb3bd01e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:40.259294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e2327c5a-165c-42ae-9ce1-3b35cb3bd01e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:40.267833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e2327c5a-165c-42ae-9ce1-3b35cb3bd01e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:40.269278 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e2327c5a-165c-42ae-9ce1-3b35cb3bd01e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:40.270397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e2327c5a-165c-42ae-9ce1-3b35cb3bd01e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085018 Sep 01 05:35:40.270952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1020/2122] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:40.591201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b920fd7c-d592-4abb-990f-f5b55b2fae74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:40.591761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b920fd7c-d592-4abb-990f-f5b55b2fae74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:40.598066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b920fd7c-d592-4abb-990f-f5b55b2fae74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:40.598545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b920fd7c-d592-4abb-990f-f5b55b2fae74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:40.598978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b920fd7c-d592-4abb-990f-f5b55b2fae74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:40.599657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b920fd7c-d592-4abb-990f-f5b55b2fae74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:40.600105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b920fd7c-d592-4abb-990f-f5b55b2fae74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:40.601544 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b920fd7c-d592-4abb-990f-f5b55b2fae74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:40.728687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b920fd7c-d592-4abb-990f-f5b55b2fae74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:40.736819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b920fd7c-d592-4abb-990f-f5b55b2fae74 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149632 Sep 01 05:35:40.737385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1103/2123] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:40 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:41.293740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-448771ef-3933-4047-9e2e-61e55a9913d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:41.294353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-448771ef-3933-4047-9e2e-61e55a9913d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:41.301063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-448771ef-3933-4047-9e2e-61e55a9913d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:41.301544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-448771ef-3933-4047-9e2e-61e55a9913d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:41.302003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-448771ef-3933-4047-9e2e-61e55a9913d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:41.302692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-448771ef-3933-4047-9e2e-61e55a9913d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:41.303140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-448771ef-3933-4047-9e2e-61e55a9913d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:41.303872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-448771ef-3933-4047-9e2e-61e55a9913d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:41.363722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-448771ef-3933-4047-9e2e-61e55a9913d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:41.372441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-448771ef-3933-4047-9e2e-61e55a9913d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:41.373897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-448771ef-3933-4047-9e2e-61e55a9913d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:41.375025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-448771ef-3933-4047-9e2e-61e55a9913d3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085495 Sep 01 05:35:41.375573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1021/2124] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:35:41.758929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-89cf3a49-402e-45f7-9382-e34698f4071c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:41.759572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-89cf3a49-402e-45f7-9382-e34698f4071c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:41.766030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89cf3a49-402e-45f7-9382-e34698f4071c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:41.766513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89cf3a49-402e-45f7-9382-e34698f4071c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:41.766948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89cf3a49-402e-45f7-9382-e34698f4071c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:41.767631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89cf3a49-402e-45f7-9382-e34698f4071c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:41.768082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89cf3a49-402e-45f7-9382-e34698f4071c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:41.768504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89cf3a49-402e-45f7-9382-e34698f4071c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:41.894777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-89cf3a49-402e-45f7-9382-e34698f4071c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:41.903278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-89cf3a49-402e-45f7-9382-e34698f4071c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148961 Sep 01 05:35:41.903837 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1104/2125] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:42.398118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-545a5ec0-5586-40a4-b849-90892e202741 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:42.398735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-545a5ec0-5586-40a4-b849-90892e202741 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:42.405232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-545a5ec0-5586-40a4-b849-90892e202741 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:42.405718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-545a5ec0-5586-40a4-b849-90892e202741 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:42.406182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-545a5ec0-5586-40a4-b849-90892e202741 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:42.406866 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-545a5ec0-5586-40a4-b849-90892e202741 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:42.407318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-545a5ec0-5586-40a4-b849-90892e202741 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:42.407747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-545a5ec0-5586-40a4-b849-90892e202741 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:42.470438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-545a5ec0-5586-40a4-b849-90892e202741 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:42.479707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-545a5ec0-5586-40a4-b849-90892e202741 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:42.481182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-545a5ec0-5586-40a4-b849-90892e202741 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:42.482330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-545a5ec0-5586-40a4-b849-90892e202741 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088642 Sep 01 05:35:42.482882 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1022/2126] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:42.925000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-35cce733-d9f2-4556-9247-66d12bdf306d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:42.925559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-35cce733-d9f2-4556-9247-66d12bdf306d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:42.932516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35cce733-d9f2-4556-9247-66d12bdf306d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:42.933022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35cce733-d9f2-4556-9247-66d12bdf306d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:42.933457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35cce733-d9f2-4556-9247-66d12bdf306d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:42.934136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35cce733-d9f2-4556-9247-66d12bdf306d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:42.934585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35cce733-d9f2-4556-9247-66d12bdf306d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:42.935005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35cce733-d9f2-4556-9247-66d12bdf306d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:43.067389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-35cce733-d9f2-4556-9247-66d12bdf306d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:43.076269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-35cce733-d9f2-4556-9247-66d12bdf306d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155173 Sep 01 05:35:43.076849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1105/2127] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:42 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:43.508381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dd8f8f4d-9bad-4c16-bde4-08172cf6b747 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:43.509020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dd8f8f4d-9bad-4c16-bde4-08172cf6b747 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:43.515406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd8f8f4d-9bad-4c16-bde4-08172cf6b747 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:43.515881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd8f8f4d-9bad-4c16-bde4-08172cf6b747 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:43.516313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd8f8f4d-9bad-4c16-bde4-08172cf6b747 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:43.517021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd8f8f4d-9bad-4c16-bde4-08172cf6b747 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:43.517466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd8f8f4d-9bad-4c16-bde4-08172cf6b747 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:43.517880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd8f8f4d-9bad-4c16-bde4-08172cf6b747 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:43.578200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dd8f8f4d-9bad-4c16-bde4-08172cf6b747 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:43.586739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dd8f8f4d-9bad-4c16-bde4-08172cf6b747 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:43.588882 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dd8f8f4d-9bad-4c16-bde4-08172cf6b747 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:43.590037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dd8f8f4d-9bad-4c16-bde4-08172cf6b747 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085563 Sep 01 05:35:43.590586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1023/2128] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:44.098916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0ca69d07-5b55-42f1-b229-fc36353c14db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:44.099598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0ca69d07-5b55-42f1-b229-fc36353c14db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:44.106328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ca69d07-5b55-42f1-b229-fc36353c14db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:44.106869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ca69d07-5b55-42f1-b229-fc36353c14db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:44.107305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ca69d07-5b55-42f1-b229-fc36353c14db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:44.108138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ca69d07-5b55-42f1-b229-fc36353c14db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:44.108594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ca69d07-5b55-42f1-b229-fc36353c14db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:44.109039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ca69d07-5b55-42f1-b229-fc36353c14db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:44.243821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0ca69d07-5b55-42f1-b229-fc36353c14db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:44.252559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0ca69d07-5b55-42f1-b229-fc36353c14db tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.158061 Sep 01 05:35:44.253156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1106/2129] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:44 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:44.613007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3631bc52-211d-4769-bcec-534287172673 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:44.613637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3631bc52-211d-4769-bcec-534287172673 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:44.620059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3631bc52-211d-4769-bcec-534287172673 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:44.620533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3631bc52-211d-4769-bcec-534287172673 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:44.620996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3631bc52-211d-4769-bcec-534287172673 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:44.621673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3631bc52-211d-4769-bcec-534287172673 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:44.622114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3631bc52-211d-4769-bcec-534287172673 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:44.622528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3631bc52-211d-4769-bcec-534287172673 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:44.686943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3631bc52-211d-4769-bcec-534287172673 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:44.695490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3631bc52-211d-4769-bcec-534287172673 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:44.697011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3631bc52-211d-4769-bcec-534287172673 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:44.698166 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3631bc52-211d-4769-bcec-534287172673 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089162 Sep 01 05:35:44.699307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1024/2130] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:45.274142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4928196b-dbe0-4bf1-9550-f1340edafee6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:45.274675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4928196b-dbe0-4bf1-9550-f1340edafee6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:45.282050 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4928196b-dbe0-4bf1-9550-f1340edafee6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:45.282524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4928196b-dbe0-4bf1-9550-f1340edafee6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:45.282954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4928196b-dbe0-4bf1-9550-f1340edafee6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:45.283619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4928196b-dbe0-4bf1-9550-f1340edafee6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:45.284064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4928196b-dbe0-4bf1-9550-f1340edafee6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:45.284477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4928196b-dbe0-4bf1-9550-f1340edafee6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:45.413744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4928196b-dbe0-4bf1-9550-f1340edafee6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:45.422353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4928196b-dbe0-4bf1-9550-f1340edafee6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152174 Sep 01 05:35:45.422920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1107/2131] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:45.721388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-450d785d-07bf-4dad-a2b3-83c9642155e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:45.722024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-450d785d-07bf-4dad-a2b3-83c9642155e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:45.728478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-450d785d-07bf-4dad-a2b3-83c9642155e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:45.728983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-450d785d-07bf-4dad-a2b3-83c9642155e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:45.729416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-450d785d-07bf-4dad-a2b3-83c9642155e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:45.730117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-450d785d-07bf-4dad-a2b3-83c9642155e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:45.730561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-450d785d-07bf-4dad-a2b3-83c9642155e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:45.730975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-450d785d-07bf-4dad-a2b3-83c9642155e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:45.793405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-450d785d-07bf-4dad-a2b3-83c9642155e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:45.801900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-450d785d-07bf-4dad-a2b3-83c9642155e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:45.803373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-450d785d-07bf-4dad-a2b3-83c9642155e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:45.804534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-450d785d-07bf-4dad-a2b3-83c9642155e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087088 Sep 01 05:35:45.805131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1025/2132] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:45 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:46.443345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b9be9e3b-2ccd-4a72-a8f3-92f7d6908aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:46.443951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b9be9e3b-2ccd-4a72-a8f3-92f7d6908aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:46.450845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b9be9e3b-2ccd-4a72-a8f3-92f7d6908aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:46.451313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b9be9e3b-2ccd-4a72-a8f3-92f7d6908aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:46.451744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b9be9e3b-2ccd-4a72-a8f3-92f7d6908aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:46.452410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b9be9e3b-2ccd-4a72-a8f3-92f7d6908aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:46.452876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b9be9e3b-2ccd-4a72-a8f3-92f7d6908aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:46.453291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b9be9e3b-2ccd-4a72-a8f3-92f7d6908aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:46.580987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b9be9e3b-2ccd-4a72-a8f3-92f7d6908aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:46.589621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b9be9e3b-2ccd-4a72-a8f3-92f7d6908aab tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149443 Sep 01 05:35:46.590262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1108/2133] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:46 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:46.828964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-028d0021-e02f-4b6c-a74e-0643e325bd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:46.829508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-028d0021-e02f-4b6c-a74e-0643e325bd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:46.835866 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-028d0021-e02f-4b6c-a74e-0643e325bd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:46.836343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-028d0021-e02f-4b6c-a74e-0643e325bd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:46.836786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-028d0021-e02f-4b6c-a74e-0643e325bd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:46.837466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-028d0021-e02f-4b6c-a74e-0643e325bd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:46.837905 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-028d0021-e02f-4b6c-a74e-0643e325bd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:46.838346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-028d0021-e02f-4b6c-a74e-0643e325bd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:46.898613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-028d0021-e02f-4b6c-a74e-0643e325bd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:46.907167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-028d0021-e02f-4b6c-a74e-0643e325bd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:46.908592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-028d0021-e02f-4b6c-a74e-0643e325bd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:46.909743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-028d0021-e02f-4b6c-a74e-0643e325bd93 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.084879 Sep 01 05:35:46.910286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1026/2134] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:47.610712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-90ef000c-aaea-465e-9d9c-3050e4ccdabc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:47.611336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-90ef000c-aaea-465e-9d9c-3050e4ccdabc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:47.617757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90ef000c-aaea-465e-9d9c-3050e4ccdabc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:47.618227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90ef000c-aaea-465e-9d9c-3050e4ccdabc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:47.618654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90ef000c-aaea-465e-9d9c-3050e4ccdabc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:47.619320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90ef000c-aaea-465e-9d9c-3050e4ccdabc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:47.619762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90ef000c-aaea-465e-9d9c-3050e4ccdabc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:47.620727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90ef000c-aaea-465e-9d9c-3050e4ccdabc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:47.748151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-90ef000c-aaea-465e-9d9c-3050e4ccdabc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:47.750368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:47.757546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-90ef000c-aaea-465e-9d9c-3050e4ccdabc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150694 Sep 01 05:35:47.758108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1109/2135] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:47.932836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ebe22f4c-5f58-4df6-92d6-0fa3870e8fba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:47.933452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ebe22f4c-5f58-4df6-92d6-0fa3870e8fba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:47.939854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebe22f4c-5f58-4df6-92d6-0fa3870e8fba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:47.940334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebe22f4c-5f58-4df6-92d6-0fa3870e8fba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:47.940792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebe22f4c-5f58-4df6-92d6-0fa3870e8fba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:47.941477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebe22f4c-5f58-4df6-92d6-0fa3870e8fba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:47.941927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebe22f4c-5f58-4df6-92d6-0fa3870e8fba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:47.942352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ebe22f4c-5f58-4df6-92d6-0fa3870e8fba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:48.003300 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ebe22f4c-5f58-4df6-92d6-0fa3870e8fba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:48.012330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ebe22f4c-5f58-4df6-92d6-0fa3870e8fba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:48.013785 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ebe22f4c-5f58-4df6-92d6-0fa3870e8fba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:48.014912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ebe22f4c-5f58-4df6-92d6-0fa3870e8fba tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086054 Sep 01 05:35:48.015451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1027/2136] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:47 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:48.780305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cf188b3d-f21d-433e-aa58-e4eb9d422d9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:48.780873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cf188b3d-f21d-433e-aa58-e4eb9d422d9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:48.787314 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf188b3d-f21d-433e-aa58-e4eb9d422d9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:48.788046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf188b3d-f21d-433e-aa58-e4eb9d422d9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:48.788520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf188b3d-f21d-433e-aa58-e4eb9d422d9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:48.789217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf188b3d-f21d-433e-aa58-e4eb9d422d9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:48.789662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf188b3d-f21d-433e-aa58-e4eb9d422d9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:48.790076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf188b3d-f21d-433e-aa58-e4eb9d422d9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:48.921365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cf188b3d-f21d-433e-aa58-e4eb9d422d9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:48.929511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cf188b3d-f21d-433e-aa58-e4eb9d422d9f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153774 Sep 01 05:35:48.930072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1110/2137] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:48 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:49.039800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c4a3e51f-c289-4674-96d9-9223a655b059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:49.040389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c4a3e51f-c289-4674-96d9-9223a655b059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:49.048124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4a3e51f-c289-4674-96d9-9223a655b059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:49.048603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4a3e51f-c289-4674-96d9-9223a655b059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:49.049069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4a3e51f-c289-4674-96d9-9223a655b059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:49.049761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4a3e51f-c289-4674-96d9-9223a655b059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:49.050207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4a3e51f-c289-4674-96d9-9223a655b059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:49.050621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4a3e51f-c289-4674-96d9-9223a655b059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:49.114973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c4a3e51f-c289-4674-96d9-9223a655b059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:49.123620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c4a3e51f-c289-4674-96d9-9223a655b059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:49.125095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c4a3e51f-c289-4674-96d9-9223a655b059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:49.126250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c4a3e51f-c289-4674-96d9-9223a655b059 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090752 Sep 01 05:35:49.126806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1028/2138] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:49 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:49.951457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fa4e8468-8c54-4fad-ab67-8235cc8f7ad4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:49.952077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fa4e8468-8c54-4fad-ab67-8235cc8f7ad4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:49.958482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa4e8468-8c54-4fad-ab67-8235cc8f7ad4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:49.958964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa4e8468-8c54-4fad-ab67-8235cc8f7ad4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:49.959401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa4e8468-8c54-4fad-ab67-8235cc8f7ad4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:49.960080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa4e8468-8c54-4fad-ab67-8235cc8f7ad4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:49.960538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa4e8468-8c54-4fad-ab67-8235cc8f7ad4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:49.960986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa4e8468-8c54-4fad-ab67-8235cc8f7ad4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:50.091524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fa4e8468-8c54-4fad-ab67-8235cc8f7ad4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:50.099612 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fa4e8468-8c54-4fad-ab67-8235cc8f7ad4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152682 Sep 01 05:35:50.100167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1111/2139] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:49 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:50.149131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b8af46e2-747a-44b8-bb11-f8b4ffe6a280 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:50.149671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b8af46e2-747a-44b8-bb11-f8b4ffe6a280 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:50.152624 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=54 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:50.157818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8af46e2-747a-44b8-bb11-f8b4ffe6a280 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:50.158289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8af46e2-747a-44b8-bb11-f8b4ffe6a280 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:50.158714 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8af46e2-747a-44b8-bb11-f8b4ffe6a280 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:50.159422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8af46e2-747a-44b8-bb11-f8b4ffe6a280 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:50.159870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8af46e2-747a-44b8-bb11-f8b4ffe6a280 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:50.160286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8af46e2-747a-44b8-bb11-f8b4ffe6a280 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:50.222973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b8af46e2-747a-44b8-bb11-f8b4ffe6a280 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:50.231478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b8af46e2-747a-44b8-bb11-f8b4ffe6a280 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:50.233057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b8af46e2-747a-44b8-bb11-f8b4ffe6a280 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:50.234225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b8af46e2-747a-44b8-bb11-f8b4ffe6a280 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089002 Sep 01 05:35:50.234770 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1029/2140] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:51.121929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cd4a902f-3189-47f0-a607-72732d9fafb3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:51.122536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cd4a902f-3189-47f0-a607-72732d9fafb3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:51.124867 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=52 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:51.130115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd4a902f-3189-47f0-a607-72732d9fafb3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:51.130594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd4a902f-3189-47f0-a607-72732d9fafb3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:51.131061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd4a902f-3189-47f0-a607-72732d9fafb3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:51.131741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd4a902f-3189-47f0-a607-72732d9fafb3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:51.132193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd4a902f-3189-47f0-a607-72732d9fafb3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:51.132615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd4a902f-3189-47f0-a607-72732d9fafb3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:51.256404 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-20fd8a7d-8ed0-4633-89f8-a0f2d3671b88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:51.257042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-20fd8a7d-8ed0-4633-89f8-a0f2d3671b88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:51.264145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20fd8a7d-8ed0-4633-89f8-a0f2d3671b88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:51.264626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20fd8a7d-8ed0-4633-89f8-a0f2d3671b88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:51.265089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20fd8a7d-8ed0-4633-89f8-a0f2d3671b88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:51.265778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20fd8a7d-8ed0-4633-89f8-a0f2d3671b88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:51.266228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20fd8a7d-8ed0-4633-89f8-a0f2d3671b88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:51.266651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20fd8a7d-8ed0-4633-89f8-a0f2d3671b88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:51.269066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cd4a902f-3189-47f0-a607-72732d9fafb3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:51.277342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cd4a902f-3189-47f0-a607-72732d9fafb3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.160358 Sep 01 05:35:51.277923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1112/2141] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:51.328465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-20fd8a7d-8ed0-4633-89f8-a0f2d3671b88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:51.337077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-20fd8a7d-8ed0-4633-89f8-a0f2d3671b88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:51.338521 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-20fd8a7d-8ed0-4633-89f8-a0f2d3671b88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:51.340809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-20fd8a7d-8ed0-4633-89f8-a0f2d3671b88 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088392 Sep 01 05:35:51.341373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1030/2142] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:51 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:35:52.298533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a6f86837-0b0c-4aa5-b4c1-d2662266ac5c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:52.299089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a6f86837-0b0c-4aa5-b4c1-d2662266ac5c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:52.305561 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6f86837-0b0c-4aa5-b4c1-d2662266ac5c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:52.306036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6f86837-0b0c-4aa5-b4c1-d2662266ac5c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:52.306469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6f86837-0b0c-4aa5-b4c1-d2662266ac5c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:52.307142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6f86837-0b0c-4aa5-b4c1-d2662266ac5c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:52.307748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6f86837-0b0c-4aa5-b4c1-d2662266ac5c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:52.308379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6f86837-0b0c-4aa5-b4c1-d2662266ac5c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:52.363550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-aceff7d1-15be-4721-8770-8282c8ff258b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:52.364307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-aceff7d1-15be-4721-8770-8282c8ff258b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:52.370890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aceff7d1-15be-4721-8770-8282c8ff258b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:52.371372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aceff7d1-15be-4721-8770-8282c8ff258b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:52.371811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aceff7d1-15be-4721-8770-8282c8ff258b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:52.372507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aceff7d1-15be-4721-8770-8282c8ff258b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:52.373016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aceff7d1-15be-4721-8770-8282c8ff258b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:52.373440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aceff7d1-15be-4721-8770-8282c8ff258b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:52.436016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-aceff7d1-15be-4721-8770-8282c8ff258b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:52.439194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a6f86837-0b0c-4aa5-b4c1-d2662266ac5c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:52.444991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-aceff7d1-15be-4721-8770-8282c8ff258b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:52.446452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-aceff7d1-15be-4721-8770-8282c8ff258b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:52.447300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a6f86837-0b0c-4aa5-b4c1-d2662266ac5c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152702 Sep 01 05:35:52.447596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-aceff7d1-15be-4721-8770-8282c8ff258b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087984 Sep 01 05:35:52.447926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1113/2143] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:52.449146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1031/2144] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:35:53.469415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a0699f13-0282-4115-a822-2b946235063b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:53.470054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a0699f13-0282-4115-a822-2b946235063b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:53.470741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4a854e7f-e01f-44f4-8863-badd56bba184 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:53.471358 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4a854e7f-e01f-44f4-8863-badd56bba184 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:53.476266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0699f13-0282-4115-a822-2b946235063b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:53.476738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0699f13-0282-4115-a822-2b946235063b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:53.477190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0699f13-0282-4115-a822-2b946235063b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:53.477584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a854e7f-e01f-44f4-8863-badd56bba184 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:53.477863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0699f13-0282-4115-a822-2b946235063b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:53.478063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a854e7f-e01f-44f4-8863-badd56bba184 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:53.478306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0699f13-0282-4115-a822-2b946235063b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:53.478496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a854e7f-e01f-44f4-8863-badd56bba184 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:53.478720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a0699f13-0282-4115-a822-2b946235063b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:53.479181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a854e7f-e01f-44f4-8863-badd56bba184 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:53.479849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a854e7f-e01f-44f4-8863-badd56bba184 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:53.480056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a854e7f-e01f-44f4-8863-badd56bba184 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:53.497944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:53.548170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4a854e7f-e01f-44f4-8863-badd56bba184 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:53.556686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4a854e7f-e01f-44f4-8863-badd56bba184 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:53.558676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4a854e7f-e01f-44f4-8863-badd56bba184 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:53.559811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4a854e7f-e01f-44f4-8863-badd56bba184 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.092911 Sep 01 05:35:53.560368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1032/2145] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:35:53.613193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a0699f13-0282-4115-a822-2b946235063b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:53.621717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a0699f13-0282-4115-a822-2b946235063b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156116 Sep 01 05:35:53.622276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1114/2146] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:54.583085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5408703a-c3e9-42b9-b2e1-a7ecd6bf2f0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:54.583728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5408703a-c3e9-42b9-b2e1-a7ecd6bf2f0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:54.591288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5408703a-c3e9-42b9-b2e1-a7ecd6bf2f0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:54.591775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5408703a-c3e9-42b9-b2e1-a7ecd6bf2f0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:54.592210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5408703a-c3e9-42b9-b2e1-a7ecd6bf2f0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:54.592932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5408703a-c3e9-42b9-b2e1-a7ecd6bf2f0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:54.593385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5408703a-c3e9-42b9-b2e1-a7ecd6bf2f0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:54.593808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5408703a-c3e9-42b9-b2e1-a7ecd6bf2f0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:54.642488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-30b0519f-0264-4fd9-a29d-23a378208e1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:54.643096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-30b0519f-0264-4fd9-a29d-23a378208e1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:54.649522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30b0519f-0264-4fd9-a29d-23a378208e1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:54.649993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30b0519f-0264-4fd9-a29d-23a378208e1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:54.650419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30b0519f-0264-4fd9-a29d-23a378208e1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:54.651748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30b0519f-0264-4fd9-a29d-23a378208e1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:54.652628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30b0519f-0264-4fd9-a29d-23a378208e1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:54.652628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-30b0519f-0264-4fd9-a29d-23a378208e1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:54.655081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5408703a-c3e9-42b9-b2e1-a7ecd6bf2f0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:54.663997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5408703a-c3e9-42b9-b2e1-a7ecd6bf2f0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:54.665453 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5408703a-c3e9-42b9-b2e1-a7ecd6bf2f0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:54.666626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5408703a-c3e9-42b9-b2e1-a7ecd6bf2f0d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087478 Sep 01 05:35:54.667359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1033/2147] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:54.779433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-30b0519f-0264-4fd9-a29d-23a378208e1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:54.787464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-30b0519f-0264-4fd9-a29d-23a378208e1e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148770 Sep 01 05:35:54.788287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1115/2148] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:55.688820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c6276062-bd88-496f-a80e-7168dcdc12eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:55.689448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c6276062-bd88-496f-a80e-7168dcdc12eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:55.695701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6276062-bd88-496f-a80e-7168dcdc12eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:55.696171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6276062-bd88-496f-a80e-7168dcdc12eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:55.696596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6276062-bd88-496f-a80e-7168dcdc12eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:55.697297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6276062-bd88-496f-a80e-7168dcdc12eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:55.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6276062-bd88-496f-a80e-7168dcdc12eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:55.698401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6276062-bd88-496f-a80e-7168dcdc12eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:55.759074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c6276062-bd88-496f-a80e-7168dcdc12eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:55.767972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c6276062-bd88-496f-a80e-7168dcdc12eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:55.769425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c6276062-bd88-496f-a80e-7168dcdc12eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:55.770551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c6276062-bd88-496f-a80e-7168dcdc12eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085693 Sep 01 05:35:55.771093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1034/2149] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:55.808824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d77dcf2a-2af4-4256-8928-36bcb1712431 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:55.809443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d77dcf2a-2af4-4256-8928-36bcb1712431 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:55.815801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d77dcf2a-2af4-4256-8928-36bcb1712431 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:55.816281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d77dcf2a-2af4-4256-8928-36bcb1712431 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:55.816718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d77dcf2a-2af4-4256-8928-36bcb1712431 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:55.817428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d77dcf2a-2af4-4256-8928-36bcb1712431 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:55.817880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d77dcf2a-2af4-4256-8928-36bcb1712431 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:55.818305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d77dcf2a-2af4-4256-8928-36bcb1712431 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:55.946719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d77dcf2a-2af4-4256-8928-36bcb1712431 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:55.955549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d77dcf2a-2af4-4256-8928-36bcb1712431 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150700 Sep 01 05:35:55.956114 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1116/2150] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:55 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:56.794356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-56604a02-204a-4f2f-8aab-f1bef1609a5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:56.794950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-56604a02-204a-4f2f-8aab-f1bef1609a5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:56.801311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-56604a02-204a-4f2f-8aab-f1bef1609a5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:56.801787 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-56604a02-204a-4f2f-8aab-f1bef1609a5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:56.802213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-56604a02-204a-4f2f-8aab-f1bef1609a5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:56.802889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-56604a02-204a-4f2f-8aab-f1bef1609a5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:56.803331 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-56604a02-204a-4f2f-8aab-f1bef1609a5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:56.803747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-56604a02-204a-4f2f-8aab-f1bef1609a5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:56.864125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-56604a02-204a-4f2f-8aab-f1bef1609a5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:56.873532 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-56604a02-204a-4f2f-8aab-f1bef1609a5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:56.874965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-56604a02-204a-4f2f-8aab-f1bef1609a5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:56.876119 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-56604a02-204a-4f2f-8aab-f1bef1609a5a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086376 Sep 01 05:35:56.876669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1035/2151] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:56.977459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6844ff2a-b8d4-484b-a911-53854bac4f56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:56.978073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6844ff2a-b8d4-484b-a911-53854bac4f56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:56.985271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6844ff2a-b8d4-484b-a911-53854bac4f56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:56.985759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6844ff2a-b8d4-484b-a911-53854bac4f56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:56.986198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6844ff2a-b8d4-484b-a911-53854bac4f56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:56.986875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6844ff2a-b8d4-484b-a911-53854bac4f56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:56.987323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6844ff2a-b8d4-484b-a911-53854bac4f56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:56.987741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6844ff2a-b8d4-484b-a911-53854bac4f56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:57.126409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6844ff2a-b8d4-484b-a911-53854bac4f56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:57.134521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6844ff2a-b8d4-484b-a911-53854bac4f56 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.160985 Sep 01 05:35:57.135076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1117/2152] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:57.898168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0e0d5bfa-27b3-40c3-ae9c-fcb79252e759 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:57.898776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0e0d5bfa-27b3-40c3-ae9c-fcb79252e759 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:57.905769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e0d5bfa-27b3-40c3-ae9c-fcb79252e759 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:57.906270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e0d5bfa-27b3-40c3-ae9c-fcb79252e759 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:57.906698 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e0d5bfa-27b3-40c3-ae9c-fcb79252e759 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:57.907374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e0d5bfa-27b3-40c3-ae9c-fcb79252e759 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:57.907819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e0d5bfa-27b3-40c3-ae9c-fcb79252e759 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:57.908233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e0d5bfa-27b3-40c3-ae9c-fcb79252e759 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:57.973182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0e0d5bfa-27b3-40c3-ae9c-fcb79252e759 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:57.982212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0e0d5bfa-27b3-40c3-ae9c-fcb79252e759 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:57.983636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0e0d5bfa-27b3-40c3-ae9c-fcb79252e759 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:57.984753 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0e0d5bfa-27b3-40c3-ae9c-fcb79252e759 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090476 Sep 01 05:35:57.985315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1036/2153] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:58.155738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-297e9a8c-d053-4ea0-8ad3-f9df2c433bf3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:58.156291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-297e9a8c-d053-4ea0-8ad3-f9df2c433bf3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:58.162946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-297e9a8c-d053-4ea0-8ad3-f9df2c433bf3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:58.163427 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-297e9a8c-d053-4ea0-8ad3-f9df2c433bf3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:58.163852 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-297e9a8c-d053-4ea0-8ad3-f9df2c433bf3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:58.164520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-297e9a8c-d053-4ea0-8ad3-f9df2c433bf3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:58.164990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-297e9a8c-d053-4ea0-8ad3-f9df2c433bf3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:58.165407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-297e9a8c-d053-4ea0-8ad3-f9df2c433bf3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:58.297186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-297e9a8c-d053-4ea0-8ad3-f9df2c433bf3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:58.305281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-297e9a8c-d053-4ea0-8ad3-f9df2c433bf3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153738 Sep 01 05:35:58.305855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1118/2154] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:58 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:59.006130 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fa259232-f200-4eca-8504-69d6fb37d816 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:59.006742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fa259232-f200-4eca-8504-69d6fb37d816 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:59.014206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa259232-f200-4eca-8504-69d6fb37d816 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:59.014683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa259232-f200-4eca-8504-69d6fb37d816 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:59.015117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa259232-f200-4eca-8504-69d6fb37d816 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:59.015798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa259232-f200-4eca-8504-69d6fb37d816 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:59.016246 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa259232-f200-4eca-8504-69d6fb37d816 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:59.016664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa259232-f200-4eca-8504-69d6fb37d816 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:59.077742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fa259232-f200-4eca-8504-69d6fb37d816 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:59.086752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fa259232-f200-4eca-8504-69d6fb37d816 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:59.088176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fa259232-f200-4eca-8504-69d6fb37d816 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:59.089639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fa259232-f200-4eca-8504-69d6fb37d816 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087446 Sep 01 05:35:59.090514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1037/2155] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:59 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:59.327189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dc9361bf-4a1e-486b-ab2e-2e754dc0c9e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:59.327734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dc9361bf-4a1e-486b-ab2e-2e754dc0c9e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:59.334193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc9361bf-4a1e-486b-ab2e-2e754dc0c9e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:59.334665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc9361bf-4a1e-486b-ab2e-2e754dc0c9e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:59.335095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc9361bf-4a1e-486b-ab2e-2e754dc0c9e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:59.335771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc9361bf-4a1e-486b-ab2e-2e754dc0c9e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:59.336224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc9361bf-4a1e-486b-ab2e-2e754dc0c9e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:59.336642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dc9361bf-4a1e-486b-ab2e-2e754dc0c9e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:59.469278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-dc9361bf-4a1e-486b-ab2e-2e754dc0c9e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:59.477431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dc9361bf-4a1e-486b-ab2e-2e754dc0c9e0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154303 Sep 01 05:35:59.478032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1119/2156] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:59 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:00.111748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0708df5e-77bd-44ff-a98c-cca3a3b42a11 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:00.112362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0708df5e-77bd-44ff-a98c-cca3a3b42a11 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:00.118784 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0708df5e-77bd-44ff-a98c-cca3a3b42a11 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:00.119261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0708df5e-77bd-44ff-a98c-cca3a3b42a11 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:00.120900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0708df5e-77bd-44ff-a98c-cca3a3b42a11 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:00.121593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0708df5e-77bd-44ff-a98c-cca3a3b42a11 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:00.122046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0708df5e-77bd-44ff-a98c-cca3a3b42a11 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:00.122469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0708df5e-77bd-44ff-a98c-cca3a3b42a11 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:00.187996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0708df5e-77bd-44ff-a98c-cca3a3b42a11 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:00.196489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0708df5e-77bd-44ff-a98c-cca3a3b42a11 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:00.199029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0708df5e-77bd-44ff-a98c-cca3a3b42a11 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:00.200197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0708df5e-77bd-44ff-a98c-cca3a3b42a11 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.092342 Sep 01 05:36:00.200756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1038/2157] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:00 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:00.498300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dd756d33-a2ec-4fec-b1e9-fcf2be75b01d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:00.498872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dd756d33-a2ec-4fec-b1e9-fcf2be75b01d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:00.505794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd756d33-a2ec-4fec-b1e9-fcf2be75b01d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:00.506301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd756d33-a2ec-4fec-b1e9-fcf2be75b01d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:00.506815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd756d33-a2ec-4fec-b1e9-fcf2be75b01d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:00.507585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd756d33-a2ec-4fec-b1e9-fcf2be75b01d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:00.508031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd756d33-a2ec-4fec-b1e9-fcf2be75b01d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:00.508443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dd756d33-a2ec-4fec-b1e9-fcf2be75b01d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:00.637006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-dd756d33-a2ec-4fec-b1e9-fcf2be75b01d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:00.645075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dd756d33-a2ec-4fec-b1e9-fcf2be75b01d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150955 Sep 01 05:36:00.645637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1120/2158] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:01.223615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ea17d15b-baa7-4011-a22c-709bd8957e31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:01.224168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ea17d15b-baa7-4011-a22c-709bd8957e31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:01.231342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ea17d15b-baa7-4011-a22c-709bd8957e31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:01.231831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ea17d15b-baa7-4011-a22c-709bd8957e31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:01.232265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ea17d15b-baa7-4011-a22c-709bd8957e31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:01.233001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ea17d15b-baa7-4011-a22c-709bd8957e31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:01.233452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ea17d15b-baa7-4011-a22c-709bd8957e31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:01.233874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ea17d15b-baa7-4011-a22c-709bd8957e31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:01.294617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ea17d15b-baa7-4011-a22c-709bd8957e31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:01.303213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ea17d15b-baa7-4011-a22c-709bd8957e31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:01.304668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ea17d15b-baa7-4011-a22c-709bd8957e31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:01.305837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ea17d15b-baa7-4011-a22c-709bd8957e31 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086272 Sep 01 05:36:01.306388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1039/2159] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:01.665673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-37781537-f12b-41b5-9589-5d03b76702d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:01.666262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-37781537-f12b-41b5-9589-5d03b76702d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:01.673221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37781537-f12b-41b5-9589-5d03b76702d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:01.673696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37781537-f12b-41b5-9589-5d03b76702d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:01.674124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37781537-f12b-41b5-9589-5d03b76702d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:01.674808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37781537-f12b-41b5-9589-5d03b76702d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:01.675251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37781537-f12b-41b5-9589-5d03b76702d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:01.675661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-37781537-f12b-41b5-9589-5d03b76702d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:01.805767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-37781537-f12b-41b5-9589-5d03b76702d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:01.814113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-37781537-f12b-41b5-9589-5d03b76702d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152523 Sep 01 05:36:01.814679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1121/2160] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:01 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:02.329562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2d3c7174-8e18-4b05-aa18-fd662b3a54eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:02.330128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2d3c7174-8e18-4b05-aa18-fd662b3a54eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:02.336491 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2d3c7174-8e18-4b05-aa18-fd662b3a54eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:02.337008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2d3c7174-8e18-4b05-aa18-fd662b3a54eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:02.337448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2d3c7174-8e18-4b05-aa18-fd662b3a54eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:02.338134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2d3c7174-8e18-4b05-aa18-fd662b3a54eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:02.338799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2d3c7174-8e18-4b05-aa18-fd662b3a54eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:02.339260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2d3c7174-8e18-4b05-aa18-fd662b3a54eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:02.403071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2d3c7174-8e18-4b05-aa18-fd662b3a54eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:02.411535 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2d3c7174-8e18-4b05-aa18-fd662b3a54eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:02.413256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2d3c7174-8e18-4b05-aa18-fd662b3a54eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:02.414376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2d3c7174-8e18-4b05-aa18-fd662b3a54eb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088800 Sep 01 05:36:02.414931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1040/2161] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:02 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:02.835975 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2a7f8655-70e9-46c8-a4ba-e3fe8e64f6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:02.836583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2a7f8655-70e9-46c8-a4ba-e3fe8e64f6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:02.843175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a7f8655-70e9-46c8-a4ba-e3fe8e64f6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:02.843649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a7f8655-70e9-46c8-a4ba-e3fe8e64f6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:02.844076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a7f8655-70e9-46c8-a4ba-e3fe8e64f6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:02.844746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a7f8655-70e9-46c8-a4ba-e3fe8e64f6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:02.845216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a7f8655-70e9-46c8-a4ba-e3fe8e64f6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:02.845628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a7f8655-70e9-46c8-a4ba-e3fe8e64f6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:02.975849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2a7f8655-70e9-46c8-a4ba-e3fe8e64f6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:02.983946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2a7f8655-70e9-46c8-a4ba-e3fe8e64f6a2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151807 Sep 01 05:36:02.984500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1122/2162] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:02 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:03.437954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cd375dea-a4f9-4f61-850a-fbd8f8ef78db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:03.438547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cd375dea-a4f9-4f61-850a-fbd8f8ef78db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:03.444959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd375dea-a4f9-4f61-850a-fbd8f8ef78db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:03.445431 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd375dea-a4f9-4f61-850a-fbd8f8ef78db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:03.445856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd375dea-a4f9-4f61-850a-fbd8f8ef78db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:03.446528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd375dea-a4f9-4f61-850a-fbd8f8ef78db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:03.447073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd375dea-a4f9-4f61-850a-fbd8f8ef78db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:03.447495 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd375dea-a4f9-4f61-850a-fbd8f8ef78db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:03.508660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cd375dea-a4f9-4f61-850a-fbd8f8ef78db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:03.517990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cd375dea-a4f9-4f61-850a-fbd8f8ef78db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:03.519412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cd375dea-a4f9-4f61-850a-fbd8f8ef78db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:03.520536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cd375dea-a4f9-4f61-850a-fbd8f8ef78db tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086531 Sep 01 05:36:03.521125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1041/2163] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:03 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:04.005550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1f013da4-08eb-43ee-9893-c88bac215791 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:04.006165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1f013da4-08eb-43ee-9893-c88bac215791 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:04.012524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f013da4-08eb-43ee-9893-c88bac215791 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:04.013032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f013da4-08eb-43ee-9893-c88bac215791 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:04.013469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f013da4-08eb-43ee-9893-c88bac215791 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:04.014151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f013da4-08eb-43ee-9893-c88bac215791 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:04.014603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f013da4-08eb-43ee-9893-c88bac215791 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:04.015026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f013da4-08eb-43ee-9893-c88bac215791 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:04.142769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1f013da4-08eb-43ee-9893-c88bac215791 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:04.151164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1f013da4-08eb-43ee-9893-c88bac215791 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149228 Sep 01 05:36:04.151681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1123/2164] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:04.543098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3c57e730-2099-4674-a63b-274c123e77ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:04.543704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3c57e730-2099-4674-a63b-274c123e77ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:04.550206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c57e730-2099-4674-a63b-274c123e77ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:04.550679 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c57e730-2099-4674-a63b-274c123e77ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:04.551106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c57e730-2099-4674-a63b-274c123e77ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:04.551777 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c57e730-2099-4674-a63b-274c123e77ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:04.552220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c57e730-2099-4674-a63b-274c123e77ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:04.552636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c57e730-2099-4674-a63b-274c123e77ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:04.614280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3c57e730-2099-4674-a63b-274c123e77ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:04.623157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3c57e730-2099-4674-a63b-274c123e77ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:04.624580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3c57e730-2099-4674-a63b-274c123e77ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:04.625734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3c57e730-2099-4674-a63b-274c123e77ae tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087177 Sep 01 05:36:04.626284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1042/2165] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:04 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:05.173117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-092eaf34-dcff-4d4d-97fc-25d12397cc19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:05.173728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-092eaf34-dcff-4d4d-97fc-25d12397cc19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:05.180220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-092eaf34-dcff-4d4d-97fc-25d12397cc19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:05.180697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-092eaf34-dcff-4d4d-97fc-25d12397cc19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:05.181163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-092eaf34-dcff-4d4d-97fc-25d12397cc19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:05.181841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-092eaf34-dcff-4d4d-97fc-25d12397cc19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:05.182296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-092eaf34-dcff-4d4d-97fc-25d12397cc19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:05.182712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-092eaf34-dcff-4d4d-97fc-25d12397cc19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:05.556001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-092eaf34-dcff-4d4d-97fc-25d12397cc19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:05.564526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-092eaf34-dcff-4d4d-97fc-25d12397cc19 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.395372 Sep 01 05:36:05.565117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1124/2166] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:05 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:05.649349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-413131c8-9de8-4ad1-a240-9ca913452092 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:05.649991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-413131c8-9de8-4ad1-a240-9ca913452092 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:05.657028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-413131c8-9de8-4ad1-a240-9ca913452092 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:05.657501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-413131c8-9de8-4ad1-a240-9ca913452092 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:05.657924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-413131c8-9de8-4ad1-a240-9ca913452092 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:05.658595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-413131c8-9de8-4ad1-a240-9ca913452092 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:05.659036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-413131c8-9de8-4ad1-a240-9ca913452092 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:05.659451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-413131c8-9de8-4ad1-a240-9ca913452092 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:05.721650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-413131c8-9de8-4ad1-a240-9ca913452092 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:05.730756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-413131c8-9de8-4ad1-a240-9ca913452092 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:05.732212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-413131c8-9de8-4ad1-a240-9ca913452092 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:05.733377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-413131c8-9de8-4ad1-a240-9ca913452092 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087867 Sep 01 05:36:05.733931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1043/2167] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:05 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:06.586351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3620143e-9eb9-4e41-a037-fc5dfdf90657 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:06.586972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3620143e-9eb9-4e41-a037-fc5dfdf90657 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:06.594077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3620143e-9eb9-4e41-a037-fc5dfdf90657 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:06.594553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3620143e-9eb9-4e41-a037-fc5dfdf90657 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:06.594983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3620143e-9eb9-4e41-a037-fc5dfdf90657 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:06.595661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3620143e-9eb9-4e41-a037-fc5dfdf90657 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:06.596107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3620143e-9eb9-4e41-a037-fc5dfdf90657 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:06.596527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3620143e-9eb9-4e41-a037-fc5dfdf90657 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:06.731167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3620143e-9eb9-4e41-a037-fc5dfdf90657 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:06.745072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3620143e-9eb9-4e41-a037-fc5dfdf90657 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.162413 Sep 01 05:36:06.746055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1125/2168] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:06 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:06.755614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b16f32da-ad4e-4d76-91c0-7da9a95126c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:06.756324 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b16f32da-ad4e-4d76-91c0-7da9a95126c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:06.763970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b16f32da-ad4e-4d76-91c0-7da9a95126c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:06.764444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b16f32da-ad4e-4d76-91c0-7da9a95126c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:06.765011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b16f32da-ad4e-4d76-91c0-7da9a95126c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:06.765582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b16f32da-ad4e-4d76-91c0-7da9a95126c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:06.766026 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b16f32da-ad4e-4d76-91c0-7da9a95126c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:06.766441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b16f32da-ad4e-4d76-91c0-7da9a95126c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:06.837901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b16f32da-ad4e-4d76-91c0-7da9a95126c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:06.848341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b16f32da-ad4e-4d76-91c0-7da9a95126c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:06.849811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b16f32da-ad4e-4d76-91c0-7da9a95126c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:06.850959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b16f32da-ad4e-4d76-91c0-7da9a95126c4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.099490 Sep 01 05:36:06.851523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1044/2169] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:06 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:36:07.769152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f6ef8e34-aef8-4e2d-b529-442e13813a73 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:07.769760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f6ef8e34-aef8-4e2d-b529-442e13813a73 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:07.776716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f6ef8e34-aef8-4e2d-b529-442e13813a73 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:07.777214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f6ef8e34-aef8-4e2d-b529-442e13813a73 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:07.777642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f6ef8e34-aef8-4e2d-b529-442e13813a73 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:07.778311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f6ef8e34-aef8-4e2d-b529-442e13813a73 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:07.778750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f6ef8e34-aef8-4e2d-b529-442e13813a73 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:07.779164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f6ef8e34-aef8-4e2d-b529-442e13813a73 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:07.793865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:07.878384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-149e0729-3b49-476b-a008-263d97a7e605 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:07.879107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-149e0729-3b49-476b-a008-263d97a7e605 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:07.886293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-149e0729-3b49-476b-a008-263d97a7e605 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:07.886798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-149e0729-3b49-476b-a008-263d97a7e605 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:07.887231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-149e0729-3b49-476b-a008-263d97a7e605 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:07.887923 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-149e0729-3b49-476b-a008-263d97a7e605 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:07.888384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-149e0729-3b49-476b-a008-263d97a7e605 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:07.888830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-149e0729-3b49-476b-a008-263d97a7e605 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:07.908548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f6ef8e34-aef8-4e2d-b529-442e13813a73 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:07.917608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f6ef8e34-aef8-4e2d-b529-442e13813a73 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151689 Sep 01 05:36:07.918201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1126/2170] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:07 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:07.952642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-149e0729-3b49-476b-a008-263d97a7e605 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:07.961270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-149e0729-3b49-476b-a008-263d97a7e605 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:07.962713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-149e0729-3b49-476b-a008-263d97a7e605 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:07.964545 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-149e0729-3b49-476b-a008-263d97a7e605 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090120 Sep 01 05:36:07.965147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1045/2171] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:07 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:36:08.939002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5cc32757-d393-40c0-8c23-23faa88f48d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:08.939631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5cc32757-d393-40c0-8c23-23faa88f48d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:08.945920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cc32757-d393-40c0-8c23-23faa88f48d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:08.946392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cc32757-d393-40c0-8c23-23faa88f48d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:08.946818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cc32757-d393-40c0-8c23-23faa88f48d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:08.947546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cc32757-d393-40c0-8c23-23faa88f48d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:08.947999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cc32757-d393-40c0-8c23-23faa88f48d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:08.948407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5cc32757-d393-40c0-8c23-23faa88f48d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:08.986060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f56b7572-5c16-43a1-a16a-f7f14c09e3bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:08.986805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f56b7572-5c16-43a1-a16a-f7f14c09e3bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:08.993554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f56b7572-5c16-43a1-a16a-f7f14c09e3bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:08.994117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f56b7572-5c16-43a1-a16a-f7f14c09e3bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:08.994628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f56b7572-5c16-43a1-a16a-f7f14c09e3bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:08.995492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f56b7572-5c16-43a1-a16a-f7f14c09e3bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:08.996017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f56b7572-5c16-43a1-a16a-f7f14c09e3bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:08.996532 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f56b7572-5c16-43a1-a16a-f7f14c09e3bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:09.061130 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f56b7572-5c16-43a1-a16a-f7f14c09e3bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:09.069871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f56b7572-5c16-43a1-a16a-f7f14c09e3bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:09.071308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f56b7572-5c16-43a1-a16a-f7f14c09e3bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:09.073008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f56b7572-5c16-43a1-a16a-f7f14c09e3bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090252 Sep 01 05:36:09.073577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1046/2172] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:08 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:09.079297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5cc32757-d393-40c0-8c23-23faa88f48d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:09.087364 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5cc32757-d393-40c0-8c23-23faa88f48d6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152280 Sep 01 05:36:09.088077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1127/2173] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:08 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:10.095248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-abdf1669-24c3-4921-a502-b6e9168db5fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:10.095859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-abdf1669-24c3-4921-a502-b6e9168db5fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:10.102275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abdf1669-24c3-4921-a502-b6e9168db5fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:10.102755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abdf1669-24c3-4921-a502-b6e9168db5fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:10.103188 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abdf1669-24c3-4921-a502-b6e9168db5fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:10.104858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abdf1669-24c3-4921-a502-b6e9168db5fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:10.105440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abdf1669-24c3-4921-a502-b6e9168db5fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:10.105870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-abdf1669-24c3-4921-a502-b6e9168db5fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:10.110623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-09728b53-578c-4f0e-80d7-dd510ff832f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:10.111348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-09728b53-578c-4f0e-80d7-dd510ff832f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:10.117677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09728b53-578c-4f0e-80d7-dd510ff832f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:10.118147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09728b53-578c-4f0e-80d7-dd510ff832f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:10.118571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09728b53-578c-4f0e-80d7-dd510ff832f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:10.119881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09728b53-578c-4f0e-80d7-dd510ff832f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:10.120434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09728b53-578c-4f0e-80d7-dd510ff832f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:10.120890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-09728b53-578c-4f0e-80d7-dd510ff832f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:10.169122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-abdf1669-24c3-4921-a502-b6e9168db5fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:10.177703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-abdf1669-24c3-4921-a502-b6e9168db5fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:10.179201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-abdf1669-24c3-4921-a502-b6e9168db5fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:10.180342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-abdf1669-24c3-4921-a502-b6e9168db5fc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089024 Sep 01 05:36:10.180910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1047/2174] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:10 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:36:10.252152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-09728b53-578c-4f0e-80d7-dd510ff832f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:10.260676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-09728b53-578c-4f0e-80d7-dd510ff832f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153826 Sep 01 05:36:10.261263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1128/2175] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:11.203551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dcb20735-c925-44df-8843-f3425ff6c6e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:11.204109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dcb20735-c925-44df-8843-f3425ff6c6e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:11.206099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:36:11.206272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf (ip 10.222.0.49) !!! Sep 01 05:36:11.216166 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dcb20735-c925-44df-8843-f3425ff6c6e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:11.216653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dcb20735-c925-44df-8843-f3425ff6c6e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:11.217125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dcb20735-c925-44df-8843-f3425ff6c6e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:11.217812 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dcb20735-c925-44df-8843-f3425ff6c6e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:11.218260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dcb20735-c925-44df-8843-f3425ff6c6e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:11.218681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dcb20735-c925-44df-8843-f3425ff6c6e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:11.282876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9600df48-0a6c-4d30-8a80-cdee2710ac71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:11.283489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9600df48-0a6c-4d30-8a80-cdee2710ac71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:11.284594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dcb20735-c925-44df-8843-f3425ff6c6e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:11.290265 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9600df48-0a6c-4d30-8a80-cdee2710ac71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:11.290750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9600df48-0a6c-4d30-8a80-cdee2710ac71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:11.291182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9600df48-0a6c-4d30-8a80-cdee2710ac71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:11.291967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9600df48-0a6c-4d30-8a80-cdee2710ac71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:11.293727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9600df48-0a6c-4d30-8a80-cdee2710ac71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:11.294151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9600df48-0a6c-4d30-8a80-cdee2710ac71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:11.294313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dcb20735-c925-44df-8843-f3425ff6c6e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:11.295617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dcb20735-c925-44df-8843-f3425ff6c6e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:11.296760 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dcb20735-c925-44df-8843-f3425ff6c6e6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.097308 Sep 01 05:36:11.297338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1048/2176] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:11 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:11.424110 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9600df48-0a6c-4d30-8a80-cdee2710ac71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:11.432376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9600df48-0a6c-4d30-8a80-cdee2710ac71 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153330 Sep 01 05:36:11.433622 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1129/2177] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:11 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:12.319294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a7f368b3-d5f1-4689-9799-79652b411f6c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:12.319843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a7f368b3-d5f1-4689-9799-79652b411f6c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:12.327176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7f368b3-d5f1-4689-9799-79652b411f6c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:12.327665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7f368b3-d5f1-4689-9799-79652b411f6c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:12.328101 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7f368b3-d5f1-4689-9799-79652b411f6c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:12.328800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7f368b3-d5f1-4689-9799-79652b411f6c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:12.329267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7f368b3-d5f1-4689-9799-79652b411f6c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:12.329694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7f368b3-d5f1-4689-9799-79652b411f6c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:12.333602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:12.390924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a7f368b3-d5f1-4689-9799-79652b411f6c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:12.399458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a7f368b3-d5f1-4689-9799-79652b411f6c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:12.400937 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a7f368b3-d5f1-4689-9799-79652b411f6c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:12.402779 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a7f368b3-d5f1-4689-9799-79652b411f6c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087482 Sep 01 05:36:12.403339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1049/2178] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:12 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:12.454254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8e9f4bf7-be54-4a80-bdad-2d1ee55838f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:12.454864 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8e9f4bf7-be54-4a80-bdad-2d1ee55838f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:12.461509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e9f4bf7-be54-4a80-bdad-2d1ee55838f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:12.461980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e9f4bf7-be54-4a80-bdad-2d1ee55838f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:12.462407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e9f4bf7-be54-4a80-bdad-2d1ee55838f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:12.463074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e9f4bf7-be54-4a80-bdad-2d1ee55838f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:12.463514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e9f4bf7-be54-4a80-bdad-2d1ee55838f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:12.464030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e9f4bf7-be54-4a80-bdad-2d1ee55838f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:12.589418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8e9f4bf7-be54-4a80-bdad-2d1ee55838f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:12.597436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8e9f4bf7-be54-4a80-bdad-2d1ee55838f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.147017 Sep 01 05:36:12.597997 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1130/2179] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:12 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:13.425839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-08f6f0a2-9d60-490f-bae0-699debfb3344 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:13.426451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-08f6f0a2-9d60-490f-bae0-699debfb3344 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:13.432640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-08f6f0a2-9d60-490f-bae0-699debfb3344 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:13.433476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-08f6f0a2-9d60-490f-bae0-699debfb3344 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:13.433922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-08f6f0a2-9d60-490f-bae0-699debfb3344 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:13.434605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-08f6f0a2-9d60-490f-bae0-699debfb3344 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:13.435056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-08f6f0a2-9d60-490f-bae0-699debfb3344 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:13.435504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-08f6f0a2-9d60-490f-bae0-699debfb3344 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:13.496637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-08f6f0a2-9d60-490f-bae0-699debfb3344 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:13.505201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-08f6f0a2-9d60-490f-bae0-699debfb3344 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:13.506647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-08f6f0a2-9d60-490f-bae0-699debfb3344 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:13.507807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-08f6f0a2-9d60-490f-bae0-699debfb3344 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085811 Sep 01 05:36:13.508349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1050/2180] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:13 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:13.618253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-db176ed6-72d5-4b5e-bc71-220e94d8fdf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:13.618871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-db176ed6-72d5-4b5e-bc71-220e94d8fdf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:13.625545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db176ed6-72d5-4b5e-bc71-220e94d8fdf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:13.626029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db176ed6-72d5-4b5e-bc71-220e94d8fdf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:13.626463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db176ed6-72d5-4b5e-bc71-220e94d8fdf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:13.627149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db176ed6-72d5-4b5e-bc71-220e94d8fdf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:13.627602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db176ed6-72d5-4b5e-bc71-220e94d8fdf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:13.628027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db176ed6-72d5-4b5e-bc71-220e94d8fdf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:13.757374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-db176ed6-72d5-4b5e-bc71-220e94d8fdf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:13.766276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-db176ed6-72d5-4b5e-bc71-220e94d8fdf8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151885 Sep 01 05:36:13.766835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1131/2181] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:14.530622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-22df0f24-f182-4848-95c6-4abac2f347ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:14.531238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-22df0f24-f182-4848-95c6-4abac2f347ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:14.538033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-22df0f24-f182-4848-95c6-4abac2f347ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:14.538518 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-22df0f24-f182-4848-95c6-4abac2f347ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:14.538952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-22df0f24-f182-4848-95c6-4abac2f347ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:14.539631 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-22df0f24-f182-4848-95c6-4abac2f347ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:14.540077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-22df0f24-f182-4848-95c6-4abac2f347ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:14.540495 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-22df0f24-f182-4848-95c6-4abac2f347ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:14.602762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-22df0f24-f182-4848-95c6-4abac2f347ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:14.612256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-22df0f24-f182-4848-95c6-4abac2f347ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:14.613750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-22df0f24-f182-4848-95c6-4abac2f347ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:14.614887 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-22df0f24-f182-4848-95c6-4abac2f347ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088763 Sep 01 05:36:14.615444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1051/2182] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:14 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:14.787725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-14e8a689-07c8-435d-8ffe-c093a675b2ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:14.788262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-14e8a689-07c8-435d-8ffe-c093a675b2ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:14.795395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14e8a689-07c8-435d-8ffe-c093a675b2ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:14.795870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14e8a689-07c8-435d-8ffe-c093a675b2ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:14.796299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14e8a689-07c8-435d-8ffe-c093a675b2ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:14.797007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14e8a689-07c8-435d-8ffe-c093a675b2ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:14.797456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14e8a689-07c8-435d-8ffe-c093a675b2ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:14.797874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14e8a689-07c8-435d-8ffe-c093a675b2ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:14.924243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-14e8a689-07c8-435d-8ffe-c093a675b2ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:14.932559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-14e8a689-07c8-435d-8ffe-c093a675b2ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148932 Sep 01 05:36:14.933183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1132/2183] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:14 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:15.638599 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8101cf3e-6122-4c63-af86-cd8f159eb68f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:15.639247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8101cf3e-6122-4c63-af86-cd8f159eb68f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:15.645942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8101cf3e-6122-4c63-af86-cd8f159eb68f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:15.646431 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8101cf3e-6122-4c63-af86-cd8f159eb68f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:15.646868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8101cf3e-6122-4c63-af86-cd8f159eb68f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:15.647553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8101cf3e-6122-4c63-af86-cd8f159eb68f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:15.648003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8101cf3e-6122-4c63-af86-cd8f159eb68f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:15.648423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8101cf3e-6122-4c63-af86-cd8f159eb68f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:15.715186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8101cf3e-6122-4c63-af86-cd8f159eb68f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:15.723730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8101cf3e-6122-4c63-af86-cd8f159eb68f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:15.725204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8101cf3e-6122-4c63-af86-cd8f159eb68f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:15.726361 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8101cf3e-6122-4c63-af86-cd8f159eb68f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.092287 Sep 01 05:36:15.726903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1052/2184] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:15 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:15.953684 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7aed95a6-91b5-4b1e-9c6b-01404eb2f83c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:15.954294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7aed95a6-91b5-4b1e-9c6b-01404eb2f83c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:15.960696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7aed95a6-91b5-4b1e-9c6b-01404eb2f83c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:15.961269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7aed95a6-91b5-4b1e-9c6b-01404eb2f83c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:15.961697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7aed95a6-91b5-4b1e-9c6b-01404eb2f83c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:15.962360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7aed95a6-91b5-4b1e-9c6b-01404eb2f83c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:15.962801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7aed95a6-91b5-4b1e-9c6b-01404eb2f83c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:15.963215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7aed95a6-91b5-4b1e-9c6b-01404eb2f83c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:16.092875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7aed95a6-91b5-4b1e-9c6b-01404eb2f83c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:16.100952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7aed95a6-91b5-4b1e-9c6b-01404eb2f83c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151157 Sep 01 05:36:16.101513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1133/2185] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:16.749145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0e0ba2e6-dca7-474d-a883-66543ab173f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:16.749758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0e0ba2e6-dca7-474d-a883-66543ab173f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:16.756233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e0ba2e6-dca7-474d-a883-66543ab173f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:16.756710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e0ba2e6-dca7-474d-a883-66543ab173f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:16.757175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e0ba2e6-dca7-474d-a883-66543ab173f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:16.757851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e0ba2e6-dca7-474d-a883-66543ab173f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:16.758301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e0ba2e6-dca7-474d-a883-66543ab173f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:16.758719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e0ba2e6-dca7-474d-a883-66543ab173f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:16.819931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0e0ba2e6-dca7-474d-a883-66543ab173f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:16.829063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0e0ba2e6-dca7-474d-a883-66543ab173f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:16.830540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0e0ba2e6-dca7-474d-a883-66543ab173f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:16.831674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0e0ba2e6-dca7-474d-a883-66543ab173f6 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086454 Sep 01 05:36:16.832226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1053/2186] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:16 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:17.122941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ac16cd3b-1fbf-4e47-b20d-a75d58ec8d48 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:17.123488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ac16cd3b-1fbf-4e47-b20d-a75d58ec8d48 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:17.130246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac16cd3b-1fbf-4e47-b20d-a75d58ec8d48 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:17.130735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac16cd3b-1fbf-4e47-b20d-a75d58ec8d48 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:17.131174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac16cd3b-1fbf-4e47-b20d-a75d58ec8d48 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:17.131876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac16cd3b-1fbf-4e47-b20d-a75d58ec8d48 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:17.132459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac16cd3b-1fbf-4e47-b20d-a75d58ec8d48 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:17.132929 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ac16cd3b-1fbf-4e47-b20d-a75d58ec8d48 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:17.273999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ac16cd3b-1fbf-4e47-b20d-a75d58ec8d48 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:17.282221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ac16cd3b-1fbf-4e47-b20d-a75d58ec8d48 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.163546 Sep 01 05:36:17.282787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1134/2187] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:17 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:17.854933 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-47cfc3d8-2d29-485a-92dd-b410288ae46f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:17.855480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-47cfc3d8-2d29-485a-92dd-b410288ae46f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:17.861790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-47cfc3d8-2d29-485a-92dd-b410288ae46f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:17.862264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-47cfc3d8-2d29-485a-92dd-b410288ae46f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:17.862693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-47cfc3d8-2d29-485a-92dd-b410288ae46f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:17.863365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-47cfc3d8-2d29-485a-92dd-b410288ae46f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:17.863806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-47cfc3d8-2d29-485a-92dd-b410288ae46f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:17.864221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-47cfc3d8-2d29-485a-92dd-b410288ae46f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:17.926661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-47cfc3d8-2d29-485a-92dd-b410288ae46f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:17.935682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-47cfc3d8-2d29-485a-92dd-b410288ae46f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:17.937135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-47cfc3d8-2d29-485a-92dd-b410288ae46f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:17.938262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-47cfc3d8-2d29-485a-92dd-b410288ae46f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087349 Sep 01 05:36:17.938808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1054/2188] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:17 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:18.303463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e13650a4-aea3-4455-93c0-401b924f1160 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:18.304075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e13650a4-aea3-4455-93c0-401b924f1160 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:18.311433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e13650a4-aea3-4455-93c0-401b924f1160 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:18.311905 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e13650a4-aea3-4455-93c0-401b924f1160 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:18.312333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e13650a4-aea3-4455-93c0-401b924f1160 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:18.313034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e13650a4-aea3-4455-93c0-401b924f1160 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:18.313483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e13650a4-aea3-4455-93c0-401b924f1160 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:18.313906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e13650a4-aea3-4455-93c0-401b924f1160 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:18.440925 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e13650a4-aea3-4455-93c0-401b924f1160 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:18.449305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e13650a4-aea3-4455-93c0-401b924f1160 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149719 Sep 01 05:36:18.449882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1135/2189] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:18 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:18.961345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dbd82c43-b2e0-4a0b-951d-9bf3f5a4f0e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:18.962183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dbd82c43-b2e0-4a0b-951d-9bf3f5a4f0e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:18.969198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbd82c43-b2e0-4a0b-951d-9bf3f5a4f0e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:18.969676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbd82c43-b2e0-4a0b-951d-9bf3f5a4f0e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:18.970109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbd82c43-b2e0-4a0b-951d-9bf3f5a4f0e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:18.970786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbd82c43-b2e0-4a0b-951d-9bf3f5a4f0e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:18.971232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbd82c43-b2e0-4a0b-951d-9bf3f5a4f0e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:18.971652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dbd82c43-b2e0-4a0b-951d-9bf3f5a4f0e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:19.033627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dbd82c43-b2e0-4a0b-951d-9bf3f5a4f0e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:19.042424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dbd82c43-b2e0-4a0b-951d-9bf3f5a4f0e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:19.044653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dbd82c43-b2e0-4a0b-951d-9bf3f5a4f0e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:19.045814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dbd82c43-b2e0-4a0b-951d-9bf3f5a4f0e8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088413 Sep 01 05:36:19.046373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1055/2190] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:18 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:19.471144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-540f2545-767d-41a4-bf13-443eafb2528d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:19.471764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-540f2545-767d-41a4-bf13-443eafb2528d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:19.478243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-540f2545-767d-41a4-bf13-443eafb2528d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:19.478717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-540f2545-767d-41a4-bf13-443eafb2528d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:19.479149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-540f2545-767d-41a4-bf13-443eafb2528d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:19.479829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-540f2545-767d-41a4-bf13-443eafb2528d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:19.480923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-540f2545-767d-41a4-bf13-443eafb2528d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:19.481355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-540f2545-767d-41a4-bf13-443eafb2528d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:19.611597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-540f2545-767d-41a4-bf13-443eafb2528d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:19.619687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-540f2545-767d-41a4-bf13-443eafb2528d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152489 Sep 01 05:36:19.620252 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1136/2191] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:19 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:20.069204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d20b092d-2bb8-40a2-88cd-756fcaff8713 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:20.069820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d20b092d-2bb8-40a2-88cd-756fcaff8713 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:20.077013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d20b092d-2bb8-40a2-88cd-756fcaff8713 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:20.077493 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d20b092d-2bb8-40a2-88cd-756fcaff8713 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:20.077924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d20b092d-2bb8-40a2-88cd-756fcaff8713 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:20.078601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d20b092d-2bb8-40a2-88cd-756fcaff8713 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:20.079082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d20b092d-2bb8-40a2-88cd-756fcaff8713 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:20.079500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d20b092d-2bb8-40a2-88cd-756fcaff8713 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:20.144283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d20b092d-2bb8-40a2-88cd-756fcaff8713 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:20.153235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d20b092d-2bb8-40a2-88cd-756fcaff8713 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:20.154628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d20b092d-2bb8-40a2-88cd-756fcaff8713 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:20.155766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d20b092d-2bb8-40a2-88cd-756fcaff8713 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090475 Sep 01 05:36:20.156319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1056/2192] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:20 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:20.641251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-54a1ecc8-cfed-4074-b7fd-d52ac33089f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:20.641866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-54a1ecc8-cfed-4074-b7fd-d52ac33089f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:20.648342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54a1ecc8-cfed-4074-b7fd-d52ac33089f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:20.648841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54a1ecc8-cfed-4074-b7fd-d52ac33089f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:20.649278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54a1ecc8-cfed-4074-b7fd-d52ac33089f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:20.649955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54a1ecc8-cfed-4074-b7fd-d52ac33089f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:20.650400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54a1ecc8-cfed-4074-b7fd-d52ac33089f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:20.650819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54a1ecc8-cfed-4074-b7fd-d52ac33089f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:20.778157 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-54a1ecc8-cfed-4074-b7fd-d52ac33089f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:20.786308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-54a1ecc8-cfed-4074-b7fd-d52ac33089f6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149573 Sep 01 05:36:20.787137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1137/2193] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:20 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:21.178015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5d03936b-1e04-4bc4-b954-3a43592eddf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:21.178587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5d03936b-1e04-4bc4-b954-3a43592eddf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:21.180559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:36:21.180705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:36:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf (ip 10.222.0.49) !!! Sep 01 05:36:21.182140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=56 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:21.189738 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d03936b-1e04-4bc4-b954-3a43592eddf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:21.190221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d03936b-1e04-4bc4-b954-3a43592eddf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:21.190652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d03936b-1e04-4bc4-b954-3a43592eddf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:21.191340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d03936b-1e04-4bc4-b954-3a43592eddf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:21.191789 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d03936b-1e04-4bc4-b954-3a43592eddf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:21.192207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5d03936b-1e04-4bc4-b954-3a43592eddf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:21.255559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5d03936b-1e04-4bc4-b954-3a43592eddf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:21.265225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5d03936b-1e04-4bc4-b954-3a43592eddf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:21.266797 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5d03936b-1e04-4bc4-b954-3a43592eddf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:21.267931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5d03936b-1e04-4bc4-b954-3a43592eddf5 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.093935 Sep 01 05:36:21.268487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1057/2194] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:21 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:21.808053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3cba467d-cd7e-4024-9601-da7b3fab4af9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:21.808662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3cba467d-cd7e-4024-9601-da7b3fab4af9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:21.811574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=52 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:21.816669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3cba467d-cd7e-4024-9601-da7b3fab4af9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:21.817187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3cba467d-cd7e-4024-9601-da7b3fab4af9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:21.817613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3cba467d-cd7e-4024-9601-da7b3fab4af9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:21.818283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3cba467d-cd7e-4024-9601-da7b3fab4af9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:21.818723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3cba467d-cd7e-4024-9601-da7b3fab4af9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:21.819133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3cba467d-cd7e-4024-9601-da7b3fab4af9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:21.950884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3cba467d-cd7e-4024-9601-da7b3fab4af9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:21.958946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3cba467d-cd7e-4024-9601-da7b3fab4af9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154680 Sep 01 05:36:21.959509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1138/2195] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:21 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:22.291843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9e9b6777-d553-4bda-8e04-65660605674a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:22.292460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9e9b6777-d553-4bda-8e04-65660605674a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:22.299181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e9b6777-d553-4bda-8e04-65660605674a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:22.299659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e9b6777-d553-4bda-8e04-65660605674a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:22.300096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e9b6777-d553-4bda-8e04-65660605674a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:22.300793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e9b6777-d553-4bda-8e04-65660605674a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:22.301258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e9b6777-d553-4bda-8e04-65660605674a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:22.301687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9e9b6777-d553-4bda-8e04-65660605674a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:22.367824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9e9b6777-d553-4bda-8e04-65660605674a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:22.376934 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9e9b6777-d553-4bda-8e04-65660605674a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:22.378371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9e9b6777-d553-4bda-8e04-65660605674a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:22.379504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9e9b6777-d553-4bda-8e04-65660605674a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.092027 Sep 01 05:36:22.380065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1058/2196] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:22 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:22.980711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-45f43c02-88f0-4f9b-ba5f-8ae12153b184 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:22.981540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-45f43c02-88f0-4f9b-ba5f-8ae12153b184 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:22.987915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45f43c02-88f0-4f9b-ba5f-8ae12153b184 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:22.988386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45f43c02-88f0-4f9b-ba5f-8ae12153b184 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:22.988834 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45f43c02-88f0-4f9b-ba5f-8ae12153b184 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:22.989510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45f43c02-88f0-4f9b-ba5f-8ae12153b184 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:22.989953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45f43c02-88f0-4f9b-ba5f-8ae12153b184 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:22.990367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45f43c02-88f0-4f9b-ba5f-8ae12153b184 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:23.118499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-45f43c02-88f0-4f9b-ba5f-8ae12153b184 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:23.127178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-45f43c02-88f0-4f9b-ba5f-8ae12153b184 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150293 Sep 01 05:36:23.127773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1139/2197] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:22 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:23.402855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b2f43a11-8e5b-469c-ad35-818616e20d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:23.403460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b2f43a11-8e5b-469c-ad35-818616e20d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:23.410512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2f43a11-8e5b-469c-ad35-818616e20d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:23.411015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2f43a11-8e5b-469c-ad35-818616e20d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:23.411444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2f43a11-8e5b-469c-ad35-818616e20d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:23.412382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2f43a11-8e5b-469c-ad35-818616e20d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:23.412846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2f43a11-8e5b-469c-ad35-818616e20d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:23.413262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b2f43a11-8e5b-469c-ad35-818616e20d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:23.473668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b2f43a11-8e5b-469c-ad35-818616e20d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:23.482824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b2f43a11-8e5b-469c-ad35-818616e20d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:23.484242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b2f43a11-8e5b-469c-ad35-818616e20d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:23.485534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b2f43a11-8e5b-469c-ad35-818616e20d0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086655 Sep 01 05:36:23.486083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1059/2198] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:23 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:24.149023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0262f0c9-5e01-4f41-92ed-56e3fe3d3278 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:24.149568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0262f0c9-5e01-4f41-92ed-56e3fe3d3278 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:24.156619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0262f0c9-5e01-4f41-92ed-56e3fe3d3278 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:24.157200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0262f0c9-5e01-4f41-92ed-56e3fe3d3278 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:24.157641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0262f0c9-5e01-4f41-92ed-56e3fe3d3278 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:24.158325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0262f0c9-5e01-4f41-92ed-56e3fe3d3278 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:24.158780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0262f0c9-5e01-4f41-92ed-56e3fe3d3278 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:24.159206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0262f0c9-5e01-4f41-92ed-56e3fe3d3278 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:24.292213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0262f0c9-5e01-4f41-92ed-56e3fe3d3278 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:24.300455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0262f0c9-5e01-4f41-92ed-56e3fe3d3278 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155413 Sep 01 05:36:24.301060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1140/2199] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:24 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:24.509531 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6161a5ed-9749-4790-a6b2-b3bfc650556d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:24.510143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6161a5ed-9749-4790-a6b2-b3bfc650556d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:24.517211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6161a5ed-9749-4790-a6b2-b3bfc650556d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:24.517694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6161a5ed-9749-4790-a6b2-b3bfc650556d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:24.518163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6161a5ed-9749-4790-a6b2-b3bfc650556d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:24.518853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6161a5ed-9749-4790-a6b2-b3bfc650556d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:24.519303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6161a5ed-9749-4790-a6b2-b3bfc650556d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:24.519724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6161a5ed-9749-4790-a6b2-b3bfc650556d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:24.584394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6161a5ed-9749-4790-a6b2-b3bfc650556d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:24.593081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6161a5ed-9749-4790-a6b2-b3bfc650556d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:24.594556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6161a5ed-9749-4790-a6b2-b3bfc650556d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:24.595693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6161a5ed-9749-4790-a6b2-b3bfc650556d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090098 Sep 01 05:36:24.596248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1060/2200] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:24 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:25.321605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ec102234-29ed-4446-b537-c6eac28c3c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:25.322201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ec102234-29ed-4446-b537-c6eac28c3c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:25.328490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec102234-29ed-4446-b537-c6eac28c3c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:25.328998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec102234-29ed-4446-b537-c6eac28c3c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:25.329429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec102234-29ed-4446-b537-c6eac28c3c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:25.330103 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec102234-29ed-4446-b537-c6eac28c3c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:25.330546 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec102234-29ed-4446-b537-c6eac28c3c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:25.330959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec102234-29ed-4446-b537-c6eac28c3c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:25.457189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ec102234-29ed-4446-b537-c6eac28c3c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:25.466009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ec102234-29ed-4446-b537-c6eac28c3c27 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148231 Sep 01 05:36:25.466573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1141/2201] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:25 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:25.618164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0fa9e6b8-1a6f-461f-ba17-2eb43b0e1513 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:25.618679 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0fa9e6b8-1a6f-461f-ba17-2eb43b0e1513 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:25.625224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0fa9e6b8-1a6f-461f-ba17-2eb43b0e1513 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:25.625705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0fa9e6b8-1a6f-461f-ba17-2eb43b0e1513 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:25.626140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0fa9e6b8-1a6f-461f-ba17-2eb43b0e1513 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:25.626828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0fa9e6b8-1a6f-461f-ba17-2eb43b0e1513 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:25.627279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0fa9e6b8-1a6f-461f-ba17-2eb43b0e1513 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:25.627694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0fa9e6b8-1a6f-461f-ba17-2eb43b0e1513 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:25.688758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0fa9e6b8-1a6f-461f-ba17-2eb43b0e1513 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:25.697321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0fa9e6b8-1a6f-461f-ba17-2eb43b0e1513 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:25.698762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0fa9e6b8-1a6f-461f-ba17-2eb43b0e1513 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:25.701037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0fa9e6b8-1a6f-461f-ba17-2eb43b0e1513 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086855 Sep 01 05:36:25.701601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1061/2202] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:25 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:26.487563 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8652a118-17d3-4e4f-b3be-59f8d3218030 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:26.488183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8652a118-17d3-4e4f-b3be-59f8d3218030 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:26.494676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8652a118-17d3-4e4f-b3be-59f8d3218030 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:26.495154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8652a118-17d3-4e4f-b3be-59f8d3218030 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:26.495594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8652a118-17d3-4e4f-b3be-59f8d3218030 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:26.496891 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8652a118-17d3-4e4f-b3be-59f8d3218030 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:26.497347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8652a118-17d3-4e4f-b3be-59f8d3218030 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:26.497775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8652a118-17d3-4e4f-b3be-59f8d3218030 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:26.623281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8652a118-17d3-4e4f-b3be-59f8d3218030 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:26.631466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8652a118-17d3-4e4f-b3be-59f8d3218030 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.147790 Sep 01 05:36:26.632033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1142/2203] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:26 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:26.724406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-208a672a-9b2c-4016-af89-ee236a989a81 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:26.725035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-208a672a-9b2c-4016-af89-ee236a989a81 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:26.732171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-208a672a-9b2c-4016-af89-ee236a989a81 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:26.732639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-208a672a-9b2c-4016-af89-ee236a989a81 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:26.733097 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-208a672a-9b2c-4016-af89-ee236a989a81 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:26.733772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-208a672a-9b2c-4016-af89-ee236a989a81 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:26.734219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-208a672a-9b2c-4016-af89-ee236a989a81 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:26.734634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-208a672a-9b2c-4016-af89-ee236a989a81 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:26.795567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-208a672a-9b2c-4016-af89-ee236a989a81 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:26.803975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-208a672a-9b2c-4016-af89-ee236a989a81 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:26.805432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-208a672a-9b2c-4016-af89-ee236a989a81 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:26.806549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-208a672a-9b2c-4016-af89-ee236a989a81 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085991 Sep 01 05:36:26.807100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1062/2204] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:26 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:27.653498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-26ef2512-d2d2-4836-b819-1aba904acc60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:27.654127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-26ef2512-d2d2-4836-b819-1aba904acc60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:27.660560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26ef2512-d2d2-4836-b819-1aba904acc60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:27.661070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26ef2512-d2d2-4836-b819-1aba904acc60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:27.661765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26ef2512-d2d2-4836-b819-1aba904acc60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:27.662439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26ef2512-d2d2-4836-b819-1aba904acc60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:27.662886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26ef2512-d2d2-4836-b819-1aba904acc60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:27.663306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-26ef2512-d2d2-4836-b819-1aba904acc60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:27.665822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:27.796625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-26ef2512-d2d2-4836-b819-1aba904acc60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:27.804827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-26ef2512-d2d2-4836-b819-1aba904acc60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156056 Sep 01 05:36:27.805388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1143/2205] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:27 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:27.829078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b95e142e-3e8c-4346-946a-76028e715b0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:27.829686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b95e142e-3e8c-4346-946a-76028e715b0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:27.835999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b95e142e-3e8c-4346-946a-76028e715b0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:27.836469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b95e142e-3e8c-4346-946a-76028e715b0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:27.836926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b95e142e-3e8c-4346-946a-76028e715b0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:27.837593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b95e142e-3e8c-4346-946a-76028e715b0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:27.838035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b95e142e-3e8c-4346-946a-76028e715b0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:27.838449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b95e142e-3e8c-4346-946a-76028e715b0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:27.899179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b95e142e-3e8c-4346-946a-76028e715b0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:27.908423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b95e142e-3e8c-4346-946a-76028e715b0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:27.909824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b95e142e-3e8c-4346-946a-76028e715b0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:27.910950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b95e142e-3e8c-4346-946a-76028e715b0b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085662 Sep 01 05:36:27.911746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1063/2206] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:27 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:28.826266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-480747ed-387c-4318-91c2-c47cd88993bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:28.826857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-480747ed-387c-4318-91c2-c47cd88993bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:28.833447 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-480747ed-387c-4318-91c2-c47cd88993bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.833925 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-480747ed-387c-4318-91c2-c47cd88993bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.834353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-480747ed-387c-4318-91c2-c47cd88993bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.835027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-480747ed-387c-4318-91c2-c47cd88993bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.835496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-480747ed-387c-4318-91c2-c47cd88993bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.835910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-480747ed-387c-4318-91c2-c47cd88993bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.933179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4a06757d-5697-4c9b-aff4-ca4318f2e4d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:28.934299 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4a06757d-5697-4c9b-aff4-ca4318f2e4d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:28.940737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a06757d-5697-4c9b-aff4-ca4318f2e4d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.941249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a06757d-5697-4c9b-aff4-ca4318f2e4d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.941681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a06757d-5697-4c9b-aff4-ca4318f2e4d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.942372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a06757d-5697-4c9b-aff4-ca4318f2e4d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.942821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a06757d-5697-4c9b-aff4-ca4318f2e4d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.943240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a06757d-5697-4c9b-aff4-ca4318f2e4d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.967441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-480747ed-387c-4318-91c2-c47cd88993bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:28.975648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-480747ed-387c-4318-91c2-c47cd88993bd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153431 Sep 01 05:36:28.976456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1144/2207] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:28 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:29.008424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4a06757d-5697-4c9b-aff4-ca4318f2e4d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:29.017591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4a06757d-5697-4c9b-aff4-ca4318f2e4d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:29.019033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4a06757d-5697-4c9b-aff4-ca4318f2e4d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:29.020175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4a06757d-5697-4c9b-aff4-ca4318f2e4d7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090845 Sep 01 05:36:29.020740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1064/2208] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:28 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:36:29.998356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c16097c7-b0fc-4d29-985b-9dbf03c00f65 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:29.998968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c16097c7-b0fc-4d29-985b-9dbf03c00f65 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:30.005420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c16097c7-b0fc-4d29-985b-9dbf03c00f65 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:30.005895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c16097c7-b0fc-4d29-985b-9dbf03c00f65 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:30.006328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c16097c7-b0fc-4d29-985b-9dbf03c00f65 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:30.007031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c16097c7-b0fc-4d29-985b-9dbf03c00f65 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:30.007478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c16097c7-b0fc-4d29-985b-9dbf03c00f65 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:30.007892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c16097c7-b0fc-4d29-985b-9dbf03c00f65 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:30.044055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ae8f0c47-6aaa-4b40-a51c-92778763c1bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:30.044682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ae8f0c47-6aaa-4b40-a51c-92778763c1bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:30.051232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae8f0c47-6aaa-4b40-a51c-92778763c1bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:30.051715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae8f0c47-6aaa-4b40-a51c-92778763c1bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:30.052148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae8f0c47-6aaa-4b40-a51c-92778763c1bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:30.052866 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae8f0c47-6aaa-4b40-a51c-92778763c1bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:30.053311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae8f0c47-6aaa-4b40-a51c-92778763c1bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:30.053737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae8f0c47-6aaa-4b40-a51c-92778763c1bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:30.118048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ae8f0c47-6aaa-4b40-a51c-92778763c1bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:30.120220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:30.128078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ae8f0c47-6aaa-4b40-a51c-92778763c1bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:30.129551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ae8f0c47-6aaa-4b40-a51c-92778763c1bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:30.130742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ae8f0c47-6aaa-4b40-a51c-92778763c1bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091544 Sep 01 05:36:30.131314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1065/2209] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:30 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:30.142780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c16097c7-b0fc-4d29-985b-9dbf03c00f65 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:30.151139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c16097c7-b0fc-4d29-985b-9dbf03c00f65 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157189 Sep 01 05:36:30.151636 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1145/2210] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:29 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:31.154692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ec9b945f-7f5a-4763-9c7f-72052d5864e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:31.155237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ec9b945f-7f5a-4763-9c7f-72052d5864e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:31.161888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec9b945f-7f5a-4763-9c7f-72052d5864e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:31.162368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec9b945f-7f5a-4763-9c7f-72052d5864e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:31.162799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec9b945f-7f5a-4763-9c7f-72052d5864e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:31.163474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec9b945f-7f5a-4763-9c7f-72052d5864e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:31.163917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec9b945f-7f5a-4763-9c7f-72052d5864e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:31.164332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ec9b945f-7f5a-4763-9c7f-72052d5864e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:31.173881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-55541d49-96b8-469c-a589-0cdb8e309879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:31.174492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-55541d49-96b8-469c-a589-0cdb8e309879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:31.181563 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55541d49-96b8-469c-a589-0cdb8e309879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:31.182048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55541d49-96b8-469c-a589-0cdb8e309879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:31.182479 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55541d49-96b8-469c-a589-0cdb8e309879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:31.183165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55541d49-96b8-469c-a589-0cdb8e309879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:31.184123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55541d49-96b8-469c-a589-0cdb8e309879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:31.184537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55541d49-96b8-469c-a589-0cdb8e309879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:31.232611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ec9b945f-7f5a-4763-9c7f-72052d5864e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:31.241460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ec9b945f-7f5a-4763-9c7f-72052d5864e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:31.242976 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ec9b945f-7f5a-4763-9c7f-72052d5864e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:31.244207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ec9b945f-7f5a-4763-9c7f-72052d5864e7 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.094395 Sep 01 05:36:31.245219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1066/2211] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:31 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:31.314328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-55541d49-96b8-469c-a589-0cdb8e309879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:31.322401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-55541d49-96b8-469c-a589-0cdb8e309879 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152448 Sep 01 05:36:31.322958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1146/2212] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:31 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:32.267550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-253364f7-ce31-4755-b9aa-92ce809bfbd1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:32.268086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-253364f7-ce31-4755-b9aa-92ce809bfbd1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:32.274471 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-253364f7-ce31-4755-b9aa-92ce809bfbd1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:32.274950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-253364f7-ce31-4755-b9aa-92ce809bfbd1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:32.275387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-253364f7-ce31-4755-b9aa-92ce809bfbd1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:32.276066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-253364f7-ce31-4755-b9aa-92ce809bfbd1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:32.276516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-253364f7-ce31-4755-b9aa-92ce809bfbd1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:32.277183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-253364f7-ce31-4755-b9aa-92ce809bfbd1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:32.338125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-253364f7-ce31-4755-b9aa-92ce809bfbd1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:32.343746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a7555cca-2b7e-4582-a910-42a8b7eede60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:32.344383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a7555cca-2b7e-4582-a910-42a8b7eede60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:32.347011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-253364f7-ce31-4755-b9aa-92ce809bfbd1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:32.348454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-253364f7-ce31-4755-b9aa-92ce809bfbd1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:32.349632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-253364f7-ce31-4755-b9aa-92ce809bfbd1 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086082 Sep 01 05:36:32.350191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1067/2213] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:32 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:32.350735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7555cca-2b7e-4582-a910-42a8b7eede60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:32.351211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7555cca-2b7e-4582-a910-42a8b7eede60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:32.351634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7555cca-2b7e-4582-a910-42a8b7eede60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:32.352307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7555cca-2b7e-4582-a910-42a8b7eede60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:32.352749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7555cca-2b7e-4582-a910-42a8b7eede60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:32.353186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7555cca-2b7e-4582-a910-42a8b7eede60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:32.482984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a7555cca-2b7e-4582-a910-42a8b7eede60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:32.491022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a7555cca-2b7e-4582-a910-42a8b7eede60 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151322 Sep 01 05:36:32.491591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1147/2214] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:32 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:33.373687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f006d2a7-b8b4-46f6-a7e5-4a40e59a1e89 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:33.374240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f006d2a7-b8b4-46f6-a7e5-4a40e59a1e89 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:33.380610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f006d2a7-b8b4-46f6-a7e5-4a40e59a1e89 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:33.381109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f006d2a7-b8b4-46f6-a7e5-4a40e59a1e89 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:33.381534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f006d2a7-b8b4-46f6-a7e5-4a40e59a1e89 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:33.382204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f006d2a7-b8b4-46f6-a7e5-4a40e59a1e89 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:33.382644 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f006d2a7-b8b4-46f6-a7e5-4a40e59a1e89 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:33.383056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f006d2a7-b8b4-46f6-a7e5-4a40e59a1e89 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:33.446642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f006d2a7-b8b4-46f6-a7e5-4a40e59a1e89 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:33.455162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f006d2a7-b8b4-46f6-a7e5-4a40e59a1e89 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:33.456582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f006d2a7-b8b4-46f6-a7e5-4a40e59a1e89 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:33.457728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f006d2a7-b8b4-46f6-a7e5-4a40e59a1e89 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088720 Sep 01 05:36:33.458273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1068/2215] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:33 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:33.512341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e591a2d5-b384-42bc-a1ec-ae3429ba1f6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:33.512986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e591a2d5-b384-42bc-a1ec-ae3429ba1f6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:33.519467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e591a2d5-b384-42bc-a1ec-ae3429ba1f6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:33.519942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e591a2d5-b384-42bc-a1ec-ae3429ba1f6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:33.520374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e591a2d5-b384-42bc-a1ec-ae3429ba1f6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:33.521083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e591a2d5-b384-42bc-a1ec-ae3429ba1f6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:33.521535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e591a2d5-b384-42bc-a1ec-ae3429ba1f6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:33.521957 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e591a2d5-b384-42bc-a1ec-ae3429ba1f6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:33.658096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e591a2d5-b384-42bc-a1ec-ae3429ba1f6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:33.666468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e591a2d5-b384-42bc-a1ec-ae3429ba1f6d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.158010 Sep 01 05:36:33.667038 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1148/2216] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:34.479483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cf3dbe7a-a694-4a34-91fb-5e0e1d3f861e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:34.480198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cf3dbe7a-a694-4a34-91fb-5e0e1d3f861e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:34.486722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf3dbe7a-a694-4a34-91fb-5e0e1d3f861e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.487191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf3dbe7a-a694-4a34-91fb-5e0e1d3f861e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.487614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf3dbe7a-a694-4a34-91fb-5e0e1d3f861e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.488280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf3dbe7a-a694-4a34-91fb-5e0e1d3f861e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.488720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf3dbe7a-a694-4a34-91fb-5e0e1d3f861e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.489161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf3dbe7a-a694-4a34-91fb-5e0e1d3f861e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.550404 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cf3dbe7a-a694-4a34-91fb-5e0e1d3f861e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:34.559709 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cf3dbe7a-a694-4a34-91fb-5e0e1d3f861e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:34.561174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cf3dbe7a-a694-4a34-91fb-5e0e1d3f861e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:34.562296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cf3dbe7a-a694-4a34-91fb-5e0e1d3f861e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086768 Sep 01 05:36:34.562861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1069/2217] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:34 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:34.687488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ee71e2b8-c4c2-4384-8a0c-d86f77ba1109 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:34.688128 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ee71e2b8-c4c2-4384-8a0c-d86f77ba1109 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:34.694535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee71e2b8-c4c2-4384-8a0c-d86f77ba1109 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.695011 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee71e2b8-c4c2-4384-8a0c-d86f77ba1109 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.695446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee71e2b8-c4c2-4384-8a0c-d86f77ba1109 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.696135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee71e2b8-c4c2-4384-8a0c-d86f77ba1109 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.696582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee71e2b8-c4c2-4384-8a0c-d86f77ba1109 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.697026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ee71e2b8-c4c2-4384-8a0c-d86f77ba1109 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.826183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ee71e2b8-c4c2-4384-8a0c-d86f77ba1109 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:34.834243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ee71e2b8-c4c2-4384-8a0c-d86f77ba1109 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150692 Sep 01 05:36:34.834809 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1149/2218] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:35.585050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-64572fc0-6965-41a8-848e-11a18df27210 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:35.585668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-64572fc0-6965-41a8-848e-11a18df27210 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:35.593596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64572fc0-6965-41a8-848e-11a18df27210 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:35.594080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64572fc0-6965-41a8-848e-11a18df27210 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:35.594515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64572fc0-6965-41a8-848e-11a18df27210 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:35.595198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64572fc0-6965-41a8-848e-11a18df27210 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:35.595647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64572fc0-6965-41a8-848e-11a18df27210 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:35.596068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-64572fc0-6965-41a8-848e-11a18df27210 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:35.658944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-64572fc0-6965-41a8-848e-11a18df27210 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:35.667637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-64572fc0-6965-41a8-848e-11a18df27210 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:35.669087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-64572fc0-6965-41a8-848e-11a18df27210 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:35.670206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-64572fc0-6965-41a8-848e-11a18df27210 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089154 Sep 01 05:36:35.670752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1070/2219] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:35 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:35.856035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-356b2e43-bb2c-43a5-b903-d16ef030dce3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:35.856571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-356b2e43-bb2c-43a5-b903-d16ef030dce3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:35.863148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-356b2e43-bb2c-43a5-b903-d16ef030dce3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:35.863662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-356b2e43-bb2c-43a5-b903-d16ef030dce3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:35.864102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-356b2e43-bb2c-43a5-b903-d16ef030dce3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:35.864817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-356b2e43-bb2c-43a5-b903-d16ef030dce3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:35.865278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-356b2e43-bb2c-43a5-b903-d16ef030dce3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:35.865704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-356b2e43-bb2c-43a5-b903-d16ef030dce3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:36.001281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-356b2e43-bb2c-43a5-b903-d16ef030dce3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:36.009530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-356b2e43-bb2c-43a5-b903-d16ef030dce3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157594 Sep 01 05:36:36.010095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1150/2220] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:35 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:36.694300 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7a35b4d7-d358-49ca-85f1-718b152d7b3f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:36.694919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7a35b4d7-d358-49ca-85f1-718b152d7b3f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:36.701638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7a35b4d7-d358-49ca-85f1-718b152d7b3f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:36.702116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7a35b4d7-d358-49ca-85f1-718b152d7b3f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:36.702548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7a35b4d7-d358-49ca-85f1-718b152d7b3f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:36.703261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7a35b4d7-d358-49ca-85f1-718b152d7b3f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:36.703734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7a35b4d7-d358-49ca-85f1-718b152d7b3f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:36.704165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7a35b4d7-d358-49ca-85f1-718b152d7b3f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:36.767244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7a35b4d7-d358-49ca-85f1-718b152d7b3f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:36.775686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7a35b4d7-d358-49ca-85f1-718b152d7b3f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:36.778967 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7a35b4d7-d358-49ca-85f1-718b152d7b3f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:36.780129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7a35b4d7-d358-49ca-85f1-718b152d7b3f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090564 Sep 01 05:36:36.780702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1071/2221] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:36 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:37.031859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3f7a2c2c-3437-4e36-afa5-d7e3a1bf99f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:37.032388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3f7a2c2c-3437-4e36-afa5-d7e3a1bf99f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:37.034507 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:36:37.034651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:36:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 (ip 10.222.0.49) !!! Sep 01 05:36:37.044434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f7a2c2c-3437-4e36-afa5-d7e3a1bf99f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:37.044987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f7a2c2c-3437-4e36-afa5-d7e3a1bf99f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:37.045430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f7a2c2c-3437-4e36-afa5-d7e3a1bf99f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:37.046126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f7a2c2c-3437-4e36-afa5-d7e3a1bf99f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:37.046578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f7a2c2c-3437-4e36-afa5-d7e3a1bf99f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:37.046998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f7a2c2c-3437-4e36-afa5-d7e3a1bf99f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:37.175628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3f7a2c2c-3437-4e36-afa5-d7e3a1bf99f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:37.184428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3f7a2c2c-3437-4e36-afa5-d7e3a1bf99f7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157042 Sep 01 05:36:37.185027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1151/2222] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:37 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:37.802896 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-daebc0d5-0857-4217-9942-fbbed222d410 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:37.803505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-daebc0d5-0857-4217-9942-fbbed222d410 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:37.810184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-daebc0d5-0857-4217-9942-fbbed222d410 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:37.810666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-daebc0d5-0857-4217-9942-fbbed222d410 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:37.811102 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-daebc0d5-0857-4217-9942-fbbed222d410 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:37.811786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-daebc0d5-0857-4217-9942-fbbed222d410 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:37.812235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-daebc0d5-0857-4217-9942-fbbed222d410 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:37.812655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-daebc0d5-0857-4217-9942-fbbed222d410 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:37.875885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-daebc0d5-0857-4217-9942-fbbed222d410 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:37.884456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-daebc0d5-0857-4217-9942-fbbed222d410 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:37.885955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-daebc0d5-0857-4217-9942-fbbed222d410 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:37.887608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-daebc0d5-0857-4217-9942-fbbed222d410 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088659 Sep 01 05:36:37.888160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1072/2223] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:37 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:38.205912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6d4cb784-ef21-421d-a53f-c9baa4d82282 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:38.206517 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6d4cb784-ef21-421d-a53f-c9baa4d82282 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:38.212618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d4cb784-ef21-421d-a53f-c9baa4d82282 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:38.213124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d4cb784-ef21-421d-a53f-c9baa4d82282 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:38.213555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d4cb784-ef21-421d-a53f-c9baa4d82282 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:38.214224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d4cb784-ef21-421d-a53f-c9baa4d82282 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:38.214666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d4cb784-ef21-421d-a53f-c9baa4d82282 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:38.215075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d4cb784-ef21-421d-a53f-c9baa4d82282 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:38.344958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6d4cb784-ef21-421d-a53f-c9baa4d82282 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:38.353087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6d4cb784-ef21-421d-a53f-c9baa4d82282 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151005 Sep 01 05:36:38.353649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1152/2224] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:38 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:38.910790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b810a5b7-f965-4648-963d-3fa2a4e1d182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:38.911653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b810a5b7-f965-4648-963d-3fa2a4e1d182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:38.919217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b810a5b7-f965-4648-963d-3fa2a4e1d182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:38.919699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b810a5b7-f965-4648-963d-3fa2a4e1d182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:38.920134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b810a5b7-f965-4648-963d-3fa2a4e1d182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:38.920841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b810a5b7-f965-4648-963d-3fa2a4e1d182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:38.921292 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b810a5b7-f965-4648-963d-3fa2a4e1d182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:38.921713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b810a5b7-f965-4648-963d-3fa2a4e1d182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:38.983031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b810a5b7-f965-4648-963d-3fa2a4e1d182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:38.991583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b810a5b7-f965-4648-963d-3fa2a4e1d182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:38.993054 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b810a5b7-f965-4648-963d-3fa2a4e1d182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:38.994189 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b810a5b7-f965-4648-963d-3fa2a4e1d182 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087335 Sep 01 05:36:38.994750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1073/2225] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:38 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:39.374931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-12ef2fc0-96ef-4e77-80e6-3ae403a6141a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:39.375471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-12ef2fc0-96ef-4e77-80e6-3ae403a6141a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:39.381892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-12ef2fc0-96ef-4e77-80e6-3ae403a6141a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:39.382387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-12ef2fc0-96ef-4e77-80e6-3ae403a6141a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:39.382820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-12ef2fc0-96ef-4e77-80e6-3ae403a6141a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:39.383491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-12ef2fc0-96ef-4e77-80e6-3ae403a6141a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:39.383933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-12ef2fc0-96ef-4e77-80e6-3ae403a6141a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:39.384347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-12ef2fc0-96ef-4e77-80e6-3ae403a6141a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:39.518186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-12ef2fc0-96ef-4e77-80e6-3ae403a6141a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:39.526218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-12ef2fc0-96ef-4e77-80e6-3ae403a6141a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155451 Sep 01 05:36:39.526807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1153/2226] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:40.017565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d2854951-e391-4eb2-8736-32862ff0a261 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:40.018185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d2854951-e391-4eb2-8736-32862ff0a261 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:40.024699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d2854951-e391-4eb2-8736-32862ff0a261 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:40.025287 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d2854951-e391-4eb2-8736-32862ff0a261 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:40.025729 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d2854951-e391-4eb2-8736-32862ff0a261 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:40.026411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d2854951-e391-4eb2-8736-32862ff0a261 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:40.027508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d2854951-e391-4eb2-8736-32862ff0a261 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:40.027952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d2854951-e391-4eb2-8736-32862ff0a261 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:40.088728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d2854951-e391-4eb2-8736-32862ff0a261 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:40.097861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d2854951-e391-4eb2-8736-32862ff0a261 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:40.099302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d2854951-e391-4eb2-8736-32862ff0a261 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:40.100432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d2854951-e391-4eb2-8736-32862ff0a261 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086815 Sep 01 05:36:40.101027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1074/2227] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:40 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:40.548363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-012c67f0-1ed9-4fe8-acff-b29f0cc7cd3a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:40.549021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-012c67f0-1ed9-4fe8-acff-b29f0cc7cd3a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:40.555430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-012c67f0-1ed9-4fe8-acff-b29f0cc7cd3a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:40.555910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-012c67f0-1ed9-4fe8-acff-b29f0cc7cd3a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:40.556343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-012c67f0-1ed9-4fe8-acff-b29f0cc7cd3a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:40.557052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-012c67f0-1ed9-4fe8-acff-b29f0cc7cd3a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:40.557506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-012c67f0-1ed9-4fe8-acff-b29f0cc7cd3a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:40.557937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-012c67f0-1ed9-4fe8-acff-b29f0cc7cd3a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:40.686595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-012c67f0-1ed9-4fe8-acff-b29f0cc7cd3a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:40.694774 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-012c67f0-1ed9-4fe8-acff-b29f0cc7cd3a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150362 Sep 01 05:36:40.695357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1154/2228] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:40 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:41.123851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-706c226e-ef9e-4192-b1a6-4fd2527d7401 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:41.124504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-706c226e-ef9e-4192-b1a6-4fd2527d7401 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:41.131025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-706c226e-ef9e-4192-b1a6-4fd2527d7401 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:41.131507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-706c226e-ef9e-4192-b1a6-4fd2527d7401 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:41.131943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-706c226e-ef9e-4192-b1a6-4fd2527d7401 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:41.132622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-706c226e-ef9e-4192-b1a6-4fd2527d7401 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:41.133104 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-706c226e-ef9e-4192-b1a6-4fd2527d7401 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:41.133528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-706c226e-ef9e-4192-b1a6-4fd2527d7401 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:41.195549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-706c226e-ef9e-4192-b1a6-4fd2527d7401 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:41.204420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-706c226e-ef9e-4192-b1a6-4fd2527d7401 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:41.205889 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-706c226e-ef9e-4192-b1a6-4fd2527d7401 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:41.207022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-706c226e-ef9e-4192-b1a6-4fd2527d7401 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087682 Sep 01 05:36:41.207578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1075/2229] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:41 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:41.715730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6839f7e5-9d51-4aae-b757-493c32916711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:41.716347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6839f7e5-9d51-4aae-b757-493c32916711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:41.718422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:36:41.718569 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:36:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 (ip 10.222.0.49) !!! Sep 01 05:36:41.726458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6839f7e5-9d51-4aae-b757-493c32916711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:41.726946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6839f7e5-9d51-4aae-b757-493c32916711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:41.727385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6839f7e5-9d51-4aae-b757-493c32916711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:41.728099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6839f7e5-9d51-4aae-b757-493c32916711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:41.728550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6839f7e5-9d51-4aae-b757-493c32916711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:41.729014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6839f7e5-9d51-4aae-b757-493c32916711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:41.860941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6839f7e5-9d51-4aae-b757-493c32916711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:41.869150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6839f7e5-9d51-4aae-b757-493c32916711 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157536 Sep 01 05:36:41.869723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1155/2230] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:42.230046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-13a40bf5-10cc-4f91-a9d0-69741ffe5ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:42.230993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-13a40bf5-10cc-4f91-a9d0-69741ffe5ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:42.237567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13a40bf5-10cc-4f91-a9d0-69741ffe5ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:42.238077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13a40bf5-10cc-4f91-a9d0-69741ffe5ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:42.238511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13a40bf5-10cc-4f91-a9d0-69741ffe5ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:42.239209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13a40bf5-10cc-4f91-a9d0-69741ffe5ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:42.239648 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13a40bf5-10cc-4f91-a9d0-69741ffe5ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:42.240069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-13a40bf5-10cc-4f91-a9d0-69741ffe5ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:42.305122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-13a40bf5-10cc-4f91-a9d0-69741ffe5ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:42.313707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-13a40bf5-10cc-4f91-a9d0-69741ffe5ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:42.315142 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-13a40bf5-10cc-4f91-a9d0-69741ffe5ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:42.316281 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-13a40bf5-10cc-4f91-a9d0-69741ffe5ea9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090125 Sep 01 05:36:42.316860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1076/2231] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:42 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:42.890883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-05c047f3-480c-462e-992d-cc8228b4b13e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:42.891522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-05c047f3-480c-462e-992d-cc8228b4b13e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:42.898017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05c047f3-480c-462e-992d-cc8228b4b13e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:42.898492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05c047f3-480c-462e-992d-cc8228b4b13e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:42.898920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05c047f3-480c-462e-992d-cc8228b4b13e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:42.899593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05c047f3-480c-462e-992d-cc8228b4b13e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:42.900037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05c047f3-480c-462e-992d-cc8228b4b13e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:42.900450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-05c047f3-480c-462e-992d-cc8228b4b13e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:43.028304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-05c047f3-480c-462e-992d-cc8228b4b13e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:43.036717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-05c047f3-480c-462e-992d-cc8228b4b13e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149750 Sep 01 05:36:43.037305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1156/2232] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:42 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:43.339439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9daf54a9-072e-4859-8cb9-5c75d4d9b39b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:43.340601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9daf54a9-072e-4859-8cb9-5c75d4d9b39b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:43.346345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9daf54a9-072e-4859-8cb9-5c75d4d9b39b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:43.346817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9daf54a9-072e-4859-8cb9-5c75d4d9b39b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:43.347244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9daf54a9-072e-4859-8cb9-5c75d4d9b39b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:43.347915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9daf54a9-072e-4859-8cb9-5c75d4d9b39b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:43.348358 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9daf54a9-072e-4859-8cb9-5c75d4d9b39b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:43.348795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9daf54a9-072e-4859-8cb9-5c75d4d9b39b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:43.411531 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9daf54a9-072e-4859-8cb9-5c75d4d9b39b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:43.420701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9daf54a9-072e-4859-8cb9-5c75d4d9b39b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:43.422157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9daf54a9-072e-4859-8cb9-5c75d4d9b39b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:43.423287 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9daf54a9-072e-4859-8cb9-5c75d4d9b39b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088073 Sep 01 05:36:43.423835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1077/2233] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:43 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:44.058329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2beb9693-f513-4006-a299-5e85956d6900 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:44.059679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2beb9693-f513-4006-a299-5e85956d6900 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:44.066153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2beb9693-f513-4006-a299-5e85956d6900 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:44.066635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2beb9693-f513-4006-a299-5e85956d6900 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:44.067073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2beb9693-f513-4006-a299-5e85956d6900 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:44.067760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2beb9693-f513-4006-a299-5e85956d6900 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:44.068213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2beb9693-f513-4006-a299-5e85956d6900 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:44.068637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2beb9693-f513-4006-a299-5e85956d6900 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:44.200541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2beb9693-f513-4006-a299-5e85956d6900 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:44.208587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2beb9693-f513-4006-a299-5e85956d6900 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154154 Sep 01 05:36:44.209185 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1157/2234] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:44 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:44.445770 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-20741867-7a9f-483f-8591-eb4a12838f45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:44.446311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-20741867-7a9f-483f-8591-eb4a12838f45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:44.452665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20741867-7a9f-483f-8591-eb4a12838f45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:44.453166 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20741867-7a9f-483f-8591-eb4a12838f45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:44.453590 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20741867-7a9f-483f-8591-eb4a12838f45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:44.454267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20741867-7a9f-483f-8591-eb4a12838f45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:44.454710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20741867-7a9f-483f-8591-eb4a12838f45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:44.455123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-20741867-7a9f-483f-8591-eb4a12838f45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:44.547937 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-20741867-7a9f-483f-8591-eb4a12838f45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:44.556605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-20741867-7a9f-483f-8591-eb4a12838f45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:44.558058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-20741867-7a9f-483f-8591-eb4a12838f45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:44.560228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-20741867-7a9f-483f-8591-eb4a12838f45 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.118411 Sep 01 05:36:44.560809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1078/2235] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:44 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:45.231267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1a7bc2d3-6d18-4093-a534-27b693666a7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:45.232074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1a7bc2d3-6d18-4093-a534-27b693666a7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:45.238827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a7bc2d3-6d18-4093-a534-27b693666a7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:45.239318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a7bc2d3-6d18-4093-a534-27b693666a7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:45.239758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a7bc2d3-6d18-4093-a534-27b693666a7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:45.240482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a7bc2d3-6d18-4093-a534-27b693666a7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:45.240964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a7bc2d3-6d18-4093-a534-27b693666a7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:45.241383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a7bc2d3-6d18-4093-a534-27b693666a7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:45.375793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1a7bc2d3-6d18-4093-a534-27b693666a7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:45.383879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1a7bc2d3-6d18-4093-a534-27b693666a7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156855 Sep 01 05:36:45.384461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1158/2236] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:45.583436 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b4926499-be6a-4727-b84f-7a7b831efd1a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:45.583979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b4926499-be6a-4727-b84f-7a7b831efd1a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:45.590319 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4926499-be6a-4727-b84f-7a7b831efd1a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:45.590765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4926499-be6a-4727-b84f-7a7b831efd1a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:45.591191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4926499-be6a-4727-b84f-7a7b831efd1a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:45.591854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4926499-be6a-4727-b84f-7a7b831efd1a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:45.592294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4926499-be6a-4727-b84f-7a7b831efd1a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:45.592706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4926499-be6a-4727-b84f-7a7b831efd1a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:45.653156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b4926499-be6a-4727-b84f-7a7b831efd1a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:45.661853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b4926499-be6a-4727-b84f-7a7b831efd1a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:45.663280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b4926499-be6a-4727-b84f-7a7b831efd1a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:45.664397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b4926499-be6a-4727-b84f-7a7b831efd1a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085172 Sep 01 05:36:45.664980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1079/2237] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:45 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:46.405114 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d80d33f6-3995-4ea9-9402-45a30ee25f98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:46.405755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d80d33f6-3995-4ea9-9402-45a30ee25f98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:46.412340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d80d33f6-3995-4ea9-9402-45a30ee25f98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:46.412838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d80d33f6-3995-4ea9-9402-45a30ee25f98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:46.413272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d80d33f6-3995-4ea9-9402-45a30ee25f98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:46.413941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d80d33f6-3995-4ea9-9402-45a30ee25f98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:46.414384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d80d33f6-3995-4ea9-9402-45a30ee25f98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:46.414797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d80d33f6-3995-4ea9-9402-45a30ee25f98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:46.541431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d80d33f6-3995-4ea9-9402-45a30ee25f98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:46.544085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:46.551114 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d80d33f6-3995-4ea9-9402-45a30ee25f98 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149878 Sep 01 05:36:46.551676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1159/2238] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:46 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:46.687748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fbc2ee4f-3184-498f-935e-57e057bda3ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:46.688256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fbc2ee4f-3184-498f-935e-57e057bda3ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:46.694676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fbc2ee4f-3184-498f-935e-57e057bda3ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:46.695158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fbc2ee4f-3184-498f-935e-57e057bda3ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:46.695585 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fbc2ee4f-3184-498f-935e-57e057bda3ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:46.696257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fbc2ee4f-3184-498f-935e-57e057bda3ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:46.696704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fbc2ee4f-3184-498f-935e-57e057bda3ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:46.697610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fbc2ee4f-3184-498f-935e-57e057bda3ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:46.762275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fbc2ee4f-3184-498f-935e-57e057bda3ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:46.770692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fbc2ee4f-3184-498f-935e-57e057bda3ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:46.772118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fbc2ee4f-3184-498f-935e-57e057bda3ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:46.773275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fbc2ee4f-3184-498f-935e-57e057bda3ed tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090184 Sep 01 05:36:46.773818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1080/2239] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:46 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:47.573360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-38e9742d-987c-4088-b7d0-c4ca6b622deb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:47.573981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-38e9742d-987c-4088-b7d0-c4ca6b622deb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:47.580490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38e9742d-987c-4088-b7d0-c4ca6b622deb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:47.581006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38e9742d-987c-4088-b7d0-c4ca6b622deb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:47.581445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38e9742d-987c-4088-b7d0-c4ca6b622deb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:47.582131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38e9742d-987c-4088-b7d0-c4ca6b622deb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:47.582585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38e9742d-987c-4088-b7d0-c4ca6b622deb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:47.583011 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-38e9742d-987c-4088-b7d0-c4ca6b622deb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:47.715875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-38e9742d-987c-4088-b7d0-c4ca6b622deb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:47.723968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-38e9742d-987c-4088-b7d0-c4ca6b622deb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154695 Sep 01 05:36:47.724543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1160/2240] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:47.796226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-15055fce-69d9-4f68-ab89-d1e16db015fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:47.796866 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-15055fce-69d9-4f68-ab89-d1e16db015fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:47.803323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15055fce-69d9-4f68-ab89-d1e16db015fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:47.803800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15055fce-69d9-4f68-ab89-d1e16db015fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:47.804239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15055fce-69d9-4f68-ab89-d1e16db015fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:47.804952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15055fce-69d9-4f68-ab89-d1e16db015fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:47.805402 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15055fce-69d9-4f68-ab89-d1e16db015fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:47.805818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15055fce-69d9-4f68-ab89-d1e16db015fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:47.866419 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-15055fce-69d9-4f68-ab89-d1e16db015fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:47.875015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-15055fce-69d9-4f68-ab89-d1e16db015fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:47.876448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-15055fce-69d9-4f68-ab89-d1e16db015fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:47.877610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-15055fce-69d9-4f68-ab89-d1e16db015fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086604 Sep 01 05:36:47.878163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1081/2241] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:47 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:48.745513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-367b3bb7-3b2c-4915-847a-72d531a14f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:48.746749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-367b3bb7-3b2c-4915-847a-72d531a14f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:48.753099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-367b3bb7-3b2c-4915-847a-72d531a14f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.753576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-367b3bb7-3b2c-4915-847a-72d531a14f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.754005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-367b3bb7-3b2c-4915-847a-72d531a14f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.754674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-367b3bb7-3b2c-4915-847a-72d531a14f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.755119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-367b3bb7-3b2c-4915-847a-72d531a14f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.755537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-367b3bb7-3b2c-4915-847a-72d531a14f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.884517 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-367b3bb7-3b2c-4915-847a-72d531a14f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:48.892651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-367b3bb7-3b2c-4915-847a-72d531a14f6f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150904 Sep 01 05:36:48.893550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1161/2242] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:48 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:48.899346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cd30ee3f-5819-44a1-8189-01c6ed9de71c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:48.899955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cd30ee3f-5819-44a1-8189-01c6ed9de71c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:48.906396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd30ee3f-5819-44a1-8189-01c6ed9de71c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.906874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd30ee3f-5819-44a1-8189-01c6ed9de71c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.907302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd30ee3f-5819-44a1-8189-01c6ed9de71c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.907981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd30ee3f-5819-44a1-8189-01c6ed9de71c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.908428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd30ee3f-5819-44a1-8189-01c6ed9de71c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.908878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cd30ee3f-5819-44a1-8189-01c6ed9de71c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.924893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:48.974433 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cd30ee3f-5819-44a1-8189-01c6ed9de71c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:48.983918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cd30ee3f-5819-44a1-8189-01c6ed9de71c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:48.985407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cd30ee3f-5819-44a1-8189-01c6ed9de71c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:48.986546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cd30ee3f-5819-44a1-8189-01c6ed9de71c tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091059 Sep 01 05:36:48.987107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1082/2243] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:48 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:49.914436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d5164083-1d47-40a5-90c6-13085a00ca68 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:49.915052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d5164083-1d47-40a5-90c6-13085a00ca68 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:49.921870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5164083-1d47-40a5-90c6-13085a00ca68 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:49.922352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5164083-1d47-40a5-90c6-13085a00ca68 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:49.922782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5164083-1d47-40a5-90c6-13085a00ca68 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:49.923485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5164083-1d47-40a5-90c6-13085a00ca68 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:49.923930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5164083-1d47-40a5-90c6-13085a00ca68 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:49.924345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5164083-1d47-40a5-90c6-13085a00ca68 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:50.010490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7aabd836-515c-4ed0-86fc-d1512b2eeee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:50.011285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7aabd836-515c-4ed0-86fc-d1512b2eeee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:50.018489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7aabd836-515c-4ed0-86fc-d1512b2eeee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:50.019064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7aabd836-515c-4ed0-86fc-d1512b2eeee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:50.019577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7aabd836-515c-4ed0-86fc-d1512b2eeee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:50.020316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7aabd836-515c-4ed0-86fc-d1512b2eeee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:50.020871 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7aabd836-515c-4ed0-86fc-d1512b2eeee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:50.021324 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7aabd836-515c-4ed0-86fc-d1512b2eeee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:50.060712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d5164083-1d47-40a5-90c6-13085a00ca68 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:50.069267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d5164083-1d47-40a5-90c6-13085a00ca68 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.158863 Sep 01 05:36:50.069853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1162/2244] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:49 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:50.083567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7aabd836-515c-4ed0-86fc-d1512b2eeee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:50.092630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7aabd836-515c-4ed0-86fc-d1512b2eeee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:50.094074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7aabd836-515c-4ed0-86fc-d1512b2eeee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:50.095195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7aabd836-515c-4ed0-86fc-d1512b2eeee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089131 Sep 01 05:36:50.095739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1083/2245] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:50 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:36:51.092044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9b8a85b4-cb3c-47e3-9253-756dc4395ae5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:51.092646 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9b8a85b4-cb3c-47e3-9253-756dc4395ae5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:51.099117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b8a85b4-cb3c-47e3-9253-756dc4395ae5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:51.099589 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b8a85b4-cb3c-47e3-9253-756dc4395ae5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:51.100019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b8a85b4-cb3c-47e3-9253-756dc4395ae5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:51.100691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b8a85b4-cb3c-47e3-9253-756dc4395ae5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:51.101166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b8a85b4-cb3c-47e3-9253-756dc4395ae5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:51.101583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b8a85b4-cb3c-47e3-9253-756dc4395ae5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:51.118115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-25f546d6-6b90-4be0-b7c5-5bccd29a0f26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:51.118728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-25f546d6-6b90-4be0-b7c5-5bccd29a0f26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:51.125137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-25f546d6-6b90-4be0-b7c5-5bccd29a0f26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:51.125620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-25f546d6-6b90-4be0-b7c5-5bccd29a0f26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:51.126049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-25f546d6-6b90-4be0-b7c5-5bccd29a0f26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:51.126731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-25f546d6-6b90-4be0-b7c5-5bccd29a0f26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:51.127177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-25f546d6-6b90-4be0-b7c5-5bccd29a0f26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:51.127594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-25f546d6-6b90-4be0-b7c5-5bccd29a0f26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:51.196990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-25f546d6-6b90-4be0-b7c5-5bccd29a0f26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:51.206557 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-25f546d6-6b90-4be0-b7c5-5bccd29a0f26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:51.207990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-25f546d6-6b90-4be0-b7c5-5bccd29a0f26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:51.209170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-25f546d6-6b90-4be0-b7c5-5bccd29a0f26 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.094834 Sep 01 05:36:51.209719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1084/2246] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:51 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:36:51.237596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9b8a85b4-cb3c-47e3-9253-756dc4395ae5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:51.246802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9b8a85b4-cb3c-47e3-9253-756dc4395ae5 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.158734 Sep 01 05:36:51.247383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1163/2247] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:51 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:52.231744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-67ed97f3-531b-484c-b700-9e71820d6dd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:52.232291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-67ed97f3-531b-484c-b700-9e71820d6dd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:52.234533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=56 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:52.239974 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67ed97f3-531b-484c-b700-9e71820d6dd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:52.240492 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67ed97f3-531b-484c-b700-9e71820d6dd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:52.240928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67ed97f3-531b-484c-b700-9e71820d6dd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:52.241639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67ed97f3-531b-484c-b700-9e71820d6dd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:52.242079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67ed97f3-531b-484c-b700-9e71820d6dd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:52.242496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67ed97f3-531b-484c-b700-9e71820d6dd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:52.268169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0d14aa0e-35dc-4a8b-a90e-c00f037352fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:52.268934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0d14aa0e-35dc-4a8b-a90e-c00f037352fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:52.271286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=52 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:52.276463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d14aa0e-35dc-4a8b-a90e-c00f037352fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:52.276978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d14aa0e-35dc-4a8b-a90e-c00f037352fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:52.277508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d14aa0e-35dc-4a8b-a90e-c00f037352fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:52.278203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d14aa0e-35dc-4a8b-a90e-c00f037352fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:52.278663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d14aa0e-35dc-4a8b-a90e-c00f037352fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:52.279090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d14aa0e-35dc-4a8b-a90e-c00f037352fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:52.305398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-67ed97f3-531b-484c-b700-9e71820d6dd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:52.314477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-67ed97f3-531b-484c-b700-9e71820d6dd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:52.315906 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-67ed97f3-531b-484c-b700-9e71820d6dd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:52.317069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-67ed97f3-531b-484c-b700-9e71820d6dd2 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.089438 Sep 01 05:36:52.317619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1085/2248] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:52 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:52.414012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0d14aa0e-35dc-4a8b-a90e-c00f037352fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:52.422254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0d14aa0e-35dc-4a8b-a90e-c00f037352fd tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157961 Sep 01 05:36:52.422812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1164/2249] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:52 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:53.340505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-10b8406c-bbc9-4c78-9ad4-4f4ad78bbe1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:53.341090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-10b8406c-bbc9-4c78-9ad4-4f4ad78bbe1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:53.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-10b8406c-bbc9-4c78-9ad4-4f4ad78bbe1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:53.347919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-10b8406c-bbc9-4c78-9ad4-4f4ad78bbe1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:53.348354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-10b8406c-bbc9-4c78-9ad4-4f4ad78bbe1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:53.349067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-10b8406c-bbc9-4c78-9ad4-4f4ad78bbe1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:53.349520 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-10b8406c-bbc9-4c78-9ad4-4f4ad78bbe1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:53.349943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-10b8406c-bbc9-4c78-9ad4-4f4ad78bbe1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:53.412569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-10b8406c-bbc9-4c78-9ad4-4f4ad78bbe1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:53.421940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-10b8406c-bbc9-4c78-9ad4-4f4ad78bbe1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:53.423378 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-10b8406c-bbc9-4c78-9ad4-4f4ad78bbe1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:53.424508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-10b8406c-bbc9-4c78-9ad4-4f4ad78bbe1f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088064 Sep 01 05:36:53.425096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1086/2250] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:53 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:53.443314 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c65eca12-cf8e-413e-80a8-fc5cc0eaeb6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:53.443924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c65eca12-cf8e-413e-80a8-fc5cc0eaeb6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:53.450854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c65eca12-cf8e-413e-80a8-fc5cc0eaeb6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:53.451326 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c65eca12-cf8e-413e-80a8-fc5cc0eaeb6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:53.451752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c65eca12-cf8e-413e-80a8-fc5cc0eaeb6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:53.452422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c65eca12-cf8e-413e-80a8-fc5cc0eaeb6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:53.452898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c65eca12-cf8e-413e-80a8-fc5cc0eaeb6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:53.453315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c65eca12-cf8e-413e-80a8-fc5cc0eaeb6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:53.584074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c65eca12-cf8e-413e-80a8-fc5cc0eaeb6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:53.593214 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c65eca12-cf8e-413e-80a8-fc5cc0eaeb6b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153609 Sep 01 05:36:53.593722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1165/2251] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:53 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:54.447496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ba3f99bb-fd88-4b52-a3e9-505a4607f895 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:54.448106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ba3f99bb-fd88-4b52-a3e9-505a4607f895 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:54.454696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ba3f99bb-fd88-4b52-a3e9-505a4607f895 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:54.455170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ba3f99bb-fd88-4b52-a3e9-505a4607f895 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:54.455602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ba3f99bb-fd88-4b52-a3e9-505a4607f895 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:54.456346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ba3f99bb-fd88-4b52-a3e9-505a4607f895 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:54.456827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ba3f99bb-fd88-4b52-a3e9-505a4607f895 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:54.457252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ba3f99bb-fd88-4b52-a3e9-505a4607f895 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:54.517336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ba3f99bb-fd88-4b52-a3e9-505a4607f895 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:54.525821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ba3f99bb-fd88-4b52-a3e9-505a4607f895 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:54.527774 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ba3f99bb-fd88-4b52-a3e9-505a4607f895 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:54.528946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ba3f99bb-fd88-4b52-a3e9-505a4607f895 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.085304 Sep 01 05:36:54.529511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1087/2252] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:54 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:54.614420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7d0ce387-da2c-4574-a2da-86c900c45025 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:54.615061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7d0ce387-da2c-4574-a2da-86c900c45025 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:54.621747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d0ce387-da2c-4574-a2da-86c900c45025 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:54.622223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d0ce387-da2c-4574-a2da-86c900c45025 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:54.622653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d0ce387-da2c-4574-a2da-86c900c45025 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:54.623330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d0ce387-da2c-4574-a2da-86c900c45025 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:54.623779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d0ce387-da2c-4574-a2da-86c900c45025 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:54.624207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7d0ce387-da2c-4574-a2da-86c900c45025 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:54.749754 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7d0ce387-da2c-4574-a2da-86c900c45025 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:54.757830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7d0ce387-da2c-4574-a2da-86c900c45025 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.147304 Sep 01 05:36:54.758395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1166/2253] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:54 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:55.551577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7b2c7b4b-7ecd-4b6d-86fd-514adb698b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:55.552193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7b2c7b4b-7ecd-4b6d-86fd-514adb698b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:55.559943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b4b-7ecd-4b6d-86fd-514adb698b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.560427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b4b-7ecd-4b6d-86fd-514adb698b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.560890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b4b-7ecd-4b6d-86fd-514adb698b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.561583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b4b-7ecd-4b6d-86fd-514adb698b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.562033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b4b-7ecd-4b6d-86fd-514adb698b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.562457 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b4b-7ecd-4b6d-86fd-514adb698b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.626892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7b2c7b4b-7ecd-4b6d-86fd-514adb698b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:55.635379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7b2c7b4b-7ecd-4b6d-86fd-514adb698b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:55.636819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7b2c7b4b-7ecd-4b6d-86fd-514adb698b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:55.637943 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7b2c7b4b-7ecd-4b6d-86fd-514adb698b1e tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.090323 Sep 01 05:36:55.638493 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1088/2254] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:55 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:55.780599 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e17bfc2b-0087-451f-9da2-dccd2386718c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:55.781236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e17bfc2b-0087-451f-9da2-dccd2386718c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:55.787906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e17bfc2b-0087-451f-9da2-dccd2386718c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.788389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e17bfc2b-0087-451f-9da2-dccd2386718c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.788853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e17bfc2b-0087-451f-9da2-dccd2386718c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.789531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e17bfc2b-0087-451f-9da2-dccd2386718c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.789985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e17bfc2b-0087-451f-9da2-dccd2386718c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.790405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e17bfc2b-0087-451f-9da2-dccd2386718c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.923882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e17bfc2b-0087-451f-9da2-dccd2386718c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:55.931961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e17bfc2b-0087-451f-9da2-dccd2386718c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156227 Sep 01 05:36:55.932530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1167/2255] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:55 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:56.660220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-36066c84-d7e6-49aa-9440-34054bda7d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:56.661120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-36066c84-d7e6-49aa-9440-34054bda7d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:56.668709 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-36066c84-d7e6-49aa-9440-34054bda7d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:56.669218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-36066c84-d7e6-49aa-9440-34054bda7d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:56.669655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-36066c84-d7e6-49aa-9440-34054bda7d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:56.670335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-36066c84-d7e6-49aa-9440-34054bda7d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:56.670783 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-36066c84-d7e6-49aa-9440-34054bda7d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:56.671199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-36066c84-d7e6-49aa-9440-34054bda7d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:56.735798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-36066c84-d7e6-49aa-9440-34054bda7d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:56.744582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-36066c84-d7e6-49aa-9440-34054bda7d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:56.746699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-36066c84-d7e6-49aa-9440-34054bda7d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:56.747848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-36066c84-d7e6-49aa-9440-34054bda7d3b tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091580 Sep 01 05:36:56.748410 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1089/2256] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:56 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:56.953741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5c0408bf-7b5e-4570-badd-d7057116bab8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:56.954280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5c0408bf-7b5e-4570-badd-d7057116bab8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:56.960578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c0408bf-7b5e-4570-badd-d7057116bab8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:56.961080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c0408bf-7b5e-4570-badd-d7057116bab8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:56.961510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c0408bf-7b5e-4570-badd-d7057116bab8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:56.962190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c0408bf-7b5e-4570-badd-d7057116bab8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:56.962629 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c0408bf-7b5e-4570-badd-d7057116bab8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:56.963042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c0408bf-7b5e-4570-badd-d7057116bab8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:57.092462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5c0408bf-7b5e-4570-badd-d7057116bab8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:57.100742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5c0408bf-7b5e-4570-badd-d7057116bab8 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150897 Sep 01 05:36:57.101326 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1168/2257] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:56 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:57.771211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ed1bad0a-1b75-4c4c-bf58-a49cfd36234d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:57.771821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ed1bad0a-1b75-4c4c-bf58-a49cfd36234d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:57.779208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed1bad0a-1b75-4c4c-bf58-a49cfd36234d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:57.779686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed1bad0a-1b75-4c4c-bf58-a49cfd36234d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:57.780118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed1bad0a-1b75-4c4c-bf58-a49cfd36234d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:57.780810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed1bad0a-1b75-4c4c-bf58-a49cfd36234d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:57.781260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed1bad0a-1b75-4c4c-bf58-a49cfd36234d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:57.781676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed1bad0a-1b75-4c4c-bf58-a49cfd36234d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:57.844864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ed1bad0a-1b75-4c4c-bf58-a49cfd36234d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:57.853432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ed1bad0a-1b75-4c4c-bf58-a49cfd36234d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:57.854880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ed1bad0a-1b75-4c4c-bf58-a49cfd36234d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:57.856040 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ed1bad0a-1b75-4c4c-bf58-a49cfd36234d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.088697 Sep 01 05:36:57.856588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1090/2258] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:57 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:58.123392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fc7efcd5-52f0-4b40-97eb-7291e79c58ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:58.123958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fc7efcd5-52f0-4b40-97eb-7291e79c58ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:58.130347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc7efcd5-52f0-4b40-97eb-7291e79c58ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:58.130819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc7efcd5-52f0-4b40-97eb-7291e79c58ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:58.131265 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc7efcd5-52f0-4b40-97eb-7291e79c58ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:58.131917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc7efcd5-52f0-4b40-97eb-7291e79c58ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:58.132360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc7efcd5-52f0-4b40-97eb-7291e79c58ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:58.132794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc7efcd5-52f0-4b40-97eb-7291e79c58ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:58.264070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fc7efcd5-52f0-4b40-97eb-7291e79c58ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:58.272112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fc7efcd5-52f0-4b40-97eb-7291e79c58ba tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153154 Sep 01 05:36:58.272676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1169/2259] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:58 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:58.878345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cde53f44-bb7c-433c-a093-3a73481157dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:58.878939 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cde53f44-bb7c-433c-a093-3a73481157dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:58.885391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cde53f44-bb7c-433c-a093-3a73481157dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:58.885869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cde53f44-bb7c-433c-a093-3a73481157dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:58.886952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cde53f44-bb7c-433c-a093-3a73481157dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:58.887630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cde53f44-bb7c-433c-a093-3a73481157dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:58.888079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cde53f44-bb7c-433c-a093-3a73481157dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:58.888502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cde53f44-bb7c-433c-a093-3a73481157dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:58.949352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cde53f44-bb7c-433c-a093-3a73481157dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:58.957872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cde53f44-bb7c-433c-a093-3a73481157dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:58.959311 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cde53f44-bb7c-433c-a093-3a73481157dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:58.960452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cde53f44-bb7c-433c-a093-3a73481157dc tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.086016 Sep 01 05:36:58.961073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1091/2260] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:58 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:59.294848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7e3cc2c5-3cb1-479d-9693-941c061cf4bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:59.295397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7e3cc2c5-3cb1-479d-9693-941c061cf4bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:59.301733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e3cc2c5-3cb1-479d-9693-941c061cf4bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:59.302211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e3cc2c5-3cb1-479d-9693-941c061cf4bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:59.302642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e3cc2c5-3cb1-479d-9693-941c061cf4bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:59.303318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e3cc2c5-3cb1-479d-9693-941c061cf4bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:59.303764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e3cc2c5-3cb1-479d-9693-941c061cf4bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:59.304182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7e3cc2c5-3cb1-479d-9693-941c061cf4bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:59.430369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7e3cc2c5-3cb1-479d-9693-941c061cf4bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:59.439271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7e3cc2c5-3cb1-479d-9693-941c061cf4bf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149221 Sep 01 05:36:59.439844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1170/2261] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:59 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:59.982808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bbe66a51-8859-4a0b-9eff-10adba8374d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:59.983412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bbe66a51-8859-4a0b-9eff-10adba8374d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:59.989794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbe66a51-8859-4a0b-9eff-10adba8374d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:59.990270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbe66a51-8859-4a0b-9eff-10adba8374d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:59.990699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbe66a51-8859-4a0b-9eff-10adba8374d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:59.991372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbe66a51-8859-4a0b-9eff-10adba8374d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:59.991810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbe66a51-8859-4a0b-9eff-10adba8374d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:59.992227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bbe66a51-8859-4a0b-9eff-10adba8374d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:00.057806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bbe66a51-8859-4a0b-9eff-10adba8374d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:00.067130 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bbe66a51-8859-4a0b-9eff-10adba8374d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:00.068554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bbe66a51-8859-4a0b-9eff-10adba8374d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:00.069710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bbe66a51-8859-4a0b-9eff-10adba8374d0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.091045 Sep 01 05:37:00.070263 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1092/2262] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:59 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:37:00.461266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a6b20994-496b-4b2b-b3e4-be853acb5954 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:00.461875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a6b20994-496b-4b2b-b3e4-be853acb5954 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:00.468800 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6b20994-496b-4b2b-b3e4-be853acb5954 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:00.469276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6b20994-496b-4b2b-b3e4-be853acb5954 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:00.469706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6b20994-496b-4b2b-b3e4-be853acb5954 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:00.470372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6b20994-496b-4b2b-b3e4-be853acb5954 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:00.470812 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6b20994-496b-4b2b-b3e4-be853acb5954 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:00.471223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a6b20994-496b-4b2b-b3e4-be853acb5954 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:00.597299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a6b20994-496b-4b2b-b3e4-be853acb5954 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:00.607271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a6b20994-496b-4b2b-b3e4-be853acb5954 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149765 Sep 01 05:37:00.608002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1171/2263] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:00 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:01.092835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3716f1cf-3f11-4c8f-982c-79ff184df811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:01.093502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3716f1cf-3f11-4c8f-982c-79ff184df811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:01.099808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3716f1cf-3f11-4c8f-982c-79ff184df811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:01.100292 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3716f1cf-3f11-4c8f-982c-79ff184df811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:01.100723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3716f1cf-3f11-4c8f-982c-79ff184df811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:01.101421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3716f1cf-3f11-4c8f-982c-79ff184df811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:01.101869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3716f1cf-3f11-4c8f-982c-79ff184df811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:01.102288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3716f1cf-3f11-4c8f-982c-79ff184df811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:01.164374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3716f1cf-3f11-4c8f-982c-79ff184df811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:01.173062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3716f1cf-3f11-4c8f-982c-79ff184df811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:01.174497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3716f1cf-3f11-4c8f-982c-79ff184df811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:01.175626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3716f1cf-3f11-4c8f-982c-79ff184df811 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 200 len: 1443 microversion: 2.20 time: 0.087423 Sep 01 05:37:01.176178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1093/2264] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:37:01 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:37:01.199719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-869a0cc9-fea8-4b09-bb7b-d55b0f2353fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '.version_select at 0x7f9624bf5940>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:01.222113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-869a0cc9-fea8-4b09-bb7b-d55b0f2353fb tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-511127826" status: 204 len: 0 microversion: 2.20 time: 0.026870 Sep 01 05:37:01.222881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1172/2265] 10.222.0.49 () {60 vars in 1259 bytes} [Thu Sep 1 05:37:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-511127826 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:37:01.628421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b4437ee1-46ae-474e-a4dc-22738f1fe797 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:01.629062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b4437ee1-46ae-474e-a4dc-22738f1fe797 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:01.634867 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4437ee1-46ae-474e-a4dc-22738f1fe797 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:01.635345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4437ee1-46ae-474e-a4dc-22738f1fe797 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:01.635772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4437ee1-46ae-474e-a4dc-22738f1fe797 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:01.637135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4437ee1-46ae-474e-a4dc-22738f1fe797 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:01.637586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4437ee1-46ae-474e-a4dc-22738f1fe797 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:01.638301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b4437ee1-46ae-474e-a4dc-22738f1fe797 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:01.855308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b4437ee1-46ae-474e-a4dc-22738f1fe797 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:01.863554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b4437ee1-46ae-474e-a4dc-22738f1fe797 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.238915 Sep 01 05:37:01.864125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1094/2266] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:01 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:02.053078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-526943a7-b83e-4e23-be7c-5f301524d78f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Action: 'create', calling method: .version_select at 0x7f962841e430>, body: {"keypair": {"name": "tempest-keypair-943622288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx/Odjs9wsnVZtCrglcUscISSZzX95q7cCcU1zPFBhV0Vt1+YD4LWJJpbKaIWj+eLjYBsmDXsK/OKvUE5qe6GrkO7fnURdApqaE/UOZQOuB7AHkbx/+Se8WWdCFIpkzmA=="}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:02.069635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-526943a7-b83e-4e23-be7c-5f301524d78f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Getting quotas for project 3a33ba1fe1ff4325b80a02053b1db739. Resources: {'key_pairs'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:37:02.073510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-526943a7-b83e-4e23-be7c-5f301524d78f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Getting quotas for user d0b6981c4d53405fbe0395ccbcb9f015 and project 3a33ba1fe1ff4325b80a02053b1db739. Resources: {'key_pairs'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:37:02.095216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-526943a7-b83e-4e23-be7c-5f301524d78f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046992 Sep 01 05:37:02.095814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1173/2267] 10.222.0.49 () {62 vars in 1200 bytes} [Thu Sep 1 05:37:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 05:37:02.885674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5812c78e-56e2-4d4b-be89-2106a2501ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:02.886858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5812c78e-56e2-4d4b-be89-2106a2501ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:02.893796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5812c78e-56e2-4d4b-be89-2106a2501ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:02.894355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5812c78e-56e2-4d4b-be89-2106a2501ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:02.894799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5812c78e-56e2-4d4b-be89-2106a2501ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:02.895584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5812c78e-56e2-4d4b-be89-2106a2501ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:02.896007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5812c78e-56e2-4d4b-be89-2106a2501ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:02.897417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5812c78e-56e2-4d4b-be89-2106a2501ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:03.030306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5812c78e-56e2-4d4b-be89-2106a2501ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:03.038882 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5812c78e-56e2-4d4b-be89-2106a2501ec0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157354 Sep 01 05:37:03.039455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1095/2268] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:02 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:03.327981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1529249095", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24d1646c-1d66-4fb4-a02e-ad0f17f6eef3"}], "security_groups": [{"name": "tempest-securitygroup--420120808"}], "key_name": "tempest-keypair-943622288", "user_data": "}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:03.438160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.network.neutron [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] validate_networks() for [('24d1646c-1d66-4fb4-a02e-ad0f17f6eef3', None, None, None, None, None)] {{(pid=120673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:37:03.793287 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-43bc5fed-aa70-4385-aab3-893357ece1be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:03.793917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-43bc5fed-aa70-4385-aab3-893357ece1be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:03.801781 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43bc5fed-aa70-4385-aab3-893357ece1be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:03.802281 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43bc5fed-aa70-4385-aab3-893357ece1be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:03.802720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43bc5fed-aa70-4385-aab3-893357ece1be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:03.803640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43bc5fed-aa70-4385-aab3-893357ece1be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:03.804151 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43bc5fed-aa70-4385-aab3-893357ece1be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:03.804945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-43bc5fed-aa70-4385-aab3-893357ece1be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:03.831315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-43bc5fed-aa70-4385-aab3-893357ece1be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Going to try to terminate instance {{(pid=120674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:37:03.888492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Flavor limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:37:03.889151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Image limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:37:03.894449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Flavor pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:37:03.895110 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Image pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:37:03.895680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:37:03.905995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:03.906750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:03.907406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:03.908290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:03.908940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:03.909511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:03.933834 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Getting quotas for project 3a33ba1fe1ff4325b80a02053b1db739. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:37:03.935635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-43bc5fed-aa70-4385-aab3-893357ece1be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 204 len: 0 microversion: 2.1 time: 0.146444 Sep 01 05:37:03.936621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1096/2269] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:37:03 2022] DELETE /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:37:03.938340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Getting quotas for user d0b6981c4d53405fbe0395ccbcb9f015 and project 3a33ba1fe1ff4325b80a02053b1db739. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:37:03.945804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-70c6677e-cf38-46d6-a6fa-088cda0b2c9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:03.946778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-70c6677e-cf38-46d6-a6fa-088cda0b2c9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:03.951098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Going to run 1 instances... {{(pid=120673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:37:03.953458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:37:03.954622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70c6677e-cf38-46d6-a6fa-088cda0b2c9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:03.955123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70c6677e-cf38-46d6-a6fa-088cda0b2c9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:03.955561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70c6677e-cf38-46d6-a6fa-088cda0b2c9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:03.956257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70c6677e-cf38-46d6-a6fa-088cda0b2c9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:03.956702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70c6677e-cf38-46d6-a6fa-088cda0b2c9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:03.957149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70c6677e-cf38-46d6-a6fa-088cda0b2c9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:03.976406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:04.005117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e6c8e072-1aa3-4107-83d8-96ece099cf0a tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.682002 Sep 01 05:37:04.006130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1174/2270] 10.222.0.49 () {62 vars in 1188 bytes} [Thu Sep 1 05:37:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 05:37:04.018308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cb6a2094-5458-460e-a24f-ed8e4679133d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:04.019026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cb6a2094-5458-460e-a24f-ed8e4679133d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:04.077070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cb6a2094-5458-460e-a24f-ed8e4679133d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:04.085030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cb6a2094-5458-460e-a24f-ed8e4679133d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:04.086702 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cb6a2094-5458-460e-a24f-ed8e4679133d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:04.088685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cb6a2094-5458-460e-a24f-ed8e4679133d tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 200 len: 1281 microversion: 2.20 time: 0.074194 Sep 01 05:37:04.090140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1175/2271] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:37:04 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:37:04.094414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2f3117bd-2bc0-4140-b69f-67f12cb26ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:04.095018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2f3117bd-2bc0-4140-b69f-67f12cb26ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:04.101360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f3117bd-2bc0-4140-b69f-67f12cb26ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:04.101922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f3117bd-2bc0-4140-b69f-67f12cb26ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:04.102554 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f3117bd-2bc0-4140-b69f-67f12cb26ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:04.103420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f3117bd-2bc0-4140-b69f-67f12cb26ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:04.104026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f3117bd-2bc0-4140-b69f-67f12cb26ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:04.104613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f3117bd-2bc0-4140-b69f-67f12cb26ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:04.265878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2f3117bd-2bc0-4140-b69f-67f12cb26ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:04.274407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2f3117bd-2bc0-4140-b69f-67f12cb26ef0 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.183462 Sep 01 05:37:04.275002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1176/2272] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:04 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:04.351909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-70c6677e-cf38-46d6-a6fa-088cda0b2c9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:04.362090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8417b1e3-07dc-4d6b-94c2-25b43af16bca tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] Calling method '.version_select at 0x7f9624b70ee0>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:04.368261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-70c6677e-cf38-46d6-a6fa-088cda0b2c9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.427346 Sep 01 05:37:04.369116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1097/2273] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:03 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:04.404434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8417b1e3-07dc-4d6b-94c2-25b43af16bca tempest-TestVolumeBootPattern-1989447752 tempest-TestVolumeBootPattern-1989447752-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1597487025" status: 202 len: 0 microversion: 2.1 time: 0.045984 Sep 01 05:37:04.405044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1177/2274] 10.222.0.49 () {58 vars in 1263 bytes} [Thu Sep 1 05:37:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1597487025 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:37:05.111910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3a0f8821-1e12-4974-b29f-0711fc569ed4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:05.112535 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3a0f8821-1e12-4974-b29f-0711fc569ed4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:05.119434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a0f8821-1e12-4974-b29f-0711fc569ed4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:05.119955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a0f8821-1e12-4974-b29f-0711fc569ed4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:05.120694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a0f8821-1e12-4974-b29f-0711fc569ed4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:05.121440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a0f8821-1e12-4974-b29f-0711fc569ed4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:05.121883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a0f8821-1e12-4974-b29f-0711fc569ed4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:05.122300 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3a0f8821-1e12-4974-b29f-0711fc569ed4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:05.191972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3a0f8821-1e12-4974-b29f-0711fc569ed4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:05.200734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3a0f8821-1e12-4974-b29f-0711fc569ed4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:05.202484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3a0f8821-1e12-4974-b29f-0711fc569ed4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:05.203875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3a0f8821-1e12-4974-b29f-0711fc569ed4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 200 len: 1333 microversion: 2.20 time: 0.095913 Sep 01 05:37:05.204865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1098/2275] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:37:05 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:37:05.298813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-731189d6-a696-4250-a85d-82bccb6bea44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:05.299441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-731189d6-a696-4250-a85d-82bccb6bea44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:05.306785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-731189d6-a696-4250-a85d-82bccb6bea44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:05.307458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-731189d6-a696-4250-a85d-82bccb6bea44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:05.308222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-731189d6-a696-4250-a85d-82bccb6bea44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:05.308963 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-731189d6-a696-4250-a85d-82bccb6bea44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:05.309638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-731189d6-a696-4250-a85d-82bccb6bea44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:05.310296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-731189d6-a696-4250-a85d-82bccb6bea44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:05.390549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1b22c82b-e5ac-40c4-a5c9-f302d548b229 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:05.391534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1b22c82b-e5ac-40c4-a5c9-f302d548b229 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:05.398690 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b22c82b-e5ac-40c4-a5c9-f302d548b229 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:05.399395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b22c82b-e5ac-40c4-a5c9-f302d548b229 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:05.400048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b22c82b-e5ac-40c4-a5c9-f302d548b229 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:05.400988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b22c82b-e5ac-40c4-a5c9-f302d548b229 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:05.402318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b22c82b-e5ac-40c4-a5c9-f302d548b229 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:05.403382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b22c82b-e5ac-40c4-a5c9-f302d548b229 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:05.509642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-731189d6-a696-4250-a85d-82bccb6bea44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:05.519102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-731189d6-a696-4250-a85d-82bccb6bea44 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.225824 Sep 01 05:37:05.520039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1178/2276] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:05 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:05.598947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1b22c82b-e5ac-40c4-a5c9-f302d548b229 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:05.610563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1b22c82b-e5ac-40c4-a5c9-f302d548b229 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.224320 Sep 01 05:37:05.611214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1099/2277] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:05 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:06.228984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-72cb664b-29cd-43eb-b273-3360fd9c57f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:06.230135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-72cb664b-29cd-43eb-b273-3360fd9c57f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:06.236490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72cb664b-29cd-43eb-b273-3360fd9c57f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:06.237005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72cb664b-29cd-43eb-b273-3360fd9c57f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:06.237440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72cb664b-29cd-43eb-b273-3360fd9c57f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:06.238337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72cb664b-29cd-43eb-b273-3360fd9c57f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:06.238795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72cb664b-29cd-43eb-b273-3360fd9c57f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:06.239219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72cb664b-29cd-43eb-b273-3360fd9c57f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:06.467416 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72cb664b-29cd-43eb-b273-3360fd9c57f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:06.476304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72cb664b-29cd-43eb-b273-3360fd9c57f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:06.477795 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72cb664b-29cd-43eb-b273-3360fd9c57f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:06.478989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-72cb664b-29cd-43eb-b273-3360fd9c57f8 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 200 len: 1406 microversion: 2.20 time: 0.253980 Sep 01 05:37:06.479665 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1179/2278] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:37:06 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:37:06.543560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fab453d4-40ef-493d-83ad-483fb9fe8956 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:06.544877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fab453d4-40ef-493d-83ad-483fb9fe8956 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:06.551619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fab453d4-40ef-493d-83ad-483fb9fe8956 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:06.552107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fab453d4-40ef-493d-83ad-483fb9fe8956 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:06.552547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fab453d4-40ef-493d-83ad-483fb9fe8956 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:06.553270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fab453d4-40ef-493d-83ad-483fb9fe8956 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:06.553724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fab453d4-40ef-493d-83ad-483fb9fe8956 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:06.554150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fab453d4-40ef-493d-83ad-483fb9fe8956 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:06.632092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5db91c99-43a7-477c-96ba-9e888250d82f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:06.633381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5db91c99-43a7-477c-96ba-9e888250d82f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:06.639377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5db91c99-43a7-477c-96ba-9e888250d82f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:06.639868 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5db91c99-43a7-477c-96ba-9e888250d82f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:06.640520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5db91c99-43a7-477c-96ba-9e888250d82f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:06.641251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5db91c99-43a7-477c-96ba-9e888250d82f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:06.641881 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5db91c99-43a7-477c-96ba-9e888250d82f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:06.642307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5db91c99-43a7-477c-96ba-9e888250d82f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:06.798867 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5db91c99-43a7-477c-96ba-9e888250d82f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:06.807284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5db91c99-43a7-477c-96ba-9e888250d82f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.178947 Sep 01 05:37:06.807934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1180/2279] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:06 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:06.904257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fab453d4-40ef-493d-83ad-483fb9fe8956 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:06.913298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fab453d4-40ef-493d-83ad-483fb9fe8956 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.374480 Sep 01 05:37:06.927458 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1100/2280] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:06 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:07.217119 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-96c8415f-64cc-495a-b5e2-fcb594dd7c4e req-d952c76d-6c09-43f8-a9a2-7ecc1fc32fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63e3cab-2de7-4da7-a5ba-432a2b389fad", "tag": "22c143eb-58c0-47e9-946d-d7fcc7267075"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:07.226418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-96c8415f-64cc-495a-b5e2-fcb594dd7c4e req-d952c76d-6c09-43f8-a9a2-7ecc1fc32fbb service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:07.226894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-96c8415f-64cc-495a-b5e2-fcb594dd7c4e req-d952c76d-6c09-43f8-a9a2-7ecc1fc32fbb service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:07.227326 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-96c8415f-64cc-495a-b5e2-fcb594dd7c4e req-d952c76d-6c09-43f8-a9a2-7ecc1fc32fbb service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:07.231375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:07.240719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-96c8415f-64cc-495a-b5e2-fcb594dd7c4e req-d952c76d-6c09-43f8-a9a2-7ecc1fc32fbb service nova] Creating event network-changed:22c143eb-58c0-47e9-946d-d7fcc7267075 for instance c63e3cab-2de7-4da7-a5ba-432a2b389fad on hv-cinder-85391 Sep 01 05:37:07.248494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-96c8415f-64cc-495a-b5e2-fcb594dd7c4e req-d952c76d-6c09-43f8-a9a2-7ecc1fc32fbb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102692 Sep 01 05:37:07.248494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1181/2281] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:07.502299 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-67e6ffa2-ab54-4e16-9fd7-08273678b002 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:07.503032 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-67e6ffa2-ab54-4e16-9fd7-08273678b002 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:07.510137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67e6ffa2-ab54-4e16-9fd7-08273678b002 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:07.510626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67e6ffa2-ab54-4e16-9fd7-08273678b002 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:07.511964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67e6ffa2-ab54-4e16-9fd7-08273678b002 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:07.512752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67e6ffa2-ab54-4e16-9fd7-08273678b002 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:07.513239 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67e6ffa2-ab54-4e16-9fd7-08273678b002 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:07.513673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67e6ffa2-ab54-4e16-9fd7-08273678b002 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:07.829476 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-738b1df9-ca90-4f93-b73b-e8787b0a173f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:07.830178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-738b1df9-ca90-4f93-b73b-e8787b0a173f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:07.836708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-738b1df9-ca90-4f93-b73b-e8787b0a173f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:07.837254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-738b1df9-ca90-4f93-b73b-e8787b0a173f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:07.837697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-738b1df9-ca90-4f93-b73b-e8787b0a173f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:07.838390 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-738b1df9-ca90-4f93-b73b-e8787b0a173f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:07.838838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-738b1df9-ca90-4f93-b73b-e8787b0a173f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:07.840032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-738b1df9-ca90-4f93-b73b-e8787b0a173f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:07.896530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-67e6ffa2-ab54-4e16-9fd7-08273678b002 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:07.905335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-67e6ffa2-ab54-4e16-9fd7-08273678b002 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:07.906900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-67e6ffa2-ab54-4e16-9fd7-08273678b002 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:07.909147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-67e6ffa2-ab54-4e16-9fd7-08273678b002 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 200 len: 1406 microversion: 2.20 time: 0.409769 Sep 01 05:37:07.909147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1101/2282] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:37:07 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 1406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:37:07.935339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ef99453a-8a8f-4bea-acc7-a22cfd421a1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:07.935961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ef99453a-8a8f-4bea-acc7-a22cfd421a1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:07.942185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef99453a-8a8f-4bea-acc7-a22cfd421a1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:07.942675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef99453a-8a8f-4bea-acc7-a22cfd421a1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:07.943292 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef99453a-8a8f-4bea-acc7-a22cfd421a1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:07.944885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef99453a-8a8f-4bea-acc7-a22cfd421a1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:07.945356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef99453a-8a8f-4bea-acc7-a22cfd421a1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:07.945787 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef99453a-8a8f-4bea-acc7-a22cfd421a1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:07.984896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-738b1df9-ca90-4f93-b73b-e8787b0a173f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:07.996076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-738b1df9-ca90-4f93-b73b-e8787b0a173f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.170753 Sep 01 05:37:07.999771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1182/2283] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:07 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:08.429099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ef99453a-8a8f-4bea-acc7-a22cfd421a1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:08.438264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ef99453a-8a8f-4bea-acc7-a22cfd421a1f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.507382 Sep 01 05:37:08.438768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1102/2284] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:07 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:08.937330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b2f313cd-21b9-419b-bb45-8be520a5f613 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:08.938461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b2f313cd-21b9-419b-bb45-8be520a5f613 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:08.947334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2f313cd-21b9-419b-bb45-8be520a5f613 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:08.948095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2f313cd-21b9-419b-bb45-8be520a5f613 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:08.949342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2f313cd-21b9-419b-bb45-8be520a5f613 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:08.950371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2f313cd-21b9-419b-bb45-8be520a5f613 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:08.950988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2f313cd-21b9-419b-bb45-8be520a5f613 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:08.952129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2f313cd-21b9-419b-bb45-8be520a5f613 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:09.023304 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d304de69-b7a2-4abe-8404-903523df8617 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:09.023922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d304de69-b7a2-4abe-8404-903523df8617 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:09.035740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d304de69-b7a2-4abe-8404-903523df8617 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:09.037016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d304de69-b7a2-4abe-8404-903523df8617 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:09.037463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d304de69-b7a2-4abe-8404-903523df8617 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:09.038182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d304de69-b7a2-4abe-8404-903523df8617 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:09.038643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d304de69-b7a2-4abe-8404-903523df8617 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:09.039062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d304de69-b7a2-4abe-8404-903523df8617 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:09.126126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b2f313cd-21b9-419b-bb45-8be520a5f613 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:09.134822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b2f313cd-21b9-419b-bb45-8be520a5f613 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:09.136830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b2f313cd-21b9-419b-bb45-8be520a5f613 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:09.137941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b2f313cd-21b9-419b-bb45-8be520a5f613 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 200 len: 1406 microversion: 2.20 time: 0.207283 Sep 01 05:37:09.138496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1183/2285] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:37:08 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:37:09.392098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d304de69-b7a2-4abe-8404-903523df8617 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:09.400511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d304de69-b7a2-4abe-8404-903523df8617 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.382848 Sep 01 05:37:09.401126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1103/2286] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:09 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:09.460175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6b177e15-db53-4971-ab57-28613c671973 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:09.460726 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6b177e15-db53-4971-ab57-28613c671973 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:09.467126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b177e15-db53-4971-ab57-28613c671973 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:09.467601 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b177e15-db53-4971-ab57-28613c671973 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:09.468029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b177e15-db53-4971-ab57-28613c671973 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:09.468714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b177e15-db53-4971-ab57-28613c671973 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:09.469184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b177e15-db53-4971-ab57-28613c671973 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:09.469597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b177e15-db53-4971-ab57-28613c671973 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:09.600740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-6b177e15-db53-4971-ab57-28613c671973 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:09.610587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6b177e15-db53-4971-ab57-28613c671973 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154393 Sep 01 05:37:09.612343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1184/2287] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:09 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:10.168988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6fb8dc26-960f-475b-8253-a935278b4894 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:10.169653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6fb8dc26-960f-475b-8253-a935278b4894 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:10.176133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6fb8dc26-960f-475b-8253-a935278b4894 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:10.176614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6fb8dc26-960f-475b-8253-a935278b4894 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:10.177266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6fb8dc26-960f-475b-8253-a935278b4894 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:10.178155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6fb8dc26-960f-475b-8253-a935278b4894 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:10.178612 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6fb8dc26-960f-475b-8253-a935278b4894 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:10.179030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6fb8dc26-960f-475b-8253-a935278b4894 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:10.423899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a17bfc1e-1c48-4a88-afb9-a13e9b5c90f2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:10.424516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a17bfc1e-1c48-4a88-afb9-a13e9b5c90f2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:10.431271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a17bfc1e-1c48-4a88-afb9-a13e9b5c90f2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:10.431764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a17bfc1e-1c48-4a88-afb9-a13e9b5c90f2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:10.432201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a17bfc1e-1c48-4a88-afb9-a13e9b5c90f2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:10.433442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a17bfc1e-1c48-4a88-afb9-a13e9b5c90f2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:10.433916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a17bfc1e-1c48-4a88-afb9-a13e9b5c90f2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:10.434345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a17bfc1e-1c48-4a88-afb9-a13e9b5c90f2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:10.577131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a17bfc1e-1c48-4a88-afb9-a13e9b5c90f2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:10.585866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a17bfc1e-1c48-4a88-afb9-a13e9b5c90f2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.166506 Sep 01 05:37:10.587295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1185/2288] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:10 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:10.634201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9562be44-38a8-4900-b7b8-70ca3589aa5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:10.634822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9562be44-38a8-4900-b7b8-70ca3589aa5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:10.636358 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6fb8dc26-960f-475b-8253-a935278b4894 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:10.641902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9562be44-38a8-4900-b7b8-70ca3589aa5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:10.642392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9562be44-38a8-4900-b7b8-70ca3589aa5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:10.642824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9562be44-38a8-4900-b7b8-70ca3589aa5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:10.643509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9562be44-38a8-4900-b7b8-70ca3589aa5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:10.643958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9562be44-38a8-4900-b7b8-70ca3589aa5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:10.644378 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9562be44-38a8-4900-b7b8-70ca3589aa5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:10.646478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6fb8dc26-960f-475b-8253-a935278b4894 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:10.648150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6fb8dc26-960f-475b-8253-a935278b4894 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:10.649563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6fb8dc26-960f-475b-8253-a935278b4894 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 200 len: 1406 microversion: 2.20 time: 0.486551 Sep 01 05:37:10.650123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1104/2289] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:37:10 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 1406 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:37:10.939910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9562be44-38a8-4900-b7b8-70ca3589aa5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:10.948154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9562be44-38a8-4900-b7b8-70ca3589aa5e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.318120 Sep 01 05:37:10.949448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1186/2290] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:10 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:11.608052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-70fe44f0-eb83-4f58-aa1d-f38523218601 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:11.608671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-70fe44f0-eb83-4f58-aa1d-f38523218601 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:11.615430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70fe44f0-eb83-4f58-aa1d-f38523218601 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:11.615921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70fe44f0-eb83-4f58-aa1d-f38523218601 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:11.616469 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70fe44f0-eb83-4f58-aa1d-f38523218601 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:11.617197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70fe44f0-eb83-4f58-aa1d-f38523218601 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:11.617654 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70fe44f0-eb83-4f58-aa1d-f38523218601 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:11.618077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70fe44f0-eb83-4f58-aa1d-f38523218601 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:11.671640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-40fb3827-084b-4f38-8d91-e65a020f87bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:11.672171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-40fb3827-084b-4f38-8d91-e65a020f87bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:11.678791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40fb3827-084b-4f38-8d91-e65a020f87bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:11.679279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40fb3827-084b-4f38-8d91-e65a020f87bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:11.679715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40fb3827-084b-4f38-8d91-e65a020f87bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:11.680400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40fb3827-084b-4f38-8d91-e65a020f87bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:11.680893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40fb3827-084b-4f38-8d91-e65a020f87bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:11.681316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-40fb3827-084b-4f38-8d91-e65a020f87bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:11.873991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40fb3827-084b-4f38-8d91-e65a020f87bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:11.881695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-70fe44f0-eb83-4f58-aa1d-f38523218601 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:11.882310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40fb3827-084b-4f38-8d91-e65a020f87bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:11.883762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-40fb3827-084b-4f38-8d91-e65a020f87bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:11.884911 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-40fb3827-084b-4f38-8d91-e65a020f87bd tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 200 len: 1406 microversion: 2.20 time: 0.217236 Sep 01 05:37:11.885474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1187/2291] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:37:11 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:37:11.911982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-70fe44f0-eb83-4f58-aa1d-f38523218601 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.308161 Sep 01 05:37:11.926747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1105/2292] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:11 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:11.970161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-755edaab-a855-4476-aa64-5da4716aaf04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:11.971273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-755edaab-a855-4476-aa64-5da4716aaf04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:11.985066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-755edaab-a855-4476-aa64-5da4716aaf04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:11.985853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-755edaab-a855-4476-aa64-5da4716aaf04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:11.985995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-755edaab-a855-4476-aa64-5da4716aaf04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:11.986782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-755edaab-a855-4476-aa64-5da4716aaf04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:11.987295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-755edaab-a855-4476-aa64-5da4716aaf04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:11.988708 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-755edaab-a855-4476-aa64-5da4716aaf04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:12.045254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-f67934b1-8eac-4ab7-a386-a4eba47c3a4a req-8b66e443-1a26-40d7-a71c-67ebba03e59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63e3cab-2de7-4da7-a5ba-432a2b389fad", "name": "network-vif-plugged", "status": "completed", "tag": "22c143eb-58c0-47e9-946d-d7fcc7267075"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:12.055611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-f67934b1-8eac-4ab7-a386-a4eba47c3a4a req-8b66e443-1a26-40d7-a71c-67ebba03e59e service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:12.056022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-f67934b1-8eac-4ab7-a386-a4eba47c3a4a req-8b66e443-1a26-40d7-a71c-67ebba03e59e service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:12.056797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-f67934b1-8eac-4ab7-a386-a4eba47c3a4a req-8b66e443-1a26-40d7-a71c-67ebba03e59e service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:12.069163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-f67934b1-8eac-4ab7-a386-a4eba47c3a4a req-8b66e443-1a26-40d7-a71c-67ebba03e59e service nova] Creating event network-vif-plugged:22c143eb-58c0-47e9-946d-d7fcc7267075 for instance c63e3cab-2de7-4da7-a5ba-432a2b389fad on hv-cinder-85391 Sep 01 05:37:12.075280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-f67934b1-8eac-4ab7-a386-a4eba47c3a4a req-8b66e443-1a26-40d7-a71c-67ebba03e59e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122348 Sep 01 05:37:12.075880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1188/2293] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:12.221440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-755edaab-a855-4476-aa64-5da4716aaf04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:12.230603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-755edaab-a855-4476-aa64-5da4716aaf04 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.264129 Sep 01 05:37:12.231186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1106/2294] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:11 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:12.914112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-90adbd95-c751-4261-ac29-15a5f3164da0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:12.914818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-90adbd95-c751-4261-ac29-15a5f3164da0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:12.928655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90adbd95-c751-4261-ac29-15a5f3164da0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:12.929307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90adbd95-c751-4261-ac29-15a5f3164da0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:12.929816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90adbd95-c751-4261-ac29-15a5f3164da0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:12.930632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90adbd95-c751-4261-ac29-15a5f3164da0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:12.931309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90adbd95-c751-4261-ac29-15a5f3164da0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:12.931811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90adbd95-c751-4261-ac29-15a5f3164da0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:12.935600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-396203f2-4775-4f41-9e8f-5f8227ab423f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:12.936214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-396203f2-4775-4f41-9e8f-5f8227ab423f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:12.944940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-396203f2-4775-4f41-9e8f-5f8227ab423f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:12.945424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-396203f2-4775-4f41-9e8f-5f8227ab423f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:12.945858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-396203f2-4775-4f41-9e8f-5f8227ab423f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:12.946556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-396203f2-4775-4f41-9e8f-5f8227ab423f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:12.947031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-396203f2-4775-4f41-9e8f-5f8227ab423f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:12.947450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-396203f2-4775-4f41-9e8f-5f8227ab423f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:13.097242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-396203f2-4775-4f41-9e8f-5f8227ab423f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:13.118962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-396203f2-4775-4f41-9e8f-5f8227ab423f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.184544 Sep 01 05:37:13.121811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1107/2295] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:12 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:13.159253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-90adbd95-c751-4261-ac29-15a5f3164da0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:13.168076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-90adbd95-c751-4261-ac29-15a5f3164da0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:13.169671 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-90adbd95-c751-4261-ac29-15a5f3164da0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:13.170941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-90adbd95-c751-4261-ac29-15a5f3164da0 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 200 len: 1406 microversion: 2.20 time: 0.266452 Sep 01 05:37:13.171713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1189/2296] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:37:12 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:37:13.252527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-89398bc1-3b09-47b1-b129-ed7897fd3db3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:13.253169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-89398bc1-3b09-47b1-b129-ed7897fd3db3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:13.259222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89398bc1-3b09-47b1-b129-ed7897fd3db3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:13.259736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89398bc1-3b09-47b1-b129-ed7897fd3db3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:13.260283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89398bc1-3b09-47b1-b129-ed7897fd3db3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:13.261945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89398bc1-3b09-47b1-b129-ed7897fd3db3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:13.262335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89398bc1-3b09-47b1-b129-ed7897fd3db3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:13.262907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89398bc1-3b09-47b1-b129-ed7897fd3db3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:13.402043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-89398bc1-3b09-47b1-b129-ed7897fd3db3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:13.411178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-89398bc1-3b09-47b1-b129-ed7897fd3db3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.162494 Sep 01 05:37:13.413267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1108/2297] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:13 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:14.138937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-81d0cca9-1fb3-4b44-a69d-27df26fa0cf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:14.139678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-81d0cca9-1fb3-4b44-a69d-27df26fa0cf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:14.142438 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:14.143232 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=12 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:14.149900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81d0cca9-1fb3-4b44-a69d-27df26fa0cf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.150391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81d0cca9-1fb3-4b44-a69d-27df26fa0cf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.150821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81d0cca9-1fb3-4b44-a69d-27df26fa0cf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.152316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81d0cca9-1fb3-4b44-a69d-27df26fa0cf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.152974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81d0cca9-1fb3-4b44-a69d-27df26fa0cf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.153400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-81d0cca9-1fb3-4b44-a69d-27df26fa0cf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.195181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-78d4db14-30c8-4712-872d-2c6b72da1aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:14.195795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-78d4db14-30c8-4712-872d-2c6b72da1aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:14.205862 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78d4db14-30c8-4712-872d-2c6b72da1aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.206571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78d4db14-30c8-4712-872d-2c6b72da1aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.207023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78d4db14-30c8-4712-872d-2c6b72da1aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.207778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78d4db14-30c8-4712-872d-2c6b72da1aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.208226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78d4db14-30c8-4712-872d-2c6b72da1aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.208645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-78d4db14-30c8-4712-872d-2c6b72da1aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.298814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-81d0cca9-1fb3-4b44-a69d-27df26fa0cf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:14.307661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-81d0cca9-1fb3-4b44-a69d-27df26fa0cf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.172739 Sep 01 05:37:14.308942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1190/2298] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:14 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:14.359808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-78d4db14-30c8-4712-872d-2c6b72da1aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:14.368639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-78d4db14-30c8-4712-872d-2c6b72da1aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:14.370354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-78d4db14-30c8-4712-872d-2c6b72da1aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:14.371626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-78d4db14-30c8-4712-872d-2c6b72da1aa4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 200 len: 1599 microversion: 2.20 time: 0.180259 Sep 01 05:37:14.372183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1109/2299] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:37:14 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 1599 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:37:14.396505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9960b4f1-6cc3-4af1-85a1-287757abef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:14.397036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9960b4f1-6cc3-4af1-85a1-287757abef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:14.404070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9960b4f1-6cc3-4af1-85a1-287757abef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.404576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9960b4f1-6cc3-4af1-85a1-287757abef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.405041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9960b4f1-6cc3-4af1-85a1-287757abef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.405711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9960b4f1-6cc3-4af1-85a1-287757abef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.406154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9960b4f1-6cc3-4af1-85a1-287757abef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.406568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9960b4f1-6cc3-4af1-85a1-287757abef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.433872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e724274e-9aa3-4c3b-857f-b164702439c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:14.434477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e724274e-9aa3-4c3b-857f-b164702439c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:14.441092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e724274e-9aa3-4c3b-857f-b164702439c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.441092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e724274e-9aa3-4c3b-857f-b164702439c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.441497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e724274e-9aa3-4c3b-857f-b164702439c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.442347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e724274e-9aa3-4c3b-857f-b164702439c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.442955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e724274e-9aa3-4c3b-857f-b164702439c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.443509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e724274e-9aa3-4c3b-857f-b164702439c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.484506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9960b4f1-6cc3-4af1-85a1-287757abef10 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091971 Sep 01 05:37:14.485722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1191/2300] 10.222.0.49 () {60 vars in 1316 bytes} [Thu Sep 1 05:37:14 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:37:14.580616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e724274e-9aa3-4c3b-857f-b164702439c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:14.590085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e724274e-9aa3-4c3b-857f-b164702439c4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.160178 Sep 01 05:37:14.590658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1110/2301] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:14 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:15.330808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-41227442-3a67-4334-a205-6e4e4061e3ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:15.331412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-41227442-3a67-4334-a205-6e4e4061e3ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:15.337347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41227442-3a67-4334-a205-6e4e4061e3ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:15.337829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41227442-3a67-4334-a205-6e4e4061e3ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:15.338322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41227442-3a67-4334-a205-6e4e4061e3ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:15.340202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41227442-3a67-4334-a205-6e4e4061e3ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:15.340666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41227442-3a67-4334-a205-6e4e4061e3ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:15.341118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41227442-3a67-4334-a205-6e4e4061e3ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:15.501768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-41227442-3a67-4334-a205-6e4e4061e3ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:15.510313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-41227442-3a67-4334-a205-6e4e4061e3ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.183935 Sep 01 05:37:15.511608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1192/2302] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:15 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:15.610523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cfd25990-a2d7-40a1-8f23-313fe7767231 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:15.611141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cfd25990-a2d7-40a1-8f23-313fe7767231 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:15.617200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfd25990-a2d7-40a1-8f23-313fe7767231 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:15.617593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfd25990-a2d7-40a1-8f23-313fe7767231 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:15.618030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfd25990-a2d7-40a1-8f23-313fe7767231 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:15.618720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfd25990-a2d7-40a1-8f23-313fe7767231 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:15.619258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfd25990-a2d7-40a1-8f23-313fe7767231 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:15.619582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfd25990-a2d7-40a1-8f23-313fe7767231 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:15.656902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-db3313f3-463b-4548-805c-020ba6b515f4 req-ad31ba97-efb2-45e8-9e5f-3b672c3acad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63e3cab-2de7-4da7-a5ba-432a2b389fad", "tag": "22c143eb-58c0-47e9-946d-d7fcc7267075"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:15.671365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-db3313f3-463b-4548-805c-020ba6b515f4 req-ad31ba97-efb2-45e8-9e5f-3b672c3acad6 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:15.672161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-db3313f3-463b-4548-805c-020ba6b515f4 req-ad31ba97-efb2-45e8-9e5f-3b672c3acad6 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:15.672604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-db3313f3-463b-4548-805c-020ba6b515f4 req-ad31ba97-efb2-45e8-9e5f-3b672c3acad6 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:15.684929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-db3313f3-463b-4548-805c-020ba6b515f4 req-ad31ba97-efb2-45e8-9e5f-3b672c3acad6 service nova] Creating event network-changed:22c143eb-58c0-47e9-946d-d7fcc7267075 for instance c63e3cab-2de7-4da7-a5ba-432a2b389fad on hv-cinder-85391 Sep 01 05:37:15.692641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-db3313f3-463b-4548-805c-020ba6b515f4 req-ad31ba97-efb2-45e8-9e5f-3b672c3acad6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242326 Sep 01 05:37:15.693891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1111/2303] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:15.759614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cfd25990-a2d7-40a1-8f23-313fe7767231 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:15.768676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cfd25990-a2d7-40a1-8f23-313fe7767231 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.161949 Sep 01 05:37:15.769272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1193/2304] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:15 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:16.533226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a67a3b34-cc5a-4f01-934d-258f8c66c7c5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:16.533954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a67a3b34-cc5a-4f01-934d-258f8c66c7c5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:16.540620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a67a3b34-cc5a-4f01-934d-258f8c66c7c5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:16.541150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a67a3b34-cc5a-4f01-934d-258f8c66c7c5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:16.541578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a67a3b34-cc5a-4f01-934d-258f8c66c7c5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:16.542510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a67a3b34-cc5a-4f01-934d-258f8c66c7c5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:16.543047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a67a3b34-cc5a-4f01-934d-258f8c66c7c5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:16.543466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a67a3b34-cc5a-4f01-934d-258f8c66c7c5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:16.672392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a67a3b34-cc5a-4f01-934d-258f8c66c7c5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:16.680610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a67a3b34-cc5a-4f01-934d-258f8c66c7c5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152153 Sep 01 05:37:16.681203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1112/2305] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:16 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:16.790719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2fd1912d-7904-45ce-98a0-b9ab3739e551 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:16.791263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2fd1912d-7904-45ce-98a0-b9ab3739e551 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:16.797886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fd1912d-7904-45ce-98a0-b9ab3739e551 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:16.798358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fd1912d-7904-45ce-98a0-b9ab3739e551 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:16.798781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fd1912d-7904-45ce-98a0-b9ab3739e551 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:16.799450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fd1912d-7904-45ce-98a0-b9ab3739e551 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:16.799894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fd1912d-7904-45ce-98a0-b9ab3739e551 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:16.800309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fd1912d-7904-45ce-98a0-b9ab3739e551 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:16.933308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2fd1912d-7904-45ce-98a0-b9ab3739e551 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:16.941414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2fd1912d-7904-45ce-98a0-b9ab3739e551 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154650 Sep 01 05:37:16.941972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1194/2306] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:16 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:17.701707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-55aecba5-3696-42f0-b96a-2b26460c7572 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:17.702272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-55aecba5-3696-42f0-b96a-2b26460c7572 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:17.708596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-55aecba5-3696-42f0-b96a-2b26460c7572 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:17.709105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-55aecba5-3696-42f0-b96a-2b26460c7572 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:17.709531 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-55aecba5-3696-42f0-b96a-2b26460c7572 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:17.710202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-55aecba5-3696-42f0-b96a-2b26460c7572 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:17.710641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-55aecba5-3696-42f0-b96a-2b26460c7572 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:17.711055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-55aecba5-3696-42f0-b96a-2b26460c7572 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:17.835301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-55aecba5-3696-42f0-b96a-2b26460c7572 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:17.844124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-55aecba5-3696-42f0-b96a-2b26460c7572 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.147172 Sep 01 05:37:17.844693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1113/2307] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:17 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:17.963062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1231231a-ddad-4da3-8b34-4f1f16af3074 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:17.963630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1231231a-ddad-4da3-8b34-4f1f16af3074 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:17.970036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1231231a-ddad-4da3-8b34-4f1f16af3074 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:17.970510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1231231a-ddad-4da3-8b34-4f1f16af3074 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:17.970939 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1231231a-ddad-4da3-8b34-4f1f16af3074 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:17.971609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1231231a-ddad-4da3-8b34-4f1f16af3074 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:17.972053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1231231a-ddad-4da3-8b34-4f1f16af3074 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:17.972470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1231231a-ddad-4da3-8b34-4f1f16af3074 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:18.099482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1231231a-ddad-4da3-8b34-4f1f16af3074 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:18.108318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1231231a-ddad-4da3-8b34-4f1f16af3074 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149133 Sep 01 05:37:18.108905 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1195/2308] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:17 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:18.864571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e7a5ca19-8d47-415e-828c-a939a85b4115 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:18.865212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e7a5ca19-8d47-415e-828c-a939a85b4115 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:18.872250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e7a5ca19-8d47-415e-828c-a939a85b4115 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:18.872724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e7a5ca19-8d47-415e-828c-a939a85b4115 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:18.873182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e7a5ca19-8d47-415e-828c-a939a85b4115 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:18.873862 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e7a5ca19-8d47-415e-828c-a939a85b4115 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:18.874310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e7a5ca19-8d47-415e-828c-a939a85b4115 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:18.874730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e7a5ca19-8d47-415e-828c-a939a85b4115 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:19.011817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e7a5ca19-8d47-415e-828c-a939a85b4115 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:19.014137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:19.021919 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e7a5ca19-8d47-415e-828c-a939a85b4115 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.161162 Sep 01 05:37:19.022496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1114/2309] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:18 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:19.130298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-33381ef3-d62c-4053-97da-88a060211b07 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:19.131022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-33381ef3-d62c-4053-97da-88a060211b07 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:19.138044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33381ef3-d62c-4053-97da-88a060211b07 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:19.138525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33381ef3-d62c-4053-97da-88a060211b07 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:19.138954 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33381ef3-d62c-4053-97da-88a060211b07 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:19.139625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33381ef3-d62c-4053-97da-88a060211b07 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:19.140070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33381ef3-d62c-4053-97da-88a060211b07 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:19.140488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33381ef3-d62c-4053-97da-88a060211b07 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:19.269349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-33381ef3-d62c-4053-97da-88a060211b07 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:19.278126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-33381ef3-d62c-4053-97da-88a060211b07 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151653 Sep 01 05:37:19.278691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1196/2310] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:19 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:20.044025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-03ae0ecd-b575-4cd9-910f-9e8ace25a77d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:20.044635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-03ae0ecd-b575-4cd9-910f-9e8ace25a77d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:20.051108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03ae0ecd-b575-4cd9-910f-9e8ace25a77d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:20.051585 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03ae0ecd-b575-4cd9-910f-9e8ace25a77d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:20.052018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03ae0ecd-b575-4cd9-910f-9e8ace25a77d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:20.052695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03ae0ecd-b575-4cd9-910f-9e8ace25a77d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:20.053184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03ae0ecd-b575-4cd9-910f-9e8ace25a77d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:20.053604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-03ae0ecd-b575-4cd9-910f-9e8ace25a77d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:20.179925 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-03ae0ecd-b575-4cd9-910f-9e8ace25a77d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:20.188761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-03ae0ecd-b575-4cd9-910f-9e8ace25a77d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149295 Sep 01 05:37:20.189346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1115/2311] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:20 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:20.301712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-55a9cedf-dd08-4b01-8c79-3d0e3ea10a4a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:20.302348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-55a9cedf-dd08-4b01-8c79-3d0e3ea10a4a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:20.309585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55a9cedf-dd08-4b01-8c79-3d0e3ea10a4a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:20.310060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55a9cedf-dd08-4b01-8c79-3d0e3ea10a4a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:20.310492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55a9cedf-dd08-4b01-8c79-3d0e3ea10a4a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:20.311163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55a9cedf-dd08-4b01-8c79-3d0e3ea10a4a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:20.311608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55a9cedf-dd08-4b01-8c79-3d0e3ea10a4a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:20.312023 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-55a9cedf-dd08-4b01-8c79-3d0e3ea10a4a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:20.443458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-55a9cedf-dd08-4b01-8c79-3d0e3ea10a4a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:20.451757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-55a9cedf-dd08-4b01-8c79-3d0e3ea10a4a tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153837 Sep 01 05:37:20.452325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1197/2312] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:20 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:21.210248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1ae79559-5617-4c3f-94b0-eea9fe912077 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:21.210873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1ae79559-5617-4c3f-94b0-eea9fe912077 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:21.217392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ae79559-5617-4c3f-94b0-eea9fe912077 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:21.217883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ae79559-5617-4c3f-94b0-eea9fe912077 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:21.218317 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ae79559-5617-4c3f-94b0-eea9fe912077 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:21.219000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ae79559-5617-4c3f-94b0-eea9fe912077 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:21.219450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ae79559-5617-4c3f-94b0-eea9fe912077 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:21.219869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1ae79559-5617-4c3f-94b0-eea9fe912077 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:21.353828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1ae79559-5617-4c3f-94b0-eea9fe912077 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:21.362463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1ae79559-5617-4c3f-94b0-eea9fe912077 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156087 Sep 01 05:37:21.363024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1116/2313] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:21 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:21.473246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-35fbc140-4283-4f03-baf4-2442a8da7adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:21.473765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-35fbc140-4283-4f03-baf4-2442a8da7adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:21.476168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:21.482376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35fbc140-4283-4f03-baf4-2442a8da7adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:21.482868 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35fbc140-4283-4f03-baf4-2442a8da7adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:21.483307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35fbc140-4283-4f03-baf4-2442a8da7adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:21.483999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35fbc140-4283-4f03-baf4-2442a8da7adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:21.484450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35fbc140-4283-4f03-baf4-2442a8da7adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:21.484902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-35fbc140-4283-4f03-baf4-2442a8da7adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:21.618087 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-35fbc140-4283-4f03-baf4-2442a8da7adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:21.626574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-35fbc140-4283-4f03-baf4-2442a8da7adc tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.157280 Sep 01 05:37:21.627127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1198/2314] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:21 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:22.384629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e8d8026f-fbf6-462c-8c69-064ff19e1cf3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:22.385353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e8d8026f-fbf6-462c-8c69-064ff19e1cf3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:22.388231 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:22.393800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8d8026f-fbf6-462c-8c69-064ff19e1cf3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.394273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8d8026f-fbf6-462c-8c69-064ff19e1cf3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.394696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8d8026f-fbf6-462c-8c69-064ff19e1cf3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.395366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8d8026f-fbf6-462c-8c69-064ff19e1cf3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.395803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8d8026f-fbf6-462c-8c69-064ff19e1cf3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.396221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8d8026f-fbf6-462c-8c69-064ff19e1cf3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.526422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e8d8026f-fbf6-462c-8c69-064ff19e1cf3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:22.534635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e8d8026f-fbf6-462c-8c69-064ff19e1cf3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153855 Sep 01 05:37:22.535459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1117/2315] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:22 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:22.647615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-17730e8e-0dee-465d-833d-3740fd61d84d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:22.648227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-17730e8e-0dee-465d-833d-3740fd61d84d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:22.654851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-17730e8e-0dee-465d-833d-3740fd61d84d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.655325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-17730e8e-0dee-465d-833d-3740fd61d84d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.655756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-17730e8e-0dee-465d-833d-3740fd61d84d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.656430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-17730e8e-0dee-465d-833d-3740fd61d84d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.656898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-17730e8e-0dee-465d-833d-3740fd61d84d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.657319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-17730e8e-0dee-465d-833d-3740fd61d84d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.672486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:22.789339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-17730e8e-0dee-465d-833d-3740fd61d84d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:22.798143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-17730e8e-0dee-465d-833d-3740fd61d84d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154401 Sep 01 05:37:22.798698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1199/2316] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:22 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:23.557248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-60a15287-b527-4997-9506-7412bf63058d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:23.557892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-60a15287-b527-4997-9506-7412bf63058d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:23.564318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60a15287-b527-4997-9506-7412bf63058d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:23.564818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60a15287-b527-4997-9506-7412bf63058d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:23.565254 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60a15287-b527-4997-9506-7412bf63058d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:23.565927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60a15287-b527-4997-9506-7412bf63058d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:23.566381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60a15287-b527-4997-9506-7412bf63058d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:23.566800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-60a15287-b527-4997-9506-7412bf63058d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:23.696710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-60a15287-b527-4997-9506-7412bf63058d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:23.705459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-60a15287-b527-4997-9506-7412bf63058d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152090 Sep 01 05:37:23.706023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1118/2317] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:23 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:23.819672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e3193eff-af0b-4a76-87b6-3fb74254454f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:23.820193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e3193eff-af0b-4a76-87b6-3fb74254454f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:23.827312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3193eff-af0b-4a76-87b6-3fb74254454f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:23.827789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3193eff-af0b-4a76-87b6-3fb74254454f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:23.828220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3193eff-af0b-4a76-87b6-3fb74254454f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:23.828928 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3193eff-af0b-4a76-87b6-3fb74254454f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:23.829377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3193eff-af0b-4a76-87b6-3fb74254454f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:23.829796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e3193eff-af0b-4a76-87b6-3fb74254454f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:23.963168 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e3193eff-af0b-4a76-87b6-3fb74254454f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:23.971409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e3193eff-af0b-4a76-87b6-3fb74254454f tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155604 Sep 01 05:37:23.971965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1200/2318] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:23 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:24.726547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d81f9428-0631-4813-b1e3-400a9d042828 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:24.727073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d81f9428-0631-4813-b1e3-400a9d042828 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:24.734173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d81f9428-0631-4813-b1e3-400a9d042828 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:24.734645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d81f9428-0631-4813-b1e3-400a9d042828 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:24.735071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d81f9428-0631-4813-b1e3-400a9d042828 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:24.735743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d81f9428-0631-4813-b1e3-400a9d042828 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:24.736181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d81f9428-0631-4813-b1e3-400a9d042828 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:24.736594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d81f9428-0631-4813-b1e3-400a9d042828 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:24.863484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d81f9428-0631-4813-b1e3-400a9d042828 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:24.871635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d81f9428-0631-4813-b1e3-400a9d042828 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149055 Sep 01 05:37:24.872197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1119/2319] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:24 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:24.992877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b5b3b33d-b9d4-44b3-9b55-b6fbb1eb83e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:24.993421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b5b3b33d-b9d4-44b3-9b55-b6fbb1eb83e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:24.999920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5b3b33d-b9d4-44b3-9b55-b6fbb1eb83e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:25.000434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5b3b33d-b9d4-44b3-9b55-b6fbb1eb83e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:25.000904 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5b3b33d-b9d4-44b3-9b55-b6fbb1eb83e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:25.001592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5b3b33d-b9d4-44b3-9b55-b6fbb1eb83e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:25.002045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5b3b33d-b9d4-44b3-9b55-b6fbb1eb83e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:25.002467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b5b3b33d-b9d4-44b3-9b55-b6fbb1eb83e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:25.129828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b5b3b33d-b9d4-44b3-9b55-b6fbb1eb83e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:25.142126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b5b3b33d-b9d4-44b3-9b55-b6fbb1eb83e6 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153249 Sep 01 05:37:25.142695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1201/2320] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:24 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:25.892540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0eb6b4e3-97e7-41bf-a441-abaedb1f06dd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:25.893184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0eb6b4e3-97e7-41bf-a441-abaedb1f06dd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:25.899684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0eb6b4e3-97e7-41bf-a441-abaedb1f06dd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:25.900172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0eb6b4e3-97e7-41bf-a441-abaedb1f06dd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:25.900610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0eb6b4e3-97e7-41bf-a441-abaedb1f06dd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:25.901507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0eb6b4e3-97e7-41bf-a441-abaedb1f06dd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:25.901978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0eb6b4e3-97e7-41bf-a441-abaedb1f06dd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:25.902400 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0eb6b4e3-97e7-41bf-a441-abaedb1f06dd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:26.034118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0eb6b4e3-97e7-41bf-a441-abaedb1f06dd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:26.043185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0eb6b4e3-97e7-41bf-a441-abaedb1f06dd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154474 Sep 01 05:37:26.043755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1120/2321] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:25 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:26.164196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a3a884b3-842e-4a9e-b899-d8c8d2615a7d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:26.164723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a3a884b3-842e-4a9e-b899-d8c8d2615a7d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:26.171771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3a884b3-842e-4a9e-b899-d8c8d2615a7d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:26.172255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3a884b3-842e-4a9e-b899-d8c8d2615a7d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:26.172690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3a884b3-842e-4a9e-b899-d8c8d2615a7d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:26.173407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3a884b3-842e-4a9e-b899-d8c8d2615a7d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:26.173860 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3a884b3-842e-4a9e-b899-d8c8d2615a7d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:26.174280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a3a884b3-842e-4a9e-b899-d8c8d2615a7d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:26.308697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a3a884b3-842e-4a9e-b899-d8c8d2615a7d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:26.316828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a3a884b3-842e-4a9e-b899-d8c8d2615a7d tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156915 Sep 01 05:37:26.317387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1202/2322] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:26 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:27.063483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4dd59fff-3a22-4dbd-83bd-5474d8a9ea01 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:27.064094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4dd59fff-3a22-4dbd-83bd-5474d8a9ea01 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:27.070542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dd59fff-3a22-4dbd-83bd-5474d8a9ea01 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:27.071016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dd59fff-3a22-4dbd-83bd-5474d8a9ea01 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:27.071445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dd59fff-3a22-4dbd-83bd-5474d8a9ea01 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:27.072118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dd59fff-3a22-4dbd-83bd-5474d8a9ea01 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:27.073100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dd59fff-3a22-4dbd-83bd-5474d8a9ea01 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:27.073835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4dd59fff-3a22-4dbd-83bd-5474d8a9ea01 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:27.203315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4dd59fff-3a22-4dbd-83bd-5474d8a9ea01 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:27.211423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4dd59fff-3a22-4dbd-83bd-5474d8a9ea01 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151786 Sep 01 05:37:27.211984 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1121/2323] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:27 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:27.339007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2af7566b-cd0f-41a2-b4b8-f186095a57bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:27.339754 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2af7566b-cd0f-41a2-b4b8-f186095a57bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:27.346156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2af7566b-cd0f-41a2-b4b8-f186095a57bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:27.346631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2af7566b-cd0f-41a2-b4b8-f186095a57bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:27.347066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2af7566b-cd0f-41a2-b4b8-f186095a57bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:27.347743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2af7566b-cd0f-41a2-b4b8-f186095a57bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:27.348196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2af7566b-cd0f-41a2-b4b8-f186095a57bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:27.348617 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2af7566b-cd0f-41a2-b4b8-f186095a57bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:27.475046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2af7566b-cd0f-41a2-b4b8-f186095a57bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:27.483535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2af7566b-cd0f-41a2-b4b8-f186095a57bb tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148996 Sep 01 05:37:27.484092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1203/2324] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:27 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:28.233356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e9244f82-524a-472b-b274-f371f79c9b0a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:28.233890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e9244f82-524a-472b-b274-f371f79c9b0a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:28.240349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e9244f82-524a-472b-b274-f371f79c9b0a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:28.240844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e9244f82-524a-472b-b274-f371f79c9b0a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:28.241275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e9244f82-524a-472b-b274-f371f79c9b0a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:28.241942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e9244f82-524a-472b-b274-f371f79c9b0a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:28.242383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e9244f82-524a-472b-b274-f371f79c9b0a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:28.242797 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e9244f82-524a-472b-b274-f371f79c9b0a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:28.369675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e9244f82-524a-472b-b274-f371f79c9b0a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:28.377724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e9244f82-524a-472b-b274-f371f79c9b0a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148943 Sep 01 05:37:28.378297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1122/2325] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:28 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:28.505521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4ce959fb-945e-4b49-b3cd-74f39ba0157c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:28.506061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4ce959fb-945e-4b49-b3cd-74f39ba0157c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:28.512891 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4ce959fb-945e-4b49-b3cd-74f39ba0157c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:28.513368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4ce959fb-945e-4b49-b3cd-74f39ba0157c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:28.513798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4ce959fb-945e-4b49-b3cd-74f39ba0157c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:28.514476 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4ce959fb-945e-4b49-b3cd-74f39ba0157c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:28.514918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4ce959fb-945e-4b49-b3cd-74f39ba0157c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:28.515333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4ce959fb-945e-4b49-b3cd-74f39ba0157c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:28.647245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4ce959fb-945e-4b49-b3cd-74f39ba0157c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:28.656090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4ce959fb-945e-4b49-b3cd-74f39ba0157c tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.154474 Sep 01 05:37:28.656639 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1204/2326] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:28 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:29.398836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dd96633b-82e4-4a1d-ba2f-a57dd324491a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:29.399445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dd96633b-82e4-4a1d-ba2f-a57dd324491a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:29.405868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd96633b-82e4-4a1d-ba2f-a57dd324491a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:29.406341 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd96633b-82e4-4a1d-ba2f-a57dd324491a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:29.406774 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd96633b-82e4-4a1d-ba2f-a57dd324491a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:29.407436 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd96633b-82e4-4a1d-ba2f-a57dd324491a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:29.407877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd96633b-82e4-4a1d-ba2f-a57dd324491a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:29.408292 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dd96633b-82e4-4a1d-ba2f-a57dd324491a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:29.538635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dd96633b-82e4-4a1d-ba2f-a57dd324491a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:29.547642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dd96633b-82e4-4a1d-ba2f-a57dd324491a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152663 Sep 01 05:37:29.548216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1123/2327] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:29 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:29.677523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-446e8ee6-d88c-4447-b678-ee6241760ebf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:29.678040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-446e8ee6-d88c-4447-b678-ee6241760ebf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:29.684516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-446e8ee6-d88c-4447-b678-ee6241760ebf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:29.685028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-446e8ee6-d88c-4447-b678-ee6241760ebf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:29.685466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-446e8ee6-d88c-4447-b678-ee6241760ebf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:29.686152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-446e8ee6-d88c-4447-b678-ee6241760ebf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:29.686606 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-446e8ee6-d88c-4447-b678-ee6241760ebf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:29.687031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-446e8ee6-d88c-4447-b678-ee6241760ebf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:29.814813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-446e8ee6-d88c-4447-b678-ee6241760ebf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:29.822905 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-446e8ee6-d88c-4447-b678-ee6241760ebf tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149220 Sep 01 05:37:29.823461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1205/2328] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:29 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:30.569808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9523a08e-3df9-40b7-a703-ba5f9dc3c08e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:30.570444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9523a08e-3df9-40b7-a703-ba5f9dc3c08e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:30.577587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9523a08e-3df9-40b7-a703-ba5f9dc3c08e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:30.578063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9523a08e-3df9-40b7-a703-ba5f9dc3c08e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:30.578490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9523a08e-3df9-40b7-a703-ba5f9dc3c08e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:30.579161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9523a08e-3df9-40b7-a703-ba5f9dc3c08e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:30.579605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9523a08e-3df9-40b7-a703-ba5f9dc3c08e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:30.580018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9523a08e-3df9-40b7-a703-ba5f9dc3c08e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:30.708671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9523a08e-3df9-40b7-a703-ba5f9dc3c08e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:30.717435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9523a08e-3df9-40b7-a703-ba5f9dc3c08e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151472 Sep 01 05:37:30.718003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1124/2329] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:30 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:30.843803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-15617994-b6b5-4b18-a567-36a3a91a6db9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:30.844696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-15617994-b6b5-4b18-a567-36a3a91a6db9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:30.851123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-15617994-b6b5-4b18-a567-36a3a91a6db9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:30.851605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-15617994-b6b5-4b18-a567-36a3a91a6db9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:30.852074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-15617994-b6b5-4b18-a567-36a3a91a6db9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:30.852759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-15617994-b6b5-4b18-a567-36a3a91a6db9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:30.853235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-15617994-b6b5-4b18-a567-36a3a91a6db9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:30.854187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-15617994-b6b5-4b18-a567-36a3a91a6db9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:30.986788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-15617994-b6b5-4b18-a567-36a3a91a6db9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:30.995616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-15617994-b6b5-4b18-a567-36a3a91a6db9 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.155860 Sep 01 05:37:30.996183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1206/2330] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:30 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:31.738745 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-69b6a0d7-cf22-4006-96e2-7f317bc71fff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:31.739356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-69b6a0d7-cf22-4006-96e2-7f317bc71fff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:31.746680 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-69b6a0d7-cf22-4006-96e2-7f317bc71fff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:31.747158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-69b6a0d7-cf22-4006-96e2-7f317bc71fff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:31.747592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-69b6a0d7-cf22-4006-96e2-7f317bc71fff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:31.748279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-69b6a0d7-cf22-4006-96e2-7f317bc71fff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:31.748730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-69b6a0d7-cf22-4006-96e2-7f317bc71fff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:31.749171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-69b6a0d7-cf22-4006-96e2-7f317bc71fff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:31.877893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-69b6a0d7-cf22-4006-96e2-7f317bc71fff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:31.886177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-69b6a0d7-cf22-4006-96e2-7f317bc71fff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151120 Sep 01 05:37:31.886554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1125/2331] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:31 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:32.015920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8f6df797-065d-4fc3-a772-2ee91a38ef06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:32.016444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8f6df797-065d-4fc3-a772-2ee91a38ef06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:32.022835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f6df797-065d-4fc3-a772-2ee91a38ef06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:32.023311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f6df797-065d-4fc3-a772-2ee91a38ef06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:32.023742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f6df797-065d-4fc3-a772-2ee91a38ef06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:32.024419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f6df797-065d-4fc3-a772-2ee91a38ef06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:32.024894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f6df797-065d-4fc3-a772-2ee91a38ef06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:32.025313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f6df797-065d-4fc3-a772-2ee91a38ef06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:32.151803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8f6df797-065d-4fc3-a772-2ee91a38ef06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:32.160180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8f6df797-065d-4fc3-a772-2ee91a38ef06 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.147902 Sep 01 05:37:32.160738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1207/2332] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:32 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:32.906172 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-15c2cb7e-0e88-4564-aeba-7790191b1486 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:32.906786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-15c2cb7e-0e88-4564-aeba-7790191b1486 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:32.913513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15c2cb7e-0e88-4564-aeba-7790191b1486 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:32.914015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15c2cb7e-0e88-4564-aeba-7790191b1486 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:32.914443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15c2cb7e-0e88-4564-aeba-7790191b1486 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:32.915114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15c2cb7e-0e88-4564-aeba-7790191b1486 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:32.915562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15c2cb7e-0e88-4564-aeba-7790191b1486 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:32.915973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-15c2cb7e-0e88-4564-aeba-7790191b1486 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:33.049135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-15c2cb7e-0e88-4564-aeba-7790191b1486 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:33.057243 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-15c2cb7e-0e88-4564-aeba-7790191b1486 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154929 Sep 01 05:37:33.058439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1126/2333] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:32 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:33.181903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c2debfd3-6836-461f-abc7-c56390e3e5ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:33.182423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c2debfd3-6836-461f-abc7-c56390e3e5ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:33.189386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c2debfd3-6836-461f-abc7-c56390e3e5ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:33.189855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c2debfd3-6836-461f-abc7-c56390e3e5ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:33.190282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c2debfd3-6836-461f-abc7-c56390e3e5ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:33.190958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c2debfd3-6836-461f-abc7-c56390e3e5ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:33.191399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c2debfd3-6836-461f-abc7-c56390e3e5ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:33.191810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c2debfd3-6836-461f-abc7-c56390e3e5ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:33.317222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c2debfd3-6836-461f-abc7-c56390e3e5ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:33.325263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c2debfd3-6836-461f-abc7-c56390e3e5ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.147331 Sep 01 05:37:33.325832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1208/2334] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:33 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:34.087434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4b2e121d-ef7b-49d4-9a42-cb29decc3094 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:34.088048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4b2e121d-ef7b-49d4-9a42-cb29decc3094 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:34.095057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4b2e121d-ef7b-49d4-9a42-cb29decc3094 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:34.095559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4b2e121d-ef7b-49d4-9a42-cb29decc3094 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:34.095990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4b2e121d-ef7b-49d4-9a42-cb29decc3094 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:34.096660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4b2e121d-ef7b-49d4-9a42-cb29decc3094 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:34.097129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4b2e121d-ef7b-49d4-9a42-cb29decc3094 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:34.097543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4b2e121d-ef7b-49d4-9a42-cb29decc3094 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:34.227782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4b2e121d-ef7b-49d4-9a42-cb29decc3094 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:34.236115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4b2e121d-ef7b-49d4-9a42-cb29decc3094 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152552 Sep 01 05:37:34.236673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1127/2335] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:34 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:34.345470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8356bb79-2609-4009-9a18-9862f88af180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:34.346084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8356bb79-2609-4009-9a18-9862f88af180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:34.352440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8356bb79-2609-4009-9a18-9862f88af180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:34.353057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8356bb79-2609-4009-9a18-9862f88af180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:34.353376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8356bb79-2609-4009-9a18-9862f88af180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:34.354054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8356bb79-2609-4009-9a18-9862f88af180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:34.354531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8356bb79-2609-4009-9a18-9862f88af180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:34.355111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8356bb79-2609-4009-9a18-9862f88af180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:34.734255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8356bb79-2609-4009-9a18-9862f88af180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:34.742297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8356bb79-2609-4009-9a18-9862f88af180 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.400625 Sep 01 05:37:34.742859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1209/2336] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:34 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:35.257946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7b7af8ef-084a-47c9-8913-f21654ac8768 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:35.258556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7b7af8ef-084a-47c9-8913-f21654ac8768 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:35.265032 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b7af8ef-084a-47c9-8913-f21654ac8768 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:35.265504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b7af8ef-084a-47c9-8913-f21654ac8768 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:35.265930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b7af8ef-084a-47c9-8913-f21654ac8768 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:35.266598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b7af8ef-084a-47c9-8913-f21654ac8768 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:35.267034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b7af8ef-084a-47c9-8913-f21654ac8768 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:35.267446 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b7af8ef-084a-47c9-8913-f21654ac8768 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:35.398349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7b7af8ef-084a-47c9-8913-f21654ac8768 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:35.406479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7b7af8ef-084a-47c9-8913-f21654ac8768 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152344 Sep 01 05:37:35.407046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1128/2337] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:35 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:35.764174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0c23acdd-e237-49d3-a2d2-0436df44ff7b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:35.764832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0c23acdd-e237-49d3-a2d2-0436df44ff7b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:35.771322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c23acdd-e237-49d3-a2d2-0436df44ff7b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:35.771793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c23acdd-e237-49d3-a2d2-0436df44ff7b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:35.772222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c23acdd-e237-49d3-a2d2-0436df44ff7b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:35.772927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c23acdd-e237-49d3-a2d2-0436df44ff7b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:35.773379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c23acdd-e237-49d3-a2d2-0436df44ff7b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:35.773792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c23acdd-e237-49d3-a2d2-0436df44ff7b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:35.902600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0c23acdd-e237-49d3-a2d2-0436df44ff7b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:35.910989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0c23acdd-e237-49d3-a2d2-0436df44ff7b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.150806 Sep 01 05:37:35.911550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1210/2338] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:35 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:36.427970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a9533375-422e-4ad7-82bf-d51b8849e869 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:36.428586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a9533375-422e-4ad7-82bf-d51b8849e869 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:36.435955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a9533375-422e-4ad7-82bf-d51b8849e869 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:36.436435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a9533375-422e-4ad7-82bf-d51b8849e869 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:36.436917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a9533375-422e-4ad7-82bf-d51b8849e869 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:36.437599 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a9533375-422e-4ad7-82bf-d51b8849e869 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:36.438047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a9533375-422e-4ad7-82bf-d51b8849e869 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:36.438466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a9533375-422e-4ad7-82bf-d51b8849e869 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:36.564792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a9533375-422e-4ad7-82bf-d51b8849e869 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:36.573802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a9533375-422e-4ad7-82bf-d51b8849e869 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148728 Sep 01 05:37:36.574711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1129/2339] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:36 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:36.933794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-946f8d13-d8b9-4628-b363-3effa621d5c7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:36.934402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-946f8d13-d8b9-4628-b363-3effa621d5c7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:36.940700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-946f8d13-d8b9-4628-b363-3effa621d5c7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:36.941209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-946f8d13-d8b9-4628-b363-3effa621d5c7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:36.941640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-946f8d13-d8b9-4628-b363-3effa621d5c7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:36.942314 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-946f8d13-d8b9-4628-b363-3effa621d5c7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:36.942760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-946f8d13-d8b9-4628-b363-3effa621d5c7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:36.943204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-946f8d13-d8b9-4628-b363-3effa621d5c7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:37.072527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-946f8d13-d8b9-4628-b363-3effa621d5c7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:37.080738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-946f8d13-d8b9-4628-b363-3effa621d5c7 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151448 Sep 01 05:37:37.081329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1211/2340] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:36 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:37.595068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-02070088-1695-482c-80e1-d2cd98bc16d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:37.595682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-02070088-1695-482c-80e1-d2cd98bc16d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:37.602091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02070088-1695-482c-80e1-d2cd98bc16d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:37.602569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02070088-1695-482c-80e1-d2cd98bc16d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:37.603115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02070088-1695-482c-80e1-d2cd98bc16d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:37.603799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02070088-1695-482c-80e1-d2cd98bc16d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:37.604798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02070088-1695-482c-80e1-d2cd98bc16d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:37.605252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02070088-1695-482c-80e1-d2cd98bc16d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:37.736598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-02070088-1695-482c-80e1-d2cd98bc16d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:37.744681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-02070088-1695-482c-80e1-d2cd98bc16d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153476 Sep 01 05:37:37.746115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1130/2341] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:37 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:38.102392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1a43e968-7cd9-4d97-a59e-bd8698732386 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:38.103047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1a43e968-7cd9-4d97-a59e-bd8698732386 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:38.109628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a43e968-7cd9-4d97-a59e-bd8698732386 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:38.110104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a43e968-7cd9-4d97-a59e-bd8698732386 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:38.110536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a43e968-7cd9-4d97-a59e-bd8698732386 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:38.111208 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a43e968-7cd9-4d97-a59e-bd8698732386 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:38.111652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a43e968-7cd9-4d97-a59e-bd8698732386 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:38.112069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1a43e968-7cd9-4d97-a59e-bd8698732386 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:38.240277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1a43e968-7cd9-4d97-a59e-bd8698732386 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:38.248341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1a43e968-7cd9-4d97-a59e-bd8698732386 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149991 Sep 01 05:37:38.248919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1212/2342] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:38 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:38.766980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9466bc83-9c41-487d-8d36-8562659bd585 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:38.767594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9466bc83-9c41-487d-8d36-8562659bd585 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:38.774160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9466bc83-9c41-487d-8d36-8562659bd585 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:38.774642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9466bc83-9c41-487d-8d36-8562659bd585 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:38.775075 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9466bc83-9c41-487d-8d36-8562659bd585 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:38.775757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9466bc83-9c41-487d-8d36-8562659bd585 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:38.776208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9466bc83-9c41-487d-8d36-8562659bd585 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:38.776872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9466bc83-9c41-487d-8d36-8562659bd585 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:38.791445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:38.905602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9466bc83-9c41-487d-8d36-8562659bd585 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:38.913863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9466bc83-9c41-487d-8d36-8562659bd585 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150778 Sep 01 05:37:38.914456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1131/2343] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:38 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:39.270065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c2842844-bfb8-4c5b-bb1c-95929eef4970 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:39.270673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c2842844-bfb8-4c5b-bb1c-95929eef4970 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:39.277176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c2842844-bfb8-4c5b-bb1c-95929eef4970 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:39.277648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c2842844-bfb8-4c5b-bb1c-95929eef4970 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:39.278077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c2842844-bfb8-4c5b-bb1c-95929eef4970 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:39.278749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c2842844-bfb8-4c5b-bb1c-95929eef4970 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:39.279196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c2842844-bfb8-4c5b-bb1c-95929eef4970 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:39.279609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c2842844-bfb8-4c5b-bb1c-95929eef4970 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:39.413493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c2842844-bfb8-4c5b-bb1c-95929eef4970 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:39.422758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c2842844-bfb8-4c5b-bb1c-95929eef4970 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.156587 Sep 01 05:37:39.423313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1213/2344] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:39 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:39.935563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9389293a-7dd0-4f10-8e2a-8b5db2e58f48 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:39.936173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9389293a-7dd0-4f10-8e2a-8b5db2e58f48 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:39.942674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9389293a-7dd0-4f10-8e2a-8b5db2e58f48 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:39.943151 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9389293a-7dd0-4f10-8e2a-8b5db2e58f48 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:39.943581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9389293a-7dd0-4f10-8e2a-8b5db2e58f48 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:39.944259 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9389293a-7dd0-4f10-8e2a-8b5db2e58f48 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:39.944706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9389293a-7dd0-4f10-8e2a-8b5db2e58f48 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:39.945149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9389293a-7dd0-4f10-8e2a-8b5db2e58f48 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:40.073384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9389293a-7dd0-4f10-8e2a-8b5db2e58f48 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:40.081548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9389293a-7dd0-4f10-8e2a-8b5db2e58f48 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150450 Sep 01 05:37:40.082112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1132/2345] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:39 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:40.443761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3f376278-167c-42ef-8b9d-88f6e8bfc365 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:40.444376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3f376278-167c-42ef-8b9d-88f6e8bfc365 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:40.450803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f376278-167c-42ef-8b9d-88f6e8bfc365 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:40.451281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f376278-167c-42ef-8b9d-88f6e8bfc365 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:40.451719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f376278-167c-42ef-8b9d-88f6e8bfc365 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:40.452404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f376278-167c-42ef-8b9d-88f6e8bfc365 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:40.452892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f376278-167c-42ef-8b9d-88f6e8bfc365 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:40.453316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f376278-167c-42ef-8b9d-88f6e8bfc365 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:40.580628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3f376278-167c-42ef-8b9d-88f6e8bfc365 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:40.589624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3f376278-167c-42ef-8b9d-88f6e8bfc365 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149233 Sep 01 05:37:40.590183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1214/2346] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:40 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:41.102131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b77979a9-fc14-4351-b9be-6f7b417e00e0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:41.102735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b77979a9-fc14-4351-b9be-6f7b417e00e0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:41.110148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b77979a9-fc14-4351-b9be-6f7b417e00e0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:41.110623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b77979a9-fc14-4351-b9be-6f7b417e00e0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:41.111046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b77979a9-fc14-4351-b9be-6f7b417e00e0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:41.111723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b77979a9-fc14-4351-b9be-6f7b417e00e0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:41.112164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b77979a9-fc14-4351-b9be-6f7b417e00e0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:41.112581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b77979a9-fc14-4351-b9be-6f7b417e00e0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:41.248502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b77979a9-fc14-4351-b9be-6f7b417e00e0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:41.256720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b77979a9-fc14-4351-b9be-6f7b417e00e0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.158433 Sep 01 05:37:41.257312 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1133/2347] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:41 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:41.610896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5c2bdcfd-5344-4ce1-aade-29d4061791f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:41.611456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5c2bdcfd-5344-4ce1-aade-29d4061791f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:41.618040 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c2bdcfd-5344-4ce1-aade-29d4061791f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:41.618515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c2bdcfd-5344-4ce1-aade-29d4061791f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:41.618943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c2bdcfd-5344-4ce1-aade-29d4061791f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:41.619610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c2bdcfd-5344-4ce1-aade-29d4061791f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:41.620757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c2bdcfd-5344-4ce1-aade-29d4061791f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:41.621192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5c2bdcfd-5344-4ce1-aade-29d4061791f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:41.747595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5c2bdcfd-5344-4ce1-aade-29d4061791f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:41.755797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5c2bdcfd-5344-4ce1-aade-29d4061791f1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.148875 Sep 01 05:37:41.756356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1215/2348] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:41 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:42.279217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-548e6fe2-cc94-4c12-bf0e-f063eb4113ea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:42.279736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-548e6fe2-cc94-4c12-bf0e-f063eb4113ea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:42.286465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-548e6fe2-cc94-4c12-bf0e-f063eb4113ea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:42.286935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-548e6fe2-cc94-4c12-bf0e-f063eb4113ea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:42.287362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-548e6fe2-cc94-4c12-bf0e-f063eb4113ea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:42.288025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-548e6fe2-cc94-4c12-bf0e-f063eb4113ea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:42.288464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-548e6fe2-cc94-4c12-bf0e-f063eb4113ea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:42.288898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-548e6fe2-cc94-4c12-bf0e-f063eb4113ea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:42.414118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-548e6fe2-cc94-4c12-bf0e-f063eb4113ea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:42.422660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-548e6fe2-cc94-4c12-bf0e-f063eb4113ea tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.147949 Sep 01 05:37:42.423230 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1134/2349] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:42 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:42.775855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b0b4a1d9-c807-4810-947a-5c6808afdb7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:42.776537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b0b4a1d9-c807-4810-947a-5c6808afdb7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:42.782798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0b4a1d9-c807-4810-947a-5c6808afdb7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:42.783274 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0b4a1d9-c807-4810-947a-5c6808afdb7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:42.783706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0b4a1d9-c807-4810-947a-5c6808afdb7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:42.784382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0b4a1d9-c807-4810-947a-5c6808afdb7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:42.785121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0b4a1d9-c807-4810-947a-5c6808afdb7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:42.785540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b0b4a1d9-c807-4810-947a-5c6808afdb7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:42.789312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:42.917075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b0b4a1d9-c807-4810-947a-5c6808afdb7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:42.925541 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b0b4a1d9-c807-4810-947a-5c6808afdb7e tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.153605 Sep 01 05:37:42.926104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1216/2350] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:42 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:43.448812 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bc148703-91a0-4141-846b-7d82bbe91259 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:43.449441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bc148703-91a0-4141-846b-7d82bbe91259 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:43.455773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc148703-91a0-4141-846b-7d82bbe91259 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:43.456251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc148703-91a0-4141-846b-7d82bbe91259 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:43.456680 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc148703-91a0-4141-846b-7d82bbe91259 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:43.457388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc148703-91a0-4141-846b-7d82bbe91259 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:43.457860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc148703-91a0-4141-846b-7d82bbe91259 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:43.458271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc148703-91a0-4141-846b-7d82bbe91259 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:43.592104 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bc148703-91a0-4141-846b-7d82bbe91259 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:43.600249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bc148703-91a0-4141-846b-7d82bbe91259 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155565 Sep 01 05:37:43.600836 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1135/2351] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:43 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:43.947054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-65ecbe30-c237-4655-bffa-5293c104e2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:43.947655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-65ecbe30-c237-4655-bffa-5293c104e2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:43.954167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65ecbe30-c237-4655-bffa-5293c104e2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:43.954640 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65ecbe30-c237-4655-bffa-5293c104e2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:43.955070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65ecbe30-c237-4655-bffa-5293c104e2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:43.955744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65ecbe30-c237-4655-bffa-5293c104e2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:43.956186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65ecbe30-c237-4655-bffa-5293c104e2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:43.956600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65ecbe30-c237-4655-bffa-5293c104e2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:44.087018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-65ecbe30-c237-4655-bffa-5293c104e2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:44.095657 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-65ecbe30-c237-4655-bffa-5293c104e2c3 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.152429 Sep 01 05:37:44.096246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1217/2352] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:43 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:44.622210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a6b51786-76ee-4e5c-853b-dadb0a4aa587 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:44.622838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a6b51786-76ee-4e5c-853b-dadb0a4aa587 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:44.629604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a6b51786-76ee-4e5c-853b-dadb0a4aa587 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:44.630093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a6b51786-76ee-4e5c-853b-dadb0a4aa587 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:44.630537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a6b51786-76ee-4e5c-853b-dadb0a4aa587 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:44.631225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a6b51786-76ee-4e5c-853b-dadb0a4aa587 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:44.631676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a6b51786-76ee-4e5c-853b-dadb0a4aa587 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:44.632099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a6b51786-76ee-4e5c-853b-dadb0a4aa587 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:44.764609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a6b51786-76ee-4e5c-853b-dadb0a4aa587 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:44.773271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a6b51786-76ee-4e5c-853b-dadb0a4aa587 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155984 Sep 01 05:37:44.774097 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1136/2353] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:44 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:45.000525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d860e8af-0ba2-466e-a4ec-367cd3391a0f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:45.001089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d860e8af-0ba2-466e-a4ec-367cd3391a0f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:45.007458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d860e8af-0ba2-466e-a4ec-367cd3391a0f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:45.007942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d860e8af-0ba2-466e-a4ec-367cd3391a0f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:45.008382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d860e8af-0ba2-466e-a4ec-367cd3391a0f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:45.009105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d860e8af-0ba2-466e-a4ec-367cd3391a0f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:45.009560 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d860e8af-0ba2-466e-a4ec-367cd3391a0f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:45.009989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d860e8af-0ba2-466e-a4ec-367cd3391a0f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:45.033352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d860e8af-0ba2-466e-a4ec-367cd3391a0f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad/ips" status: 200 len: 153 microversion: 2.20 time: 0.036628 Sep 01 05:37:45.033932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1218/2354] 10.222.0.49 () {60 vars in 1289 bytes} [Thu Sep 1 05:37:44 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:37:45.117369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cc163720-32e2-4ef9-aa1c-0a7fba65abf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:45.117944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cc163720-32e2-4ef9-aa1c-0a7fba65abf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:45.124588 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc163720-32e2-4ef9-aa1c-0a7fba65abf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:45.125097 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc163720-32e2-4ef9-aa1c-0a7fba65abf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:45.125538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc163720-32e2-4ef9-aa1c-0a7fba65abf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:45.126216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc163720-32e2-4ef9-aa1c-0a7fba65abf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:45.126667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc163720-32e2-4ef9-aa1c-0a7fba65abf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:45.127088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cc163720-32e2-4ef9-aa1c-0a7fba65abf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:45.252970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cc163720-32e2-4ef9-aa1c-0a7fba65abf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:45.261248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cc163720-32e2-4ef9-aa1c-0a7fba65abf1 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.147644 Sep 01 05:37:45.261823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1137/2355] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:45 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:45.795653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a7cf2817-7f60-4583-9f87-944c2d3b5dd7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:45.796298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a7cf2817-7f60-4583-9f87-944c2d3b5dd7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:45.802308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7cf2817-7f60-4583-9f87-944c2d3b5dd7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:45.802779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7cf2817-7f60-4583-9f87-944c2d3b5dd7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:45.803206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7cf2817-7f60-4583-9f87-944c2d3b5dd7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:45.803878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7cf2817-7f60-4583-9f87-944c2d3b5dd7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:45.804319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7cf2817-7f60-4583-9f87-944c2d3b5dd7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:45.804732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a7cf2817-7f60-4583-9f87-944c2d3b5dd7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:45.938159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a7cf2817-7f60-4583-9f87-944c2d3b5dd7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:45.946422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a7cf2817-7f60-4583-9f87-944c2d3b5dd7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155340 Sep 01 05:37:45.946987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1219/2356] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:45 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:46.282424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c00451d1-3e95-4855-89f3-8a9d6e9cae64 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:46.283045 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c00451d1-3e95-4855-89f3-8a9d6e9cae64 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:46.290098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c00451d1-3e95-4855-89f3-8a9d6e9cae64 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:46.290584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c00451d1-3e95-4855-89f3-8a9d6e9cae64 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:46.291017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c00451d1-3e95-4855-89f3-8a9d6e9cae64 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:46.291827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c00451d1-3e95-4855-89f3-8a9d6e9cae64 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:46.292386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c00451d1-3e95-4855-89f3-8a9d6e9cae64 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:46.292831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c00451d1-3e95-4855-89f3-8a9d6e9cae64 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:46.422118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c00451d1-3e95-4855-89f3-8a9d6e9cae64 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:46.430249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c00451d1-3e95-4855-89f3-8a9d6e9cae64 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.151680 Sep 01 05:37:46.430809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1138/2357] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:46 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:46.967477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-77eb8093-aae0-474c-84ad-b0df1854c945 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:46.968086 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-77eb8093-aae0-474c-84ad-b0df1854c945 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:46.974454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77eb8093-aae0-474c-84ad-b0df1854c945 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:46.974924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77eb8093-aae0-474c-84ad-b0df1854c945 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:46.975349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77eb8093-aae0-474c-84ad-b0df1854c945 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:46.976021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77eb8093-aae0-474c-84ad-b0df1854c945 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:46.976463 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77eb8093-aae0-474c-84ad-b0df1854c945 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:46.976905 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-77eb8093-aae0-474c-84ad-b0df1854c945 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:47.105739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-77eb8093-aae0-474c-84ad-b0df1854c945 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:47.113738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-77eb8093-aae0-474c-84ad-b0df1854c945 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150105 Sep 01 05:37:47.114297 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1220/2358] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:46 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:47.451586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d5e86fca-8989-440f-8c32-a0c2aa4abce4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:47.452202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d5e86fca-8989-440f-8c32-a0c2aa4abce4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:47.458649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5e86fca-8989-440f-8c32-a0c2aa4abce4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:47.459128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5e86fca-8989-440f-8c32-a0c2aa4abce4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:47.459564 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5e86fca-8989-440f-8c32-a0c2aa4abce4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:47.460240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5e86fca-8989-440f-8c32-a0c2aa4abce4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:47.460690 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5e86fca-8989-440f-8c32-a0c2aa4abce4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:47.461139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d5e86fca-8989-440f-8c32-a0c2aa4abce4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:47.588508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d5e86fca-8989-440f-8c32-a0c2aa4abce4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:47.596850 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d5e86fca-8989-440f-8c32-a0c2aa4abce4 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.149302 Sep 01 05:37:47.597421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1139/2359] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:47 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:48.134578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-db69e6c3-1d53-4b57-a316-1831d9f7b6aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:48.135753 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-db69e6c3-1d53-4b57-a316-1831d9f7b6aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:48.142156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db69e6c3-1d53-4b57-a316-1831d9f7b6aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:48.142625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db69e6c3-1d53-4b57-a316-1831d9f7b6aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:48.143046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db69e6c3-1d53-4b57-a316-1831d9f7b6aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:48.143710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db69e6c3-1d53-4b57-a316-1831d9f7b6aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:48.144148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db69e6c3-1d53-4b57-a316-1831d9f7b6aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:48.144558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-db69e6c3-1d53-4b57-a316-1831d9f7b6aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:48.275670 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-db69e6c3-1d53-4b57-a316-1831d9f7b6aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:48.286562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-db69e6c3-1d53-4b57-a316-1831d9f7b6aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155834 Sep 01 05:37:48.287134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1221/2360] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:48 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:48.618612 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-65fb18c7-12e9-4846-b752-595dfd0bc2d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:48.619242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-65fb18c7-12e9-4846-b752-595dfd0bc2d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 5fd99adb-f38e-4d43-82b1-529010509f72] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:48.626057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-65fb18c7-12e9-4846-b752-595dfd0bc2d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:48.626542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-65fb18c7-12e9-4846-b752-595dfd0bc2d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:48.626980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-65fb18c7-12e9-4846-b752-595dfd0bc2d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:48.627702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-65fb18c7-12e9-4846-b752-595dfd0bc2d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:48.628155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-65fb18c7-12e9-4846-b752-595dfd0bc2d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:48.628579 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-65fb18c7-12e9-4846-b752-595dfd0bc2d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:48.767483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-65fb18c7-12e9-4846-b752-595dfd0bc2d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:48.776467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-65fb18c7-12e9-4846-b752-595dfd0bc2d2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72" status: 200 len: 1732 microversion: 2.1 time: 0.161007 Sep 01 05:37:48.777071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1140/2361] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:48 2022] GET /compute/v2.1/servers/5fd99adb-f38e-4d43-82b1-529010509f72 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:48.796832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b5dc3e5c-3eca-4be2-9d92-a544fd8a052b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '.version_select at 0x7f9624ebc0d0>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:48.814763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b5dc3e5c-3eca-4be2-9d92-a544fd8a052b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1464602" status: 202 len: 0 microversion: 2.1 time: 0.021747 Sep 01 05:37:48.815326 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1222/2362] 10.222.0.49 () {58 vars in 1212 bytes} [Thu Sep 1 05:37:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1464602 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:37:49.308371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b627ef6a-33c3-4eaa-8df1-6f7b3aaa7dcd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:49.308922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b627ef6a-33c3-4eaa-8df1-6f7b3aaa7dcd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:49.315328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b627ef6a-33c3-4eaa-8df1-6f7b3aaa7dcd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:49.315812 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b627ef6a-33c3-4eaa-8df1-6f7b3aaa7dcd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:49.316240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b627ef6a-33c3-4eaa-8df1-6f7b3aaa7dcd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:49.316954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b627ef6a-33c3-4eaa-8df1-6f7b3aaa7dcd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:49.317399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b627ef6a-33c3-4eaa-8df1-6f7b3aaa7dcd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:49.317813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b627ef6a-33c3-4eaa-8df1-6f7b3aaa7dcd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:49.659936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b627ef6a-33c3-4eaa-8df1-6f7b3aaa7dcd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:49.669268 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b627ef6a-33c3-4eaa-8df1-6f7b3aaa7dcd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.365502 Sep 01 05:37:49.669930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1141/2363] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:49 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:50.016533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-bdd2e853-1d65-48fe-8b01-3a0806f63fee req-1d89677a-9eac-4543-9a29-f8b45f5428ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd99adb-f38e-4d43-82b1-529010509f72", "tag": "7ce60b54-510b-440d-9175-fd0f98028fab"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:50.027290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-bdd2e853-1d65-48fe-8b01-3a0806f63fee req-1d89677a-9eac-4543-9a29-f8b45f5428ee service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:50.027643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-bdd2e853-1d65-48fe-8b01-3a0806f63fee req-1d89677a-9eac-4543-9a29-f8b45f5428ee service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:50.028075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-bdd2e853-1d65-48fe-8b01-3a0806f63fee req-1d89677a-9eac-4543-9a29-f8b45f5428ee service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:50.040037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-bdd2e853-1d65-48fe-8b01-3a0806f63fee req-1d89677a-9eac-4543-9a29-f8b45f5428ee service nova] Creating event network-changed:7ce60b54-510b-440d-9175-fd0f98028fab for instance 5fd99adb-f38e-4d43-82b1-529010509f72 on hv-cinder-85391 Sep 01 05:37:50.046306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-bdd2e853-1d65-48fe-8b01-3a0806f63fee req-1d89677a-9eac-4543-9a29-f8b45f5428ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033901 Sep 01 05:37:50.046909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1223/2364] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:50.690970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0e2637d2-ede8-4e67-b9a7-985e853ced19 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:50.691639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0e2637d2-ede8-4e67-b9a7-985e853ced19 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:50.698620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e2637d2-ede8-4e67-b9a7-985e853ced19 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:50.699618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e2637d2-ede8-4e67-b9a7-985e853ced19 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:50.700101 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e2637d2-ede8-4e67-b9a7-985e853ced19 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:50.700905 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e2637d2-ede8-4e67-b9a7-985e853ced19 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:50.701417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e2637d2-ede8-4e67-b9a7-985e853ced19 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:50.701916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0e2637d2-ede8-4e67-b9a7-985e853ced19 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:50.845154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0e2637d2-ede8-4e67-b9a7-985e853ced19 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:50.853675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0e2637d2-ede8-4e67-b9a7-985e853ced19 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.166511 Sep 01 05:37:50.854362 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1142/2365] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:50 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:51.875988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-798b6e64-675c-4cc5-a695-97f1a57a1fdc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:51.876713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-798b6e64-675c-4cc5-a695-97f1a57a1fdc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:51.879217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:51.884459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-798b6e64-675c-4cc5-a695-97f1a57a1fdc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:51.884990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-798b6e64-675c-4cc5-a695-97f1a57a1fdc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:51.885419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-798b6e64-675c-4cc5-a695-97f1a57a1fdc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:51.886088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-798b6e64-675c-4cc5-a695-97f1a57a1fdc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:51.886530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-798b6e64-675c-4cc5-a695-97f1a57a1fdc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:51.886943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-798b6e64-675c-4cc5-a695-97f1a57a1fdc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:52.019117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-798b6e64-675c-4cc5-a695-97f1a57a1fdc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:52.027631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-798b6e64-675c-4cc5-a695-97f1a57a1fdc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155422 Sep 01 05:37:52.028034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1224/2366] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:51 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:53.047846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-672440bc-0b00-45a5-85bc-c727ef19376b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:53.048459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-672440bc-0b00-45a5-85bc-c727ef19376b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:53.051135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=52 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:53.056538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-672440bc-0b00-45a5-85bc-c727ef19376b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:53.057569 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-672440bc-0b00-45a5-85bc-c727ef19376b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:53.058208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-672440bc-0b00-45a5-85bc-c727ef19376b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:53.058891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-672440bc-0b00-45a5-85bc-c727ef19376b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:53.059343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-672440bc-0b00-45a5-85bc-c727ef19376b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:53.059761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-672440bc-0b00-45a5-85bc-c727ef19376b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:53.187584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-672440bc-0b00-45a5-85bc-c727ef19376b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:53.195622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-672440bc-0b00-45a5-85bc-c727ef19376b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151680 Sep 01 05:37:53.196175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1143/2367] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:53 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:54.216937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-72945afe-3fea-422c-aed2-5e998c6e5cfe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:54.217468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-72945afe-3fea-422c-aed2-5e998c6e5cfe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:54.224017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72945afe-3fea-422c-aed2-5e998c6e5cfe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:54.224498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72945afe-3fea-422c-aed2-5e998c6e5cfe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:54.225006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72945afe-3fea-422c-aed2-5e998c6e5cfe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:54.225681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72945afe-3fea-422c-aed2-5e998c6e5cfe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:54.226129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72945afe-3fea-422c-aed2-5e998c6e5cfe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:54.226548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72945afe-3fea-422c-aed2-5e998c6e5cfe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:54.354771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72945afe-3fea-422c-aed2-5e998c6e5cfe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:54.362967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-72945afe-3fea-422c-aed2-5e998c6e5cfe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150272 Sep 01 05:37:54.363531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1225/2368] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:54 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:55.383966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-146e7707-b7ea-4a09-9061-abdd44de58da tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:55.384582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-146e7707-b7ea-4a09-9061-abdd44de58da tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:55.391678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-146e7707-b7ea-4a09-9061-abdd44de58da tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:55.392162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-146e7707-b7ea-4a09-9061-abdd44de58da tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:55.392598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-146e7707-b7ea-4a09-9061-abdd44de58da tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:55.393315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-146e7707-b7ea-4a09-9061-abdd44de58da tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:55.393768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-146e7707-b7ea-4a09-9061-abdd44de58da tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:55.394187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-146e7707-b7ea-4a09-9061-abdd44de58da tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:55.525875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-146e7707-b7ea-4a09-9061-abdd44de58da tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:55.534184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-146e7707-b7ea-4a09-9061-abdd44de58da tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154071 Sep 01 05:37:55.535014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1144/2369] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:55 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:56.555428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4de8af29-957a-4ff7-a073-4a223e5950db tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:56.556034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4de8af29-957a-4ff7-a073-4a223e5950db tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:56.563218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4de8af29-957a-4ff7-a073-4a223e5950db tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:56.563684 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4de8af29-957a-4ff7-a073-4a223e5950db tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:56.564108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4de8af29-957a-4ff7-a073-4a223e5950db tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:56.564800 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4de8af29-957a-4ff7-a073-4a223e5950db tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:56.565267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4de8af29-957a-4ff7-a073-4a223e5950db tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:56.565681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4de8af29-957a-4ff7-a073-4a223e5950db tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:56.696318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4de8af29-957a-4ff7-a073-4a223e5950db tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:56.705331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4de8af29-957a-4ff7-a073-4a223e5950db tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153638 Sep 01 05:37:56.706049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1226/2370] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:56 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:57.726487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-be937e6d-1b68-4025-8620-50d372a2c2ca tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:57.727128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-be937e6d-1b68-4025-8620-50d372a2c2ca tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:57.734530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be937e6d-1b68-4025-8620-50d372a2c2ca tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:57.735008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be937e6d-1b68-4025-8620-50d372a2c2ca tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:57.735440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be937e6d-1b68-4025-8620-50d372a2c2ca tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:57.736116 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be937e6d-1b68-4025-8620-50d372a2c2ca tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:57.736565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be937e6d-1b68-4025-8620-50d372a2c2ca tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:57.737028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-be937e6d-1b68-4025-8620-50d372a2c2ca tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:57.868933 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-be937e6d-1b68-4025-8620-50d372a2c2ca tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:57.877741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-be937e6d-1b68-4025-8620-50d372a2c2ca tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155160 Sep 01 05:37:57.878297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1145/2371] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:57 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:58.899470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9096a2d9-44ef-4210-b076-166397954d5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:58.900090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9096a2d9-44ef-4210-b076-166397954d5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:58.907210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9096a2d9-44ef-4210-b076-166397954d5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:58.907690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9096a2d9-44ef-4210-b076-166397954d5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:58.908126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9096a2d9-44ef-4210-b076-166397954d5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:58.908838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9096a2d9-44ef-4210-b076-166397954d5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:58.909294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9096a2d9-44ef-4210-b076-166397954d5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:58.909972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9096a2d9-44ef-4210-b076-166397954d5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:59.039637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9096a2d9-44ef-4210-b076-166397954d5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:59.048768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9096a2d9-44ef-4210-b076-166397954d5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153123 Sep 01 05:37:59.049356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1227/2372] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:58 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:00.069856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ee341a85-4f8d-4f1e-a562-9acfc1175bc0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:00.070470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ee341a85-4f8d-4f1e-a562-9acfc1175bc0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:00.077880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee341a85-4f8d-4f1e-a562-9acfc1175bc0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:00.078360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee341a85-4f8d-4f1e-a562-9acfc1175bc0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:00.078791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee341a85-4f8d-4f1e-a562-9acfc1175bc0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:00.079467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee341a85-4f8d-4f1e-a562-9acfc1175bc0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:00.079917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee341a85-4f8d-4f1e-a562-9acfc1175bc0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:00.080345 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ee341a85-4f8d-4f1e-a562-9acfc1175bc0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:00.211577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ee341a85-4f8d-4f1e-a562-9acfc1175bc0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:00.219885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ee341a85-4f8d-4f1e-a562-9acfc1175bc0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153925 Sep 01 05:38:00.220443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1146/2373] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:00 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:01.241818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3ab5c2c3-2751-4256-81cb-ab445c7993ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:01.242369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3ab5c2c3-2751-4256-81cb-ab445c7993ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:01.249307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ab5c2c3-2751-4256-81cb-ab445c7993ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:01.249794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ab5c2c3-2751-4256-81cb-ab445c7993ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:01.250638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ab5c2c3-2751-4256-81cb-ab445c7993ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:01.250933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ab5c2c3-2751-4256-81cb-ab445c7993ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:01.251387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ab5c2c3-2751-4256-81cb-ab445c7993ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:01.251808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3ab5c2c3-2751-4256-81cb-ab445c7993ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:01.386337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3ab5c2c3-2751-4256-81cb-ab445c7993ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:01.394444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3ab5c2c3-2751-4256-81cb-ab445c7993ed tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156932 Sep 01 05:38:01.395009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1228/2374] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:01 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:02.416826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a4f3005e-2d62-48d5-8aea-4fcfad76d996 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:02.417438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a4f3005e-2d62-48d5-8aea-4fcfad76d996 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:02.424080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4f3005e-2d62-48d5-8aea-4fcfad76d996 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:02.424551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4f3005e-2d62-48d5-8aea-4fcfad76d996 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:02.425006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4f3005e-2d62-48d5-8aea-4fcfad76d996 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:02.425673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4f3005e-2d62-48d5-8aea-4fcfad76d996 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:02.426114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4f3005e-2d62-48d5-8aea-4fcfad76d996 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:02.426527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4f3005e-2d62-48d5-8aea-4fcfad76d996 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:02.553426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a4f3005e-2d62-48d5-8aea-4fcfad76d996 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:02.562124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a4f3005e-2d62-48d5-8aea-4fcfad76d996 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149708 Sep 01 05:38:02.562682 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1147/2375] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:02 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:03.705121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1f2f4fb8-5e61-4858-92d4-15a8b648b9d8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:03.705739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1f2f4fb8-5e61-4858-92d4-15a8b648b9d8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:03.711624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f2f4fb8-5e61-4858-92d4-15a8b648b9d8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:03.712093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f2f4fb8-5e61-4858-92d4-15a8b648b9d8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:03.712523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f2f4fb8-5e61-4858-92d4-15a8b648b9d8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:03.713245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f2f4fb8-5e61-4858-92d4-15a8b648b9d8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:03.713693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f2f4fb8-5e61-4858-92d4-15a8b648b9d8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:03.714107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1f2f4fb8-5e61-4858-92d4-15a8b648b9d8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:03.840515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1f2f4fb8-5e61-4858-92d4-15a8b648b9d8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:03.848588 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1f2f4fb8-5e61-4858-92d4-15a8b648b9d8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.268650 Sep 01 05:38:03.849167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1229/2376] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:03 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:04.870161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e4d971e6-501f-4eb6-880d-bb7c74bd22be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:04.870768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e4d971e6-501f-4eb6-880d-bb7c74bd22be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:04.877159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4d971e6-501f-4eb6-880d-bb7c74bd22be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:04.877630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4d971e6-501f-4eb6-880d-bb7c74bd22be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:04.878055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4d971e6-501f-4eb6-880d-bb7c74bd22be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:04.878721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4d971e6-501f-4eb6-880d-bb7c74bd22be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:04.879162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4d971e6-501f-4eb6-880d-bb7c74bd22be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:04.879574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4d971e6-501f-4eb6-880d-bb7c74bd22be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:04.882063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=100 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:05.006063 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e4d971e6-501f-4eb6-880d-bb7c74bd22be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:05.014687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e4d971e6-501f-4eb6-880d-bb7c74bd22be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148988 Sep 01 05:38:05.015247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1148/2377] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:04 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:06.035949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bf2bf5cf-5d4d-4650-9a1e-3ab25b3686e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:06.036566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bf2bf5cf-5d4d-4650-9a1e-3ab25b3686e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:06.043489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf2bf5cf-5d4d-4650-9a1e-3ab25b3686e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:06.043971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf2bf5cf-5d4d-4650-9a1e-3ab25b3686e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:06.044404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf2bf5cf-5d4d-4650-9a1e-3ab25b3686e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:06.045129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf2bf5cf-5d4d-4650-9a1e-3ab25b3686e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:06.045577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf2bf5cf-5d4d-4650-9a1e-3ab25b3686e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:06.045997 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf2bf5cf-5d4d-4650-9a1e-3ab25b3686e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:06.175637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bf2bf5cf-5d4d-4650-9a1e-3ab25b3686e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:06.183872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bf2bf5cf-5d4d-4650-9a1e-3ab25b3686e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152105 Sep 01 05:38:06.184434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1230/2378] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:06 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:07.205525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e5ea2a2e-6c6e-4770-8125-a3c15c822847 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:07.206074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e5ea2a2e-6c6e-4770-8125-a3c15c822847 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:07.212399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e5ea2a2e-6c6e-4770-8125-a3c15c822847 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:07.213066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e5ea2a2e-6c6e-4770-8125-a3c15c822847 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:07.213584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e5ea2a2e-6c6e-4770-8125-a3c15c822847 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:07.214260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e5ea2a2e-6c6e-4770-8125-a3c15c822847 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:07.214704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e5ea2a2e-6c6e-4770-8125-a3c15c822847 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:07.215118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e5ea2a2e-6c6e-4770-8125-a3c15c822847 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:07.345848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e5ea2a2e-6c6e-4770-8125-a3c15c822847 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:07.354139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e5ea2a2e-6c6e-4770-8125-a3c15c822847 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152539 Sep 01 05:38:07.354699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1149/2379] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:07 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:08.375736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8a05a0bf-8a20-4d71-9e06-d6c6eba4647e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:08.376296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8a05a0bf-8a20-4d71-9e06-d6c6eba4647e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:08.382312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a05a0bf-8a20-4d71-9e06-d6c6eba4647e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:08.382789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a05a0bf-8a20-4d71-9e06-d6c6eba4647e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:08.383223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a05a0bf-8a20-4d71-9e06-d6c6eba4647e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:08.383896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a05a0bf-8a20-4d71-9e06-d6c6eba4647e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:08.384343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a05a0bf-8a20-4d71-9e06-d6c6eba4647e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:08.386077 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a05a0bf-8a20-4d71-9e06-d6c6eba4647e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:08.515393 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8a05a0bf-8a20-4d71-9e06-d6c6eba4647e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:08.523445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8a05a0bf-8a20-4d71-9e06-d6c6eba4647e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151873 Sep 01 05:38:08.524002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1231/2380] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:08 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:09.546310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9efd4e21-2b57-403d-a25d-ab7d3179a25a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:09.546855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9efd4e21-2b57-403d-a25d-ab7d3179a25a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:09.553147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9efd4e21-2b57-403d-a25d-ab7d3179a25a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:09.553622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9efd4e21-2b57-403d-a25d-ab7d3179a25a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:09.554045 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9efd4e21-2b57-403d-a25d-ab7d3179a25a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:09.554720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9efd4e21-2b57-403d-a25d-ab7d3179a25a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:09.555160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9efd4e21-2b57-403d-a25d-ab7d3179a25a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:09.555592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9efd4e21-2b57-403d-a25d-ab7d3179a25a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:09.682914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9efd4e21-2b57-403d-a25d-ab7d3179a25a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:09.691194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9efd4e21-2b57-403d-a25d-ab7d3179a25a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149625 Sep 01 05:38:09.691759 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1150/2381] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:09 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:10.715045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-42ccaaf8-a7a8-4352-ac1d-47309e24a179 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:10.715643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-42ccaaf8-a7a8-4352-ac1d-47309e24a179 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:10.722135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42ccaaf8-a7a8-4352-ac1d-47309e24a179 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:10.722618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42ccaaf8-a7a8-4352-ac1d-47309e24a179 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:10.723051 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42ccaaf8-a7a8-4352-ac1d-47309e24a179 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:10.723736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42ccaaf8-a7a8-4352-ac1d-47309e24a179 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:10.724181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42ccaaf8-a7a8-4352-ac1d-47309e24a179 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:10.724600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42ccaaf8-a7a8-4352-ac1d-47309e24a179 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:10.862165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-42ccaaf8-a7a8-4352-ac1d-47309e24a179 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:10.872195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-42ccaaf8-a7a8-4352-ac1d-47309e24a179 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.161946 Sep 01 05:38:10.872764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1232/2382] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:10 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:11.894638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-89e73db2-40ca-48df-b571-5a7c6a40da5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:11.895302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-89e73db2-40ca-48df-b571-5a7c6a40da5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:11.902467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89e73db2-40ca-48df-b571-5a7c6a40da5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:11.902931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89e73db2-40ca-48df-b571-5a7c6a40da5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:11.903366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89e73db2-40ca-48df-b571-5a7c6a40da5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:11.904059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89e73db2-40ca-48df-b571-5a7c6a40da5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:11.904512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89e73db2-40ca-48df-b571-5a7c6a40da5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:11.904974 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-89e73db2-40ca-48df-b571-5a7c6a40da5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:12.037224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-89e73db2-40ca-48df-b571-5a7c6a40da5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:12.045185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-89e73db2-40ca-48df-b571-5a7c6a40da5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154385 Sep 01 05:38:12.045764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1151/2383] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:11 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:13.067755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d21c0e40-6c22-4388-92a5-d6247c5be38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:13.068367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d21c0e40-6c22-4388-92a5-d6247c5be38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:13.075100 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d21c0e40-6c22-4388-92a5-d6247c5be38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:13.075576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d21c0e40-6c22-4388-92a5-d6247c5be38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:13.076009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d21c0e40-6c22-4388-92a5-d6247c5be38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:13.076685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d21c0e40-6c22-4388-92a5-d6247c5be38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:13.077162 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d21c0e40-6c22-4388-92a5-d6247c5be38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:13.077581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d21c0e40-6c22-4388-92a5-d6247c5be38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:13.080046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=90 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:13.209201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d21c0e40-6c22-4388-92a5-d6247c5be38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:13.217857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d21c0e40-6c22-4388-92a5-d6247c5be38a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153979 Sep 01 05:38:13.218423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1233/2384] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:13 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:14.239586 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fd4d9c15-6299-48ff-b07b-99b0a36c8c7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:14.240220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fd4d9c15-6299-48ff-b07b-99b0a36c8c7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:14.246879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd4d9c15-6299-48ff-b07b-99b0a36c8c7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:14.247363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd4d9c15-6299-48ff-b07b-99b0a36c8c7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:14.247798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd4d9c15-6299-48ff-b07b-99b0a36c8c7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:14.248478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd4d9c15-6299-48ff-b07b-99b0a36c8c7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:14.248968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd4d9c15-6299-48ff-b07b-99b0a36c8c7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:14.249395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fd4d9c15-6299-48ff-b07b-99b0a36c8c7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:14.377978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fd4d9c15-6299-48ff-b07b-99b0a36c8c7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:14.386726 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fd4d9c15-6299-48ff-b07b-99b0a36c8c7c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151037 Sep 01 05:38:14.387426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1152/2385] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:14 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:15.408062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8f9c7d18-7fbe-49f8-8cd7-2831d389642b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:15.408682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8f9c7d18-7fbe-49f8-8cd7-2831d389642b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:15.415438 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f9c7d18-7fbe-49f8-8cd7-2831d389642b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:15.415923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f9c7d18-7fbe-49f8-8cd7-2831d389642b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:15.416977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f9c7d18-7fbe-49f8-8cd7-2831d389642b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:15.417943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f9c7d18-7fbe-49f8-8cd7-2831d389642b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:15.418401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f9c7d18-7fbe-49f8-8cd7-2831d389642b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:15.418829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8f9c7d18-7fbe-49f8-8cd7-2831d389642b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:15.545300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8f9c7d18-7fbe-49f8-8cd7-2831d389642b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:15.553409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8f9c7d18-7fbe-49f8-8cd7-2831d389642b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149290 Sep 01 05:38:15.553973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1234/2386] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:15 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:16.573951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0323322f-960f-4b2d-bf86-273048f60dc9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:16.574595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0323322f-960f-4b2d-bf86-273048f60dc9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:16.581055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0323322f-960f-4b2d-bf86-273048f60dc9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:16.581537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0323322f-960f-4b2d-bf86-273048f60dc9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:16.581973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0323322f-960f-4b2d-bf86-273048f60dc9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:16.582656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0323322f-960f-4b2d-bf86-273048f60dc9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:16.583106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0323322f-960f-4b2d-bf86-273048f60dc9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:16.583526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0323322f-960f-4b2d-bf86-273048f60dc9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:16.711869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0323322f-960f-4b2d-bf86-273048f60dc9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:16.720623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0323322f-960f-4b2d-bf86-273048f60dc9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150662 Sep 01 05:38:16.721227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1153/2387] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:16 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:38:17.741947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b2534bcc-3e39-4e77-9a0a-74403fadff13 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:17.743326 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b2534bcc-3e39-4e77-9a0a-74403fadff13 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:17.749580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2534bcc-3e39-4e77-9a0a-74403fadff13 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:17.750151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2534bcc-3e39-4e77-9a0a-74403fadff13 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:17.750653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2534bcc-3e39-4e77-9a0a-74403fadff13 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:17.751413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2534bcc-3e39-4e77-9a0a-74403fadff13 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:17.751933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2534bcc-3e39-4e77-9a0a-74403fadff13 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:17.752429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2534bcc-3e39-4e77-9a0a-74403fadff13 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:17.890409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b2534bcc-3e39-4e77-9a0a-74403fadff13 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:17.898638 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b2534bcc-3e39-4e77-9a0a-74403fadff13 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.160554 Sep 01 05:38:17.899203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1235/2388] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:17 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:18.921223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b3f6dab4-5932-4a73-bd69-be26adb9c76a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:18.921867 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b3f6dab4-5932-4a73-bd69-be26adb9c76a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:18.928550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b3f6dab4-5932-4a73-bd69-be26adb9c76a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:18.929265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b3f6dab4-5932-4a73-bd69-be26adb9c76a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:18.929785 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b3f6dab4-5932-4a73-bd69-be26adb9c76a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:18.930474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b3f6dab4-5932-4a73-bd69-be26adb9c76a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:18.931137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b3f6dab4-5932-4a73-bd69-be26adb9c76a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:18.931639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b3f6dab4-5932-4a73-bd69-be26adb9c76a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:19.065454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b3f6dab4-5932-4a73-bd69-be26adb9c76a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:19.073568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b3f6dab4-5932-4a73-bd69-be26adb9c76a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156330 Sep 01 05:38:19.074129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1154/2389] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:18 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:20.096414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4d18dd1a-08f2-45c3-9d5c-d4fa33aa1878 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:20.097080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4d18dd1a-08f2-45c3-9d5c-d4fa33aa1878 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:20.103508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d18dd1a-08f2-45c3-9d5c-d4fa33aa1878 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:20.104618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d18dd1a-08f2-45c3-9d5c-d4fa33aa1878 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:20.105071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d18dd1a-08f2-45c3-9d5c-d4fa33aa1878 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:20.105741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d18dd1a-08f2-45c3-9d5c-d4fa33aa1878 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:20.106179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d18dd1a-08f2-45c3-9d5c-d4fa33aa1878 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:20.106592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4d18dd1a-08f2-45c3-9d5c-d4fa33aa1878 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:20.237388 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4d18dd1a-08f2-45c3-9d5c-d4fa33aa1878 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:20.245526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4d18dd1a-08f2-45c3-9d5c-d4fa33aa1878 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152920 Sep 01 05:38:20.246092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1236/2390] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:20 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:21.265559 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5bb375d8-56d6-4518-9041-777793284117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:21.266168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5bb375d8-56d6-4518-9041-777793284117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:21.272519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5bb375d8-56d6-4518-9041-777793284117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:21.273023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5bb375d8-56d6-4518-9041-777793284117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:21.273454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5bb375d8-56d6-4518-9041-777793284117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:21.274126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5bb375d8-56d6-4518-9041-777793284117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:21.274570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5bb375d8-56d6-4518-9041-777793284117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:21.274986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5bb375d8-56d6-4518-9041-777793284117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:21.406139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5bb375d8-56d6-4518-9041-777793284117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:21.414547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5bb375d8-56d6-4518-9041-777793284117 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152802 Sep 01 05:38:21.415105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1155/2391] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:21 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:22.436961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2cdea99e-74f5-49ab-bd78-afc6d0705d9f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:22.437580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2cdea99e-74f5-49ab-bd78-afc6d0705d9f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:22.440014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=26 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:22.445361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cdea99e-74f5-49ab-bd78-afc6d0705d9f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:22.445840 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cdea99e-74f5-49ab-bd78-afc6d0705d9f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:22.446276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cdea99e-74f5-49ab-bd78-afc6d0705d9f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:22.446960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cdea99e-74f5-49ab-bd78-afc6d0705d9f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:22.448000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cdea99e-74f5-49ab-bd78-afc6d0705d9f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:22.449091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2cdea99e-74f5-49ab-bd78-afc6d0705d9f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:22.577115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2cdea99e-74f5-49ab-bd78-afc6d0705d9f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:22.585159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2cdea99e-74f5-49ab-bd78-afc6d0705d9f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153026 Sep 01 05:38:22.585717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1237/2392] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:22 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:23.607517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-adb460e3-5ecb-405d-a73c-8f9b6c2ed397 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:23.608122 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-adb460e3-5ecb-405d-a73c-8f9b6c2ed397 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:23.610540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=26 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:23.615850 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adb460e3-5ecb-405d-a73c-8f9b6c2ed397 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.616327 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adb460e3-5ecb-405d-a73c-8f9b6c2ed397 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.616754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adb460e3-5ecb-405d-a73c-8f9b6c2ed397 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.617448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adb460e3-5ecb-405d-a73c-8f9b6c2ed397 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.617892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adb460e3-5ecb-405d-a73c-8f9b6c2ed397 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.618309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-adb460e3-5ecb-405d-a73c-8f9b6c2ed397 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.749056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-adb460e3-5ecb-405d-a73c-8f9b6c2ed397 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:23.757190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-adb460e3-5ecb-405d-a73c-8f9b6c2ed397 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154143 Sep 01 05:38:23.757755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1156/2393] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:23 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:24.778571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b688277b-a4f9-470e-b047-263c9321707f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:24.779211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b688277b-a4f9-470e-b047-263c9321707f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:24.785806 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b688277b-a4f9-470e-b047-263c9321707f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:24.786276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b688277b-a4f9-470e-b047-263c9321707f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:24.786701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b688277b-a4f9-470e-b047-263c9321707f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:24.787366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b688277b-a4f9-470e-b047-263c9321707f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:24.787811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b688277b-a4f9-470e-b047-263c9321707f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:24.788223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b688277b-a4f9-470e-b047-263c9321707f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:24.926944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b688277b-a4f9-470e-b047-263c9321707f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:24.936035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b688277b-a4f9-470e-b047-263c9321707f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.161503 Sep 01 05:38:24.936596 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1238/2394] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:24 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:25.957828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-71821f44-af41-4b92-88b8-8847a444b0af tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:25.958437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-71821f44-af41-4b92-88b8-8847a444b0af tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:25.965065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71821f44-af41-4b92-88b8-8847a444b0af tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.965546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71821f44-af41-4b92-88b8-8847a444b0af tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.965980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71821f44-af41-4b92-88b8-8847a444b0af tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:25.966665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71821f44-af41-4b92-88b8-8847a444b0af tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.967138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71821f44-af41-4b92-88b8-8847a444b0af tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.967542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-71821f44-af41-4b92-88b8-8847a444b0af tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:26.096177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-71821f44-af41-4b92-88b8-8847a444b0af tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:26.104474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-71821f44-af41-4b92-88b8-8847a444b0af tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150610 Sep 01 05:38:26.105078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1157/2395] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:25 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:27.126178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-dfbcc294-fd18-4d7b-983e-a102a6bea9e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:27.126783 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-dfbcc294-fd18-4d7b-983e-a102a6bea9e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:27.133000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dfbcc294-fd18-4d7b-983e-a102a6bea9e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:27.133474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dfbcc294-fd18-4d7b-983e-a102a6bea9e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:27.133900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dfbcc294-fd18-4d7b-983e-a102a6bea9e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:27.134570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dfbcc294-fd18-4d7b-983e-a102a6bea9e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:27.135073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dfbcc294-fd18-4d7b-983e-a102a6bea9e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:27.135538 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-dfbcc294-fd18-4d7b-983e-a102a6bea9e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:27.262860 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-dfbcc294-fd18-4d7b-983e-a102a6bea9e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:27.270931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-dfbcc294-fd18-4d7b-983e-a102a6bea9e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148565 Sep 01 05:38:27.271497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1239/2396] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:27 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:28.293040 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-96b0ca66-03dd-4d41-9f72-bbe5f79aae4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:28.293574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-96b0ca66-03dd-4d41-9f72-bbe5f79aae4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:28.299924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96b0ca66-03dd-4d41-9f72-bbe5f79aae4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:28.300404 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96b0ca66-03dd-4d41-9f72-bbe5f79aae4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:28.300888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96b0ca66-03dd-4d41-9f72-bbe5f79aae4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:28.301572 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96b0ca66-03dd-4d41-9f72-bbe5f79aae4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:28.302030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96b0ca66-03dd-4d41-9f72-bbe5f79aae4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:28.302451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96b0ca66-03dd-4d41-9f72-bbe5f79aae4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:28.433093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-96b0ca66-03dd-4d41-9f72-bbe5f79aae4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:28.441249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-96b0ca66-03dd-4d41-9f72-bbe5f79aae4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152577 Sep 01 05:38:28.441813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1158/2397] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:28 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:29.463428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8fc75c9d-4ad3-44e8-bdf9-088bdfa491a0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:29.464045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8fc75c9d-4ad3-44e8-bdf9-088bdfa491a0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:29.471216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8fc75c9d-4ad3-44e8-bdf9-088bdfa491a0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:29.471718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8fc75c9d-4ad3-44e8-bdf9-088bdfa491a0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:29.472151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8fc75c9d-4ad3-44e8-bdf9-088bdfa491a0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:29.472857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8fc75c9d-4ad3-44e8-bdf9-088bdfa491a0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:29.473328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8fc75c9d-4ad3-44e8-bdf9-088bdfa491a0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:29.473747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8fc75c9d-4ad3-44e8-bdf9-088bdfa491a0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:29.603247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8fc75c9d-4ad3-44e8-bdf9-088bdfa491a0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:29.611430 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8fc75c9d-4ad3-44e8-bdf9-088bdfa491a0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151864 Sep 01 05:38:29.612024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1240/2398] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:29 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:30.633175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-46a9d2af-b6f1-4101-81da-e4eb6de12539 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:30.633778 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-46a9d2af-b6f1-4101-81da-e4eb6de12539 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:30.641177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46a9d2af-b6f1-4101-81da-e4eb6de12539 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:30.641683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46a9d2af-b6f1-4101-81da-e4eb6de12539 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:30.642119 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46a9d2af-b6f1-4101-81da-e4eb6de12539 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:30.642810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46a9d2af-b6f1-4101-81da-e4eb6de12539 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:30.643282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46a9d2af-b6f1-4101-81da-e4eb6de12539 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:30.643709 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-46a9d2af-b6f1-4101-81da-e4eb6de12539 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:30.771962 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-46a9d2af-b6f1-4101-81da-e4eb6de12539 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:30.780093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-46a9d2af-b6f1-4101-81da-e4eb6de12539 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150759 Sep 01 05:38:30.780655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1159/2399] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:30 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:31.802048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-712fd0da-4855-4007-980e-ab9462fc2e64 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:31.802802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-712fd0da-4855-4007-980e-ab9462fc2e64 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:31.809886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-712fd0da-4855-4007-980e-ab9462fc2e64 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:31.810364 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-712fd0da-4855-4007-980e-ab9462fc2e64 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:31.810799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-712fd0da-4855-4007-980e-ab9462fc2e64 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:31.811477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-712fd0da-4855-4007-980e-ab9462fc2e64 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:31.811924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-712fd0da-4855-4007-980e-ab9462fc2e64 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:31.812343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-712fd0da-4855-4007-980e-ab9462fc2e64 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:31.942201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-712fd0da-4855-4007-980e-ab9462fc2e64 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:31.951136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-712fd0da-4855-4007-980e-ab9462fc2e64 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152933 Sep 01 05:38:31.951704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1241/2400] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:31 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:38:32.971851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-197da56e-1d06-4e54-93e3-239dff5574f6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:32.972455 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-197da56e-1d06-4e54-93e3-239dff5574f6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:32.979490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-197da56e-1d06-4e54-93e3-239dff5574f6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:32.979974 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-197da56e-1d06-4e54-93e3-239dff5574f6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:32.980402 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-197da56e-1d06-4e54-93e3-239dff5574f6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:32.981111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-197da56e-1d06-4e54-93e3-239dff5574f6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:32.981556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-197da56e-1d06-4e54-93e3-239dff5574f6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:32.981971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-197da56e-1d06-4e54-93e3-239dff5574f6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:33.108249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-197da56e-1d06-4e54-93e3-239dff5574f6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:33.116463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-197da56e-1d06-4e54-93e3-239dff5574f6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148456 Sep 01 05:38:33.117064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1160/2401] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:32 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:34.138381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5fef50b5-fab4-4206-9e0b-0d8bb5977975 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:34.138988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5fef50b5-fab4-4206-9e0b-0d8bb5977975 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:34.145512 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fef50b5-fab4-4206-9e0b-0d8bb5977975 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:34.145920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fef50b5-fab4-4206-9e0b-0d8bb5977975 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:34.146343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fef50b5-fab4-4206-9e0b-0d8bb5977975 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:34.147012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fef50b5-fab4-4206-9e0b-0d8bb5977975 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:34.147453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fef50b5-fab4-4206-9e0b-0d8bb5977975 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:34.147868 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fef50b5-fab4-4206-9e0b-0d8bb5977975 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:34.276843 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5fef50b5-fab4-4206-9e0b-0d8bb5977975 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:34.285266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5fef50b5-fab4-4206-9e0b-0d8bb5977975 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151449 Sep 01 05:38:34.285829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1242/2402] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:34 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:35.306071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0a7fe23f-b9f4-49c5-b600-4f8815ec37f7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:35.307228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0a7fe23f-b9f4-49c5-b600-4f8815ec37f7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:35.313830 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a7fe23f-b9f4-49c5-b600-4f8815ec37f7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:35.314314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a7fe23f-b9f4-49c5-b600-4f8815ec37f7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:35.314748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a7fe23f-b9f4-49c5-b600-4f8815ec37f7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:35.315437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a7fe23f-b9f4-49c5-b600-4f8815ec37f7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:35.315892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a7fe23f-b9f4-49c5-b600-4f8815ec37f7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:35.316315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0a7fe23f-b9f4-49c5-b600-4f8815ec37f7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:35.320205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=78 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:35.451591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0a7fe23f-b9f4-49c5-b600-4f8815ec37f7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:35.459686 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0a7fe23f-b9f4-49c5-b600-4f8815ec37f7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.157561 Sep 01 05:38:35.460253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1161/2403] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:35 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:36.482508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9cb1f318-8825-44f9-8918-7909419871d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:36.483153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9cb1f318-8825-44f9-8918-7909419871d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:36.489522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9cb1f318-8825-44f9-8918-7909419871d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:36.489995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9cb1f318-8825-44f9-8918-7909419871d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:36.490426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9cb1f318-8825-44f9-8918-7909419871d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:36.491102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9cb1f318-8825-44f9-8918-7909419871d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:36.491555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9cb1f318-8825-44f9-8918-7909419871d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:36.491973 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9cb1f318-8825-44f9-8918-7909419871d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:36.623719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9cb1f318-8825-44f9-8918-7909419871d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:36.631866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9cb1f318-8825-44f9-8918-7909419871d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154252 Sep 01 05:38:36.632428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1243/2404] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:36 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:37.653088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-188dd8f1-fdf0-413d-8dfe-01a14cad0655 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:37.653693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-188dd8f1-fdf0-413d-8dfe-01a14cad0655 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:37.660270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-188dd8f1-fdf0-413d-8dfe-01a14cad0655 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.660743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-188dd8f1-fdf0-413d-8dfe-01a14cad0655 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.661192 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-188dd8f1-fdf0-413d-8dfe-01a14cad0655 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.661864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-188dd8f1-fdf0-413d-8dfe-01a14cad0655 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.662306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-188dd8f1-fdf0-413d-8dfe-01a14cad0655 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.662717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-188dd8f1-fdf0-413d-8dfe-01a14cad0655 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.790398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-188dd8f1-fdf0-413d-8dfe-01a14cad0655 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:37.799224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-188dd8f1-fdf0-413d-8dfe-01a14cad0655 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150235 Sep 01 05:38:37.799796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1162/2405] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:37 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:38.821048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ead6c434-96e8-4720-93db-79bd2c48c1b7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:38.821661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ead6c434-96e8-4720-93db-79bd2c48c1b7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:38.828505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ead6c434-96e8-4720-93db-79bd2c48c1b7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.829016 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ead6c434-96e8-4720-93db-79bd2c48c1b7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.829448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ead6c434-96e8-4720-93db-79bd2c48c1b7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.830126 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ead6c434-96e8-4720-93db-79bd2c48c1b7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.830572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ead6c434-96e8-4720-93db-79bd2c48c1b7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.830990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ead6c434-96e8-4720-93db-79bd2c48c1b7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.961703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ead6c434-96e8-4720-93db-79bd2c48c1b7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:38.969842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ead6c434-96e8-4720-93db-79bd2c48c1b7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152654 Sep 01 05:38:38.970408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1244/2406] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:38 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:39.991370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fb9dc408-ecf3-44c4-af00-66d2ae912a0b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:39.992005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fb9dc408-ecf3-44c4-af00-66d2ae912a0b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:39.999173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb9dc408-ecf3-44c4-af00-66d2ae912a0b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:39.999648 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb9dc408-ecf3-44c4-af00-66d2ae912a0b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:40.000072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb9dc408-ecf3-44c4-af00-66d2ae912a0b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:40.000738 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb9dc408-ecf3-44c4-af00-66d2ae912a0b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:40.001216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb9dc408-ecf3-44c4-af00-66d2ae912a0b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:40.001635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb9dc408-ecf3-44c4-af00-66d2ae912a0b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:40.145269 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fb9dc408-ecf3-44c4-af00-66d2ae912a0b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:40.153955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fb9dc408-ecf3-44c4-af00-66d2ae912a0b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.166413 Sep 01 05:38:40.154528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1163/2407] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:39 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:41.176215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-46d0742f-7cfc-40b3-9230-c06fc7d99209 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:41.176748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-46d0742f-7cfc-40b3-9230-c06fc7d99209 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:41.183674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d0742f-7cfc-40b3-9230-c06fc7d99209 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:41.184145 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d0742f-7cfc-40b3-9230-c06fc7d99209 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:41.184571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d0742f-7cfc-40b3-9230-c06fc7d99209 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:41.185273 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d0742f-7cfc-40b3-9230-c06fc7d99209 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:41.185717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d0742f-7cfc-40b3-9230-c06fc7d99209 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:41.186130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-46d0742f-7cfc-40b3-9230-c06fc7d99209 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:41.324995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-46d0742f-7cfc-40b3-9230-c06fc7d99209 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:41.333134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-46d0742f-7cfc-40b3-9230-c06fc7d99209 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.160857 Sep 01 05:38:41.333691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1245/2408] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:41 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:42.355621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-95fa6f4f-3178-4c64-bd72-443963420a67 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:42.356237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-95fa6f4f-3178-4c64-bd72-443963420a67 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:42.362660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-95fa6f4f-3178-4c64-bd72-443963420a67 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:42.363139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-95fa6f4f-3178-4c64-bd72-443963420a67 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:42.363573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-95fa6f4f-3178-4c64-bd72-443963420a67 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:42.364257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-95fa6f4f-3178-4c64-bd72-443963420a67 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:42.364710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-95fa6f4f-3178-4c64-bd72-443963420a67 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:42.365165 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-95fa6f4f-3178-4c64-bd72-443963420a67 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:42.492819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-95fa6f4f-3178-4c64-bd72-443963420a67 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:42.501185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-95fa6f4f-3178-4c64-bd72-443963420a67 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150112 Sep 01 05:38:42.501750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1164/2409] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:42 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:43.522551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a2f0079a-e212-4779-8360-26cf56ef797f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:43.523164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a2f0079a-e212-4779-8360-26cf56ef797f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:43.530238 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2f0079a-e212-4779-8360-26cf56ef797f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:43.530712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2f0079a-e212-4779-8360-26cf56ef797f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:43.531137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2f0079a-e212-4779-8360-26cf56ef797f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.531805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2f0079a-e212-4779-8360-26cf56ef797f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:43.532248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2f0079a-e212-4779-8360-26cf56ef797f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:43.532662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a2f0079a-e212-4779-8360-26cf56ef797f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.536733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=78 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:43.662288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a2f0079a-e212-4779-8360-26cf56ef797f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:43.670342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a2f0079a-e212-4779-8360-26cf56ef797f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151680 Sep 01 05:38:43.670899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1246/2410] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:43 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:44.691611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-14f5cf7a-c47c-403b-8996-29c462cc3685 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:44.692223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-14f5cf7a-c47c-403b-8996-29c462cc3685 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:44.698340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14f5cf7a-c47c-403b-8996-29c462cc3685 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:44.698816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14f5cf7a-c47c-403b-8996-29c462cc3685 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:44.699249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14f5cf7a-c47c-403b-8996-29c462cc3685 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:44.699965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14f5cf7a-c47c-403b-8996-29c462cc3685 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:44.700394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14f5cf7a-c47c-403b-8996-29c462cc3685 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:44.700833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-14f5cf7a-c47c-403b-8996-29c462cc3685 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:44.827224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-14f5cf7a-c47c-403b-8996-29c462cc3685 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:44.835390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-14f5cf7a-c47c-403b-8996-29c462cc3685 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.147804 Sep 01 05:38:44.835959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1165/2411] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:44 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:45.857946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fffaec93-5cc9-4132-9fbe-508d39d4cac9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:45.858495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fffaec93-5cc9-4132-9fbe-508d39d4cac9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:45.864882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fffaec93-5cc9-4132-9fbe-508d39d4cac9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:45.865367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fffaec93-5cc9-4132-9fbe-508d39d4cac9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:45.865807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fffaec93-5cc9-4132-9fbe-508d39d4cac9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:45.866492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fffaec93-5cc9-4132-9fbe-508d39d4cac9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:45.866948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fffaec93-5cc9-4132-9fbe-508d39d4cac9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:45.867371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fffaec93-5cc9-4132-9fbe-508d39d4cac9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:45.995884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fffaec93-5cc9-4132-9fbe-508d39d4cac9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:46.004056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fffaec93-5cc9-4132-9fbe-508d39d4cac9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150800 Sep 01 05:38:46.004626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1247/2412] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:45 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:47.025247 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-91b15e84-871f-4554-9821-b9a98d4764ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:47.025940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-91b15e84-871f-4554-9821-b9a98d4764ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:47.032488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91b15e84-871f-4554-9821-b9a98d4764ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:47.033009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91b15e84-871f-4554-9821-b9a98d4764ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:47.033443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91b15e84-871f-4554-9821-b9a98d4764ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:47.034394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91b15e84-871f-4554-9821-b9a98d4764ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:47.034841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91b15e84-871f-4554-9821-b9a98d4764ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:47.035261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-91b15e84-871f-4554-9821-b9a98d4764ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:47.162480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-91b15e84-871f-4554-9821-b9a98d4764ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:47.171340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-91b15e84-871f-4554-9821-b9a98d4764ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150123 Sep 01 05:38:47.171908 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1166/2413] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:47 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:48.192057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cd88e53b-e0ca-40ab-a0da-fcafae2f00eb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:48.192581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cd88e53b-e0ca-40ab-a0da-fcafae2f00eb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:48.199784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd88e53b-e0ca-40ab-a0da-fcafae2f00eb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:48.200268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd88e53b-e0ca-40ab-a0da-fcafae2f00eb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:48.200701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd88e53b-e0ca-40ab-a0da-fcafae2f00eb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:48.201417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd88e53b-e0ca-40ab-a0da-fcafae2f00eb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:48.201876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd88e53b-e0ca-40ab-a0da-fcafae2f00eb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:48.202299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cd88e53b-e0ca-40ab-a0da-fcafae2f00eb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:48.336300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cd88e53b-e0ca-40ab-a0da-fcafae2f00eb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:48.345423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cd88e53b-e0ca-40ab-a0da-fcafae2f00eb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.157292 Sep 01 05:38:48.346004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1248/2414] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:48 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:49.366671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ae50f967-b8c0-4c2e-9078-3b3fdd653918 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:49.367237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ae50f967-b8c0-4c2e-9078-3b3fdd653918 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:49.373758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae50f967-b8c0-4c2e-9078-3b3fdd653918 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:49.374233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae50f967-b8c0-4c2e-9078-3b3fdd653918 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:49.374665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae50f967-b8c0-4c2e-9078-3b3fdd653918 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:49.375344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae50f967-b8c0-4c2e-9078-3b3fdd653918 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:49.375793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae50f967-b8c0-4c2e-9078-3b3fdd653918 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:49.376211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ae50f967-b8c0-4c2e-9078-3b3fdd653918 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:49.503414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ae50f967-b8c0-4c2e-9078-3b3fdd653918 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:49.512214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ae50f967-b8c0-4c2e-9078-3b3fdd653918 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149522 Sep 01 05:38:49.512819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1167/2415] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:49 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:50.534375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-89867a96-c7d8-4938-850a-b7a6566fd1fa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:50.535042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-89867a96-c7d8-4938-850a-b7a6566fd1fa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:50.541417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89867a96-c7d8-4938-850a-b7a6566fd1fa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:50.541889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89867a96-c7d8-4938-850a-b7a6566fd1fa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:50.542315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89867a96-c7d8-4938-850a-b7a6566fd1fa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:50.542992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89867a96-c7d8-4938-850a-b7a6566fd1fa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:50.543434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89867a96-c7d8-4938-850a-b7a6566fd1fa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:50.543849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89867a96-c7d8-4938-850a-b7a6566fd1fa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:50.670685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-89867a96-c7d8-4938-850a-b7a6566fd1fa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:50.678721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-89867a96-c7d8-4938-850a-b7a6566fd1fa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148567 Sep 01 05:38:50.679283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1249/2416] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:50 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:51.700196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1e957580-85fa-4143-8b37-af2e3246167c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:51.700828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1e957580-85fa-4143-8b37-af2e3246167c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:51.707257 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1e957580-85fa-4143-8b37-af2e3246167c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:51.707734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1e957580-85fa-4143-8b37-af2e3246167c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:51.708163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1e957580-85fa-4143-8b37-af2e3246167c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:51.708868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1e957580-85fa-4143-8b37-af2e3246167c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:51.709316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1e957580-85fa-4143-8b37-af2e3246167c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:51.709736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1e957580-85fa-4143-8b37-af2e3246167c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:51.847429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1e957580-85fa-4143-8b37-af2e3246167c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:51.856509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1e957580-85fa-4143-8b37-af2e3246167c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.160817 Sep 01 05:38:51.857227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1168/2417] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:51 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:52.878055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8c473df1-2bd4-4d9b-9de3-0d9e41e239c1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:52.878664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8c473df1-2bd4-4d9b-9de3-0d9e41e239c1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:52.880947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=26 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:52.887348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c473df1-2bd4-4d9b-9de3-0d9e41e239c1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:52.887823 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c473df1-2bd4-4d9b-9de3-0d9e41e239c1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:52.888255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c473df1-2bd4-4d9b-9de3-0d9e41e239c1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:52.889017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c473df1-2bd4-4d9b-9de3-0d9e41e239c1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:52.889468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c473df1-2bd4-4d9b-9de3-0d9e41e239c1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:52.889888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8c473df1-2bd4-4d9b-9de3-0d9e41e239c1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:53.021205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8c473df1-2bd4-4d9b-9de3-0d9e41e239c1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:53.029821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8c473df1-2bd4-4d9b-9de3-0d9e41e239c1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155594 Sep 01 05:38:53.030396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1250/2418] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:52 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:54.051423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ab8b00bf-2551-4891-be09-bce3403647d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:54.052037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ab8b00bf-2551-4891-be09-bce3403647d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:54.054373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=26 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:54.060673 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab8b00bf-2551-4891-be09-bce3403647d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:54.061182 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab8b00bf-2551-4891-be09-bce3403647d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:54.061615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab8b00bf-2551-4891-be09-bce3403647d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:54.062297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab8b00bf-2551-4891-be09-bce3403647d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:54.062741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab8b00bf-2551-4891-be09-bce3403647d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:54.063161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ab8b00bf-2551-4891-be09-bce3403647d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:54.191113 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ab8b00bf-2551-4891-be09-bce3403647d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:54.200232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ab8b00bf-2551-4891-be09-bce3403647d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152647 Sep 01 05:38:54.200817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1169/2419] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:54 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:55.222431 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-04ec6a9d-70fb-42e6-b57c-2a1bbd1fed62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:55.222992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-04ec6a9d-70fb-42e6-b57c-2a1bbd1fed62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:55.230641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ec6a9d-70fb-42e6-b57c-2a1bbd1fed62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:55.231117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ec6a9d-70fb-42e6-b57c-2a1bbd1fed62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:55.231544 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ec6a9d-70fb-42e6-b57c-2a1bbd1fed62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:55.232210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ec6a9d-70fb-42e6-b57c-2a1bbd1fed62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:55.232659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ec6a9d-70fb-42e6-b57c-2a1bbd1fed62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:55.233097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ec6a9d-70fb-42e6-b57c-2a1bbd1fed62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:55.360149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-04ec6a9d-70fb-42e6-b57c-2a1bbd1fed62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:55.368355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-04ec6a9d-70fb-42e6-b57c-2a1bbd1fed62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150010 Sep 01 05:38:55.369453 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1251/2420] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:55 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:56.390430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2c49784e-2a44-4afb-90fe-172bfd85c3aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:56.391148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2c49784e-2a44-4afb-90fe-172bfd85c3aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:56.397553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c49784e-2a44-4afb-90fe-172bfd85c3aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:56.398304 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c49784e-2a44-4afb-90fe-172bfd85c3aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:56.398741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c49784e-2a44-4afb-90fe-172bfd85c3aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:56.399416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c49784e-2a44-4afb-90fe-172bfd85c3aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:56.399930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c49784e-2a44-4afb-90fe-172bfd85c3aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:56.400385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c49784e-2a44-4afb-90fe-172bfd85c3aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:56.531775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2c49784e-2a44-4afb-90fe-172bfd85c3aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:56.540844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2c49784e-2a44-4afb-90fe-172bfd85c3aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153963 Sep 01 05:38:56.541420 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1170/2421] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:56 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:57.561746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-605d3ac2-a33f-4d74-9007-682f6c39721a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:57.562385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-605d3ac2-a33f-4d74-9007-682f6c39721a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:57.568855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-605d3ac2-a33f-4d74-9007-682f6c39721a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:57.569340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-605d3ac2-a33f-4d74-9007-682f6c39721a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:57.569773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-605d3ac2-a33f-4d74-9007-682f6c39721a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:57.570457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-605d3ac2-a33f-4d74-9007-682f6c39721a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:57.570910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-605d3ac2-a33f-4d74-9007-682f6c39721a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:57.571334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-605d3ac2-a33f-4d74-9007-682f6c39721a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:57.702806 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-605d3ac2-a33f-4d74-9007-682f6c39721a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:57.711229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-605d3ac2-a33f-4d74-9007-682f6c39721a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153355 Sep 01 05:38:57.711788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1252/2422] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:57 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:58.732265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-904350d0-e8ea-4117-a5fd-174245995ebe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:58.732899 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-904350d0-e8ea-4117-a5fd-174245995ebe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:58.739425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-904350d0-e8ea-4117-a5fd-174245995ebe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:58.739896 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-904350d0-e8ea-4117-a5fd-174245995ebe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:58.740320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-904350d0-e8ea-4117-a5fd-174245995ebe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:58.741016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-904350d0-e8ea-4117-a5fd-174245995ebe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:58.741462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-904350d0-e8ea-4117-a5fd-174245995ebe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:58.741875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-904350d0-e8ea-4117-a5fd-174245995ebe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:58.867501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-904350d0-e8ea-4117-a5fd-174245995ebe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:58.876230 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-904350d0-e8ea-4117-a5fd-174245995ebe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.147997 Sep 01 05:38:58.876810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1171/2423] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:58 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:59.897072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4b296b4c-1b51-465c-9ebe-cc9351eb66b0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:59.897692 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4b296b4c-1b51-465c-9ebe-cc9351eb66b0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:59.904506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b296b4c-1b51-465c-9ebe-cc9351eb66b0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:59.905032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b296b4c-1b51-465c-9ebe-cc9351eb66b0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:59.905468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b296b4c-1b51-465c-9ebe-cc9351eb66b0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:59.906153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b296b4c-1b51-465c-9ebe-cc9351eb66b0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:59.906603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b296b4c-1b51-465c-9ebe-cc9351eb66b0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:59.907022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4b296b4c-1b51-465c-9ebe-cc9351eb66b0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:00.036144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4b296b4c-1b51-465c-9ebe-cc9351eb66b0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:00.044714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4b296b4c-1b51-465c-9ebe-cc9351eb66b0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151508 Sep 01 05:39:00.045321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1253/2424] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:59 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:01.065861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-07b1b6b2-1d7a-491d-85c1-bf36ec3f5898 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:01.066499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-07b1b6b2-1d7a-491d-85c1-bf36ec3f5898 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:01.073027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07b1b6b2-1d7a-491d-85c1-bf36ec3f5898 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:01.073697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07b1b6b2-1d7a-491d-85c1-bf36ec3f5898 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:01.074133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07b1b6b2-1d7a-491d-85c1-bf36ec3f5898 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:01.074804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07b1b6b2-1d7a-491d-85c1-bf36ec3f5898 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:01.075249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07b1b6b2-1d7a-491d-85c1-bf36ec3f5898 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:01.075666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07b1b6b2-1d7a-491d-85c1-bf36ec3f5898 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:01.204879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-07b1b6b2-1d7a-491d-85c1-bf36ec3f5898 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:01.212977 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-07b1b6b2-1d7a-491d-85c1-bf36ec3f5898 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150942 Sep 01 05:39:01.214196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1172/2425] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:01 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:02.235155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ccbbdbd8-9fa8-41af-80c8-6f71d4fabb50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:02.235698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ccbbdbd8-9fa8-41af-80c8-6f71d4fabb50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:02.242242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ccbbdbd8-9fa8-41af-80c8-6f71d4fabb50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:02.242824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ccbbdbd8-9fa8-41af-80c8-6f71d4fabb50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:02.243186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ccbbdbd8-9fa8-41af-80c8-6f71d4fabb50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:02.243873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ccbbdbd8-9fa8-41af-80c8-6f71d4fabb50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:02.244321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ccbbdbd8-9fa8-41af-80c8-6f71d4fabb50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:02.245424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ccbbdbd8-9fa8-41af-80c8-6f71d4fabb50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:02.375611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ccbbdbd8-9fa8-41af-80c8-6f71d4fabb50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:02.383761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ccbbdbd8-9fa8-41af-80c8-6f71d4fabb50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152688 Sep 01 05:39:02.384337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1254/2426] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:02 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:03.405650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-96dd368c-6f9d-48f4-947a-7f39fb09b432 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:03.406288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-96dd368c-6f9d-48f4-947a-7f39fb09b432 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:03.413036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96dd368c-6f9d-48f4-947a-7f39fb09b432 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:03.413515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96dd368c-6f9d-48f4-947a-7f39fb09b432 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:03.413947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96dd368c-6f9d-48f4-947a-7f39fb09b432 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:03.414623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96dd368c-6f9d-48f4-947a-7f39fb09b432 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:03.415072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96dd368c-6f9d-48f4-947a-7f39fb09b432 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:03.415488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-96dd368c-6f9d-48f4-947a-7f39fb09b432 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:03.544970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-96dd368c-6f9d-48f4-947a-7f39fb09b432 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:03.553092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-96dd368c-6f9d-48f4-947a-7f39fb09b432 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152123 Sep 01 05:39:03.553659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1173/2427] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:03 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:04.575156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e9802c7a-7d09-471e-92cc-ab898a49be6c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:04.575688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e9802c7a-7d09-471e-92cc-ab898a49be6c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:04.582170 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9802c7a-7d09-471e-92cc-ab898a49be6c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:04.582653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9802c7a-7d09-471e-92cc-ab898a49be6c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:04.583093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9802c7a-7d09-471e-92cc-ab898a49be6c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:04.583782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9802c7a-7d09-471e-92cc-ab898a49be6c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:04.584233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9802c7a-7d09-471e-92cc-ab898a49be6c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:04.584663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e9802c7a-7d09-471e-92cc-ab898a49be6c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:04.717552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e9802c7a-7d09-471e-92cc-ab898a49be6c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:04.725582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e9802c7a-7d09-471e-92cc-ab898a49be6c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154978 Sep 01 05:39:04.726142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1255/2428] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:04 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:39:05.747667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cef2958c-8a65-4cfa-b516-d9d920c85c5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:05.748273 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cef2958c-8a65-4cfa-b516-d9d920c85c5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:05.754727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cef2958c-8a65-4cfa-b516-d9d920c85c5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:05.755229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cef2958c-8a65-4cfa-b516-d9d920c85c5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:05.755655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cef2958c-8a65-4cfa-b516-d9d920c85c5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:05.756323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cef2958c-8a65-4cfa-b516-d9d920c85c5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:05.756763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cef2958c-8a65-4cfa-b516-d9d920c85c5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:05.757202 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cef2958c-8a65-4cfa-b516-d9d920c85c5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:05.759649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=78 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:05.888364 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cef2958c-8a65-4cfa-b516-d9d920c85c5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:05.896728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cef2958c-8a65-4cfa-b516-d9d920c85c5a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153493 Sep 01 05:39:05.897328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1174/2429] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:05 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:06.918403 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c41395d3-e00b-4be1-bc33-4d3e880a8f11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:06.919022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c41395d3-e00b-4be1-bc33-4d3e880a8f11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:06.925771 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c41395d3-e00b-4be1-bc33-4d3e880a8f11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:06.926281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c41395d3-e00b-4be1-bc33-4d3e880a8f11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:06.926717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c41395d3-e00b-4be1-bc33-4d3e880a8f11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:06.927462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c41395d3-e00b-4be1-bc33-4d3e880a8f11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:06.927909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c41395d3-e00b-4be1-bc33-4d3e880a8f11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:06.928358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c41395d3-e00b-4be1-bc33-4d3e880a8f11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:07.059207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c41395d3-e00b-4be1-bc33-4d3e880a8f11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:07.067324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c41395d3-e00b-4be1-bc33-4d3e880a8f11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153322 Sep 01 05:39:07.067878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1256/2430] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:06 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:08.087391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-807a6391-c21b-4084-bcf1-a78b56b151ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:08.088028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-807a6391-c21b-4084-bcf1-a78b56b151ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:08.095049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-807a6391-c21b-4084-bcf1-a78b56b151ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:08.095544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-807a6391-c21b-4084-bcf1-a78b56b151ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:08.095972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-807a6391-c21b-4084-bcf1-a78b56b151ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:08.096639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-807a6391-c21b-4084-bcf1-a78b56b151ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:08.097113 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-807a6391-c21b-4084-bcf1-a78b56b151ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:08.097528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-807a6391-c21b-4084-bcf1-a78b56b151ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:08.229075 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-807a6391-c21b-4084-bcf1-a78b56b151ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:08.237158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-807a6391-c21b-4084-bcf1-a78b56b151ff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153553 Sep 01 05:39:08.237722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1175/2431] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:08 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:09.258322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fcbe36a9-7f9a-41e0-a920-e10517d76732 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:09.258888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fcbe36a9-7f9a-41e0-a920-e10517d76732 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:09.265424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fcbe36a9-7f9a-41e0-a920-e10517d76732 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:09.265900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fcbe36a9-7f9a-41e0-a920-e10517d76732 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:09.266326 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fcbe36a9-7f9a-41e0-a920-e10517d76732 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:09.267005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fcbe36a9-7f9a-41e0-a920-e10517d76732 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:09.267448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fcbe36a9-7f9a-41e0-a920-e10517d76732 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:09.267863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fcbe36a9-7f9a-41e0-a920-e10517d76732 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:09.397519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fcbe36a9-7f9a-41e0-a920-e10517d76732 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:09.406310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fcbe36a9-7f9a-41e0-a920-e10517d76732 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152051 Sep 01 05:39:09.406867 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1257/2432] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:09 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:10.428371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6aea0fcd-1977-4eda-9f77-ce851696e714 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:10.429031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6aea0fcd-1977-4eda-9f77-ce851696e714 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:10.435745 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6aea0fcd-1977-4eda-9f77-ce851696e714 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:10.436235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6aea0fcd-1977-4eda-9f77-ce851696e714 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:10.436671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6aea0fcd-1977-4eda-9f77-ce851696e714 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:10.437385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6aea0fcd-1977-4eda-9f77-ce851696e714 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:10.437834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6aea0fcd-1977-4eda-9f77-ce851696e714 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:10.438261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6aea0fcd-1977-4eda-9f77-ce851696e714 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:10.567214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6aea0fcd-1977-4eda-9f77-ce851696e714 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:10.576162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6aea0fcd-1977-4eda-9f77-ce851696e714 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151708 Sep 01 05:39:10.576728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1176/2433] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:10 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:11.597069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bacbbf26-c8fe-46c4-9e33-3f353993fd17 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:11.597599 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bacbbf26-c8fe-46c4-9e33-3f353993fd17 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:11.604568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bacbbf26-c8fe-46c4-9e33-3f353993fd17 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:11.605083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bacbbf26-c8fe-46c4-9e33-3f353993fd17 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:11.605515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bacbbf26-c8fe-46c4-9e33-3f353993fd17 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:11.606220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bacbbf26-c8fe-46c4-9e33-3f353993fd17 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:11.606667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bacbbf26-c8fe-46c4-9e33-3f353993fd17 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:11.607085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bacbbf26-c8fe-46c4-9e33-3f353993fd17 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:11.734269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bacbbf26-c8fe-46c4-9e33-3f353993fd17 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:11.742365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bacbbf26-c8fe-46c4-9e33-3f353993fd17 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149250 Sep 01 05:39:11.742935 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1258/2434] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:11 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:12.765167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c2e90781-618b-4d1e-9ed8-3f851e18d221 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:12.765786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c2e90781-618b-4d1e-9ed8-3f851e18d221 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:12.771997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2e90781-618b-4d1e-9ed8-3f851e18d221 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:12.772477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2e90781-618b-4d1e-9ed8-3f851e18d221 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:12.772942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2e90781-618b-4d1e-9ed8-3f851e18d221 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:12.773625 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2e90781-618b-4d1e-9ed8-3f851e18d221 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:12.774071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2e90781-618b-4d1e-9ed8-3f851e18d221 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:12.774490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c2e90781-618b-4d1e-9ed8-3f851e18d221 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:12.920209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c2e90781-618b-4d1e-9ed8-3f851e18d221 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:12.929038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c2e90781-618b-4d1e-9ed8-3f851e18d221 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.169274 Sep 01 05:39:12.929619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1177/2435] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:12 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:13.954156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-49fcc928-85f9-4965-acce-e3b370126849 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:13.954775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-49fcc928-85f9-4965-acce-e3b370126849 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:13.961184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-49fcc928-85f9-4965-acce-e3b370126849 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:13.961662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-49fcc928-85f9-4965-acce-e3b370126849 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:13.962096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-49fcc928-85f9-4965-acce-e3b370126849 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:13.962781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-49fcc928-85f9-4965-acce-e3b370126849 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:13.963831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-49fcc928-85f9-4965-acce-e3b370126849 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:13.964342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-49fcc928-85f9-4965-acce-e3b370126849 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:13.968021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=78 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:14.092343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-49fcc928-85f9-4965-acce-e3b370126849 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:14.100427 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-49fcc928-85f9-4965-acce-e3b370126849 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150161 Sep 01 05:39:14.101014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1259/2436] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:13 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:15.123098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-336739b2-417b-4508-9210-b58a1bbc3262 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:15.123709 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-336739b2-417b-4508-9210-b58a1bbc3262 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:15.130160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-336739b2-417b-4508-9210-b58a1bbc3262 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:15.130636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-336739b2-417b-4508-9210-b58a1bbc3262 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:15.131060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-336739b2-417b-4508-9210-b58a1bbc3262 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:15.131735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-336739b2-417b-4508-9210-b58a1bbc3262 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:15.132177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-336739b2-417b-4508-9210-b58a1bbc3262 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:15.132591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-336739b2-417b-4508-9210-b58a1bbc3262 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:15.260718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-336739b2-417b-4508-9210-b58a1bbc3262 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:15.268872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-336739b2-417b-4508-9210-b58a1bbc3262 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150438 Sep 01 05:39:15.269438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1178/2437] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:15 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:16.290797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f94c2bdf-6ece-47ad-81d5-cd2265b98f7b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:16.291429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f94c2bdf-6ece-47ad-81d5-cd2265b98f7b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:16.298292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f94c2bdf-6ece-47ad-81d5-cd2265b98f7b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:16.298767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f94c2bdf-6ece-47ad-81d5-cd2265b98f7b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:16.299194 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f94c2bdf-6ece-47ad-81d5-cd2265b98f7b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:16.299872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f94c2bdf-6ece-47ad-81d5-cd2265b98f7b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:16.300315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f94c2bdf-6ece-47ad-81d5-cd2265b98f7b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:16.300731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f94c2bdf-6ece-47ad-81d5-cd2265b98f7b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:16.432384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f94c2bdf-6ece-47ad-81d5-cd2265b98f7b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:16.440509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f94c2bdf-6ece-47ad-81d5-cd2265b98f7b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153618 Sep 01 05:39:16.441097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1260/2438] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:16 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:17.462044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2c4e49fe-ac59-451a-8bac-ccf0d18c051d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:17.462639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2c4e49fe-ac59-451a-8bac-ccf0d18c051d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:17.469750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c4e49fe-ac59-451a-8bac-ccf0d18c051d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:17.470226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c4e49fe-ac59-451a-8bac-ccf0d18c051d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:17.470696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c4e49fe-ac59-451a-8bac-ccf0d18c051d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:17.471395 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c4e49fe-ac59-451a-8bac-ccf0d18c051d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:17.471835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c4e49fe-ac59-451a-8bac-ccf0d18c051d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:17.472249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c4e49fe-ac59-451a-8bac-ccf0d18c051d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:17.598057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2c4e49fe-ac59-451a-8bac-ccf0d18c051d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:17.606418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2c4e49fe-ac59-451a-8bac-ccf0d18c051d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148254 Sep 01 05:39:17.607000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1179/2439] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:17 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:18.627730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d4ee3c4a-b6c6-4d77-974b-5cea800b72cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:18.628367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d4ee3c4a-b6c6-4d77-974b-5cea800b72cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:18.635895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d4ee3c4a-b6c6-4d77-974b-5cea800b72cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:18.636389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d4ee3c4a-b6c6-4d77-974b-5cea800b72cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:18.636866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d4ee3c4a-b6c6-4d77-974b-5cea800b72cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:18.637539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d4ee3c4a-b6c6-4d77-974b-5cea800b72cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:18.637987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d4ee3c4a-b6c6-4d77-974b-5cea800b72cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:18.638400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d4ee3c4a-b6c6-4d77-974b-5cea800b72cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:18.767227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d4ee3c4a-b6c6-4d77-974b-5cea800b72cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:18.775347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d4ee3c4a-b6c6-4d77-974b-5cea800b72cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151497 Sep 01 05:39:18.776602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1261/2440] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:18 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:19.797353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3f5c1cde-9a48-43a0-aa38-797256f6e4a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:19.797968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3f5c1cde-9a48-43a0-aa38-797256f6e4a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:19.804340 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f5c1cde-9a48-43a0-aa38-797256f6e4a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:19.804835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f5c1cde-9a48-43a0-aa38-797256f6e4a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:19.805269 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f5c1cde-9a48-43a0-aa38-797256f6e4a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:19.805944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f5c1cde-9a48-43a0-aa38-797256f6e4a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:19.806389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f5c1cde-9a48-43a0-aa38-797256f6e4a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:19.806805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3f5c1cde-9a48-43a0-aa38-797256f6e4a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:19.938512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3f5c1cde-9a48-43a0-aa38-797256f6e4a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:19.946677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3f5c1cde-9a48-43a0-aa38-797256f6e4a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153255 Sep 01 05:39:19.947240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1180/2441] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:19 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:20.970724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7fb5f5d4-4d21-4e4e-8188-c450683bbe5e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:20.971377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7fb5f5d4-4d21-4e4e-8188-c450683bbe5e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:20.977865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7fb5f5d4-4d21-4e4e-8188-c450683bbe5e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:20.978345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7fb5f5d4-4d21-4e4e-8188-c450683bbe5e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:20.978784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7fb5f5d4-4d21-4e4e-8188-c450683bbe5e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:20.979469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7fb5f5d4-4d21-4e4e-8188-c450683bbe5e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:20.979927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7fb5f5d4-4d21-4e4e-8188-c450683bbe5e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:20.980353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7fb5f5d4-4d21-4e4e-8188-c450683bbe5e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:21.111201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7fb5f5d4-4d21-4e4e-8188-c450683bbe5e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:21.119335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7fb5f5d4-4d21-4e4e-8188-c450683bbe5e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152506 Sep 01 05:39:21.119902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1262/2442] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:20 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:22.140351 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-035413dc-b1bd-4184-8b30-680ee603b90e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:22.140991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-035413dc-b1bd-4184-8b30-680ee603b90e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:22.147574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-035413dc-b1bd-4184-8b30-680ee603b90e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:22.147994 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-035413dc-b1bd-4184-8b30-680ee603b90e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:22.148424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-035413dc-b1bd-4184-8b30-680ee603b90e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:22.149130 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-035413dc-b1bd-4184-8b30-680ee603b90e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:22.149577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-035413dc-b1bd-4184-8b30-680ee603b90e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:22.149996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-035413dc-b1bd-4184-8b30-680ee603b90e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:22.280888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-035413dc-b1bd-4184-8b30-680ee603b90e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:22.289379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-035413dc-b1bd-4184-8b30-680ee603b90e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153840 Sep 01 05:39:22.289937 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1181/2443] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:22 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:23.312159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9a50a5a2-4e5f-4759-a6e4-fd6a3c49699c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:23.312697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9a50a5a2-4e5f-4759-a6e4-fd6a3c49699c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:23.314960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=26 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:23.320073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a50a5a2-4e5f-4759-a6e4-fd6a3c49699c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:23.320550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a50a5a2-4e5f-4759-a6e4-fd6a3c49699c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:23.321072 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a50a5a2-4e5f-4759-a6e4-fd6a3c49699c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:23.321749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a50a5a2-4e5f-4759-a6e4-fd6a3c49699c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:23.322190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a50a5a2-4e5f-4759-a6e4-fd6a3c49699c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:23.322604 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9a50a5a2-4e5f-4759-a6e4-fd6a3c49699c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:23.455643 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9a50a5a2-4e5f-4759-a6e4-fd6a3c49699c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:23.463683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9a50a5a2-4e5f-4759-a6e4-fd6a3c49699c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155473 Sep 01 05:39:23.464284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1263/2444] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:23 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:24.483921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-247b84c8-5218-442e-8c76-aa83a3885a46 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:24.485146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-247b84c8-5218-442e-8c76-aa83a3885a46 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:24.487486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=26 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:24.492872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-247b84c8-5218-442e-8c76-aa83a3885a46 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:24.493356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-247b84c8-5218-442e-8c76-aa83a3885a46 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:24.493789 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-247b84c8-5218-442e-8c76-aa83a3885a46 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:24.494522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-247b84c8-5218-442e-8c76-aa83a3885a46 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:24.494965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-247b84c8-5218-442e-8c76-aa83a3885a46 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:24.495909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-247b84c8-5218-442e-8c76-aa83a3885a46 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:24.626466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-247b84c8-5218-442e-8c76-aa83a3885a46 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:24.634602 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-247b84c8-5218-442e-8c76-aa83a3885a46 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154719 Sep 01 05:39:24.635162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1182/2445] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:24 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:25.656272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-86eda80e-1700-42b3-aa1f-9c42b9c2a019 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:25.656912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-86eda80e-1700-42b3-aa1f-9c42b9c2a019 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:25.663713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86eda80e-1700-42b3-aa1f-9c42b9c2a019 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:25.664190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86eda80e-1700-42b3-aa1f-9c42b9c2a019 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:25.664620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86eda80e-1700-42b3-aa1f-9c42b9c2a019 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:25.665332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86eda80e-1700-42b3-aa1f-9c42b9c2a019 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:25.665773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86eda80e-1700-42b3-aa1f-9c42b9c2a019 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:25.666187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-86eda80e-1700-42b3-aa1f-9c42b9c2a019 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:25.799448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-86eda80e-1700-42b3-aa1f-9c42b9c2a019 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:25.808423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-86eda80e-1700-42b3-aa1f-9c42b9c2a019 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156267 Sep 01 05:39:25.809115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1264/2446] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:25 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:26.830626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-45beef51-0118-4f0c-9a43-ee7acf748c0d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:26.831237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-45beef51-0118-4f0c-9a43-ee7acf748c0d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:26.837649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45beef51-0118-4f0c-9a43-ee7acf748c0d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:26.838117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45beef51-0118-4f0c-9a43-ee7acf748c0d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:26.838540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45beef51-0118-4f0c-9a43-ee7acf748c0d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:26.839233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45beef51-0118-4f0c-9a43-ee7acf748c0d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:26.839680 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45beef51-0118-4f0c-9a43-ee7acf748c0d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:26.840089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-45beef51-0118-4f0c-9a43-ee7acf748c0d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:26.969297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-45beef51-0118-4f0c-9a43-ee7acf748c0d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:26.977418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-45beef51-0118-4f0c-9a43-ee7acf748c0d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150712 Sep 01 05:39:26.977989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1183/2447] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:26 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:27.999195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7439015b-f648-4ea3-b833-df8e3949c3a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:27.999814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7439015b-f648-4ea3-b833-df8e3949c3a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:28.006219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7439015b-f648-4ea3-b833-df8e3949c3a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:28.006703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7439015b-f648-4ea3-b833-df8e3949c3a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:28.007142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7439015b-f648-4ea3-b833-df8e3949c3a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:28.007828 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7439015b-f648-4ea3-b833-df8e3949c3a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:28.008310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7439015b-f648-4ea3-b833-df8e3949c3a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:28.008736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7439015b-f648-4ea3-b833-df8e3949c3a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:28.138064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7439015b-f648-4ea3-b833-df8e3949c3a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:28.146184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7439015b-f648-4ea3-b833-df8e3949c3a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150954 Sep 01 05:39:28.146678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1265/2448] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:27 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:29.168344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3018755f-29e1-48f7-a7f0-5ef2477b3927 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:29.168989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3018755f-29e1-48f7-a7f0-5ef2477b3927 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:29.175342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3018755f-29e1-48f7-a7f0-5ef2477b3927 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:29.176506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3018755f-29e1-48f7-a7f0-5ef2477b3927 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:29.177016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3018755f-29e1-48f7-a7f0-5ef2477b3927 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:29.177713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3018755f-29e1-48f7-a7f0-5ef2477b3927 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:29.178162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3018755f-29e1-48f7-a7f0-5ef2477b3927 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:29.178578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3018755f-29e1-48f7-a7f0-5ef2477b3927 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:29.306523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3018755f-29e1-48f7-a7f0-5ef2477b3927 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:29.315294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3018755f-29e1-48f7-a7f0-5ef2477b3927 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151464 Sep 01 05:39:29.315853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1184/2449] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:29 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:30.335599 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-293f819f-f38a-4259-9254-306481f53e38 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:30.336138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-293f819f-f38a-4259-9254-306481f53e38 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:30.342652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-293f819f-f38a-4259-9254-306481f53e38 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:30.343136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-293f819f-f38a-4259-9254-306481f53e38 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:30.343571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-293f819f-f38a-4259-9254-306481f53e38 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:30.344261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-293f819f-f38a-4259-9254-306481f53e38 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:30.344715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-293f819f-f38a-4259-9254-306481f53e38 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:30.345163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-293f819f-f38a-4259-9254-306481f53e38 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:30.474215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-293f819f-f38a-4259-9254-306481f53e38 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:30.483084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-293f819f-f38a-4259-9254-306481f53e38 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151508 Sep 01 05:39:30.483654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1266/2450] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:30 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:31.504826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-aa4f92ef-d4ea-4094-a646-22dc3cb888cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:31.505442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-aa4f92ef-d4ea-4094-a646-22dc3cb888cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:31.512360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa4f92ef-d4ea-4094-a646-22dc3cb888cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:31.512900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa4f92ef-d4ea-4094-a646-22dc3cb888cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:31.513336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa4f92ef-d4ea-4094-a646-22dc3cb888cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:31.514016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa4f92ef-d4ea-4094-a646-22dc3cb888cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:31.514467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa4f92ef-d4ea-4094-a646-22dc3cb888cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:31.514923 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa4f92ef-d4ea-4094-a646-22dc3cb888cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:31.645967 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-aa4f92ef-d4ea-4094-a646-22dc3cb888cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:31.655067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-aa4f92ef-d4ea-4094-a646-22dc3cb888cd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154071 Sep 01 05:39:31.655634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1185/2451] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:31 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:32.677114 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1273a03c-ec4b-43c9-8608-0cd32d08b51e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:32.677723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1273a03c-ec4b-43c9-8608-0cd32d08b51e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:32.684628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1273a03c-ec4b-43c9-8608-0cd32d08b51e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:32.685124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1273a03c-ec4b-43c9-8608-0cd32d08b51e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:32.685553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1273a03c-ec4b-43c9-8608-0cd32d08b51e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:32.686222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1273a03c-ec4b-43c9-8608-0cd32d08b51e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:32.686666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1273a03c-ec4b-43c9-8608-0cd32d08b51e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:32.687081 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1273a03c-ec4b-43c9-8608-0cd32d08b51e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:32.816981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1273a03c-ec4b-43c9-8608-0cd32d08b51e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:32.825203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1273a03c-ec4b-43c9-8608-0cd32d08b51e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151893 Sep 01 05:39:32.825776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1267/2452] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:32 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:33.851084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-72f2bf97-a354-4843-a00a-cc896431fee7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:33.851692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-72f2bf97-a354-4843-a00a-cc896431fee7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:33.854213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:39:33.854363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 (ip 10.222.0.49) !!! Sep 01 05:39:33.860439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72f2bf97-a354-4843-a00a-cc896431fee7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:33.860948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72f2bf97-a354-4843-a00a-cc896431fee7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:33.861386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72f2bf97-a354-4843-a00a-cc896431fee7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:33.862068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72f2bf97-a354-4843-a00a-cc896431fee7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:33.862515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72f2bf97-a354-4843-a00a-cc896431fee7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:33.862932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-72f2bf97-a354-4843-a00a-cc896431fee7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:33.991650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-72f2bf97-a354-4843-a00a-cc896431fee7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:34.000157 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-72f2bf97-a354-4843-a00a-cc896431fee7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152908 Sep 01 05:39:34.000723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1186/2453] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:33 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:35.021606 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1e097804-846e-484d-89e2-36f6cb5d23e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:35.022175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1e097804-846e-484d-89e2-36f6cb5d23e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:35.024595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:39:35.024757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:39:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 (ip 10.222.0.49) !!! Sep 01 05:39:35.033236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e097804-846e-484d-89e2-36f6cb5d23e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:35.033976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e097804-846e-484d-89e2-36f6cb5d23e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:35.034409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e097804-846e-484d-89e2-36f6cb5d23e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:35.035242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e097804-846e-484d-89e2-36f6cb5d23e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:35.035691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e097804-846e-484d-89e2-36f6cb5d23e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:35.036112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1e097804-846e-484d-89e2-36f6cb5d23e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:35.165097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1e097804-846e-484d-89e2-36f6cb5d23e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:35.173578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1e097804-846e-484d-89e2-36f6cb5d23e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155955 Sep 01 05:39:35.174144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1268/2454] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:35 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:36.195139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0f9772c1-9173-4f1a-92a8-c8b2fb83a230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:36.195754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0f9772c1-9173-4f1a-92a8-c8b2fb83a230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:36.202605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f9772c1-9173-4f1a-92a8-c8b2fb83a230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:36.203092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f9772c1-9173-4f1a-92a8-c8b2fb83a230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:36.203525 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f9772c1-9173-4f1a-92a8-c8b2fb83a230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:36.204211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f9772c1-9173-4f1a-92a8-c8b2fb83a230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:36.204664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f9772c1-9173-4f1a-92a8-c8b2fb83a230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:36.205135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0f9772c1-9173-4f1a-92a8-c8b2fb83a230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:36.209078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=78 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:36.335798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0f9772c1-9173-4f1a-92a8-c8b2fb83a230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:36.344964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0f9772c1-9173-4f1a-92a8-c8b2fb83a230 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153662 Sep 01 05:39:36.345528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1187/2455] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:36 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:37.366006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e6e4943f-562d-42f3-946c-9e2afa0dfc22 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:37.366615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e6e4943f-562d-42f3-946c-9e2afa0dfc22 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:37.373803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6e4943f-562d-42f3-946c-9e2afa0dfc22 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:37.374275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6e4943f-562d-42f3-946c-9e2afa0dfc22 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:37.374701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6e4943f-562d-42f3-946c-9e2afa0dfc22 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:37.375369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6e4943f-562d-42f3-946c-9e2afa0dfc22 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:37.375811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6e4943f-562d-42f3-946c-9e2afa0dfc22 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:37.376224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e6e4943f-562d-42f3-946c-9e2afa0dfc22 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:37.505122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e6e4943f-562d-42f3-946c-9e2afa0dfc22 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:37.513450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e6e4943f-562d-42f3-946c-9e2afa0dfc22 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151331 Sep 01 05:39:37.514005 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1269/2456] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:37 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:38.534210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-967598ce-812d-4ce3-845f-027ba191efff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:38.534938 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-967598ce-812d-4ce3-845f-027ba191efff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:38.541339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-967598ce-812d-4ce3-845f-027ba191efff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:38.541814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-967598ce-812d-4ce3-845f-027ba191efff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:38.542250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-967598ce-812d-4ce3-845f-027ba191efff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:38.544026 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-967598ce-812d-4ce3-845f-027ba191efff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:38.544477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-967598ce-812d-4ce3-845f-027ba191efff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:38.544947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-967598ce-812d-4ce3-845f-027ba191efff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:38.677230 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-967598ce-812d-4ce3-845f-027ba191efff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:38.685987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-967598ce-812d-4ce3-845f-027ba191efff tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155910 Sep 01 05:39:38.686548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1188/2457] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:38 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:39.706785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-277a2f78-66bf-45e4-af82-6c9862a1ae14 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:39.707373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-277a2f78-66bf-45e4-af82-6c9862a1ae14 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:39.713539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-277a2f78-66bf-45e4-af82-6c9862a1ae14 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:39.714010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-277a2f78-66bf-45e4-af82-6c9862a1ae14 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:39.714946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-277a2f78-66bf-45e4-af82-6c9862a1ae14 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:39.715616 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-277a2f78-66bf-45e4-af82-6c9862a1ae14 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:39.716057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-277a2f78-66bf-45e4-af82-6c9862a1ae14 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:39.716469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-277a2f78-66bf-45e4-af82-6c9862a1ae14 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:39.844536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-277a2f78-66bf-45e4-af82-6c9862a1ae14 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:39.852591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-277a2f78-66bf-45e4-af82-6c9862a1ae14 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149623 Sep 01 05:39:39.853179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1270/2458] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:39 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:40.875658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c0146ee8-9448-4fe0-baa1-6127de10e55e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:40.876270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c0146ee8-9448-4fe0-baa1-6127de10e55e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:40.882733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0146ee8-9448-4fe0-baa1-6127de10e55e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:40.883209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0146ee8-9448-4fe0-baa1-6127de10e55e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:40.883642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0146ee8-9448-4fe0-baa1-6127de10e55e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:40.884316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0146ee8-9448-4fe0-baa1-6127de10e55e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:40.884764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0146ee8-9448-4fe0-baa1-6127de10e55e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:40.885203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0146ee8-9448-4fe0-baa1-6127de10e55e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:41.020991 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c0146ee8-9448-4fe0-baa1-6127de10e55e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:41.029197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c0146ee8-9448-4fe0-baa1-6127de10e55e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.157995 Sep 01 05:39:41.029759 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1189/2459] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:40 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:42.051533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-523347b1-2225-46bc-b134-de85154f4623 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:42.052139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-523347b1-2225-46bc-b134-de85154f4623 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:42.059282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-523347b1-2225-46bc-b134-de85154f4623 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:42.059759 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-523347b1-2225-46bc-b134-de85154f4623 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:42.060187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-523347b1-2225-46bc-b134-de85154f4623 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:42.060882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-523347b1-2225-46bc-b134-de85154f4623 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:42.061341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-523347b1-2225-46bc-b134-de85154f4623 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:42.061751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-523347b1-2225-46bc-b134-de85154f4623 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:42.188694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-523347b1-2225-46bc-b134-de85154f4623 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:42.196804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-523347b1-2225-46bc-b134-de85154f4623 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149116 Sep 01 05:39:42.197370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1271/2460] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:42 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:43.218612 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2dedfed0-a3cc-4084-a5d6-aa0890787ce5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:43.219271 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2dedfed0-a3cc-4084-a5d6-aa0890787ce5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:43.221144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:39:43.221287 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:39:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 (ip 10.222.0.49) !!! Sep 01 05:39:43.227426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2dedfed0-a3cc-4084-a5d6-aa0890787ce5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:43.227905 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2dedfed0-a3cc-4084-a5d6-aa0890787ce5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:43.228367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2dedfed0-a3cc-4084-a5d6-aa0890787ce5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:43.229068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2dedfed0-a3cc-4084-a5d6-aa0890787ce5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:43.229514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2dedfed0-a3cc-4084-a5d6-aa0890787ce5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:43.230438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2dedfed0-a3cc-4084-a5d6-aa0890787ce5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:43.361020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2dedfed0-a3cc-4084-a5d6-aa0890787ce5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:43.369128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2dedfed0-a3cc-4084-a5d6-aa0890787ce5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154554 Sep 01 05:39:43.369662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1190/2461] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:43 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:44.390808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-97253103-e29c-45a3-b1a0-2373e912fb70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:44.391516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-97253103-e29c-45a3-b1a0-2373e912fb70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:44.398768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97253103-e29c-45a3-b1a0-2373e912fb70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:44.399163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97253103-e29c-45a3-b1a0-2373e912fb70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:44.399732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97253103-e29c-45a3-b1a0-2373e912fb70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:44.400459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97253103-e29c-45a3-b1a0-2373e912fb70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:44.401030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97253103-e29c-45a3-b1a0-2373e912fb70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:44.401494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97253103-e29c-45a3-b1a0-2373e912fb70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:44.404215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=78 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:44.533404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-97253103-e29c-45a3-b1a0-2373e912fb70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:44.541808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-97253103-e29c-45a3-b1a0-2373e912fb70 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155991 Sep 01 05:39:44.542854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1272/2462] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:44 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:45.563348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fb54c9d8-a49e-4582-ba84-54e3f9db500d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:45.563958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fb54c9d8-a49e-4582-ba84-54e3f9db500d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:45.570412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb54c9d8-a49e-4582-ba84-54e3f9db500d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:45.570825 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb54c9d8-a49e-4582-ba84-54e3f9db500d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:45.571251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb54c9d8-a49e-4582-ba84-54e3f9db500d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:45.571928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb54c9d8-a49e-4582-ba84-54e3f9db500d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:45.572370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb54c9d8-a49e-4582-ba84-54e3f9db500d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:45.572799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fb54c9d8-a49e-4582-ba84-54e3f9db500d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:45.787285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fb54c9d8-a49e-4582-ba84-54e3f9db500d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:45.796131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fb54c9d8-a49e-4582-ba84-54e3f9db500d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.236609 Sep 01 05:39:45.796698 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1191/2463] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:45 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:46.817279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-635ff691-2ecf-4041-b6c8-593580e4dced tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:46.817901 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-635ff691-2ecf-4041-b6c8-593580e4dced tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:46.824528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-635ff691-2ecf-4041-b6c8-593580e4dced tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:46.825044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-635ff691-2ecf-4041-b6c8-593580e4dced tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:46.825482 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-635ff691-2ecf-4041-b6c8-593580e4dced tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:46.826163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-635ff691-2ecf-4041-b6c8-593580e4dced tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:46.826615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-635ff691-2ecf-4041-b6c8-593580e4dced tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:46.827045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-635ff691-2ecf-4041-b6c8-593580e4dced tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:47.052108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-635ff691-2ecf-4041-b6c8-593580e4dced tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:47.060841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-635ff691-2ecf-4041-b6c8-593580e4dced tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.247520 Sep 01 05:39:47.061400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1273/2464] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:46 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:48.082004 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-94213c5b-1610-4572-9b20-dd2ef9727fd2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:48.082641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-94213c5b-1610-4572-9b20-dd2ef9727fd2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:48.089163 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94213c5b-1610-4572-9b20-dd2ef9727fd2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:48.089418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94213c5b-1610-4572-9b20-dd2ef9727fd2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:48.089847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94213c5b-1610-4572-9b20-dd2ef9727fd2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:48.090526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94213c5b-1610-4572-9b20-dd2ef9727fd2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:48.090969 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94213c5b-1610-4572-9b20-dd2ef9727fd2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:48.091383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94213c5b-1610-4572-9b20-dd2ef9727fd2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:48.287587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-94213c5b-1610-4572-9b20-dd2ef9727fd2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:48.296449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-94213c5b-1610-4572-9b20-dd2ef9727fd2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.218294 Sep 01 05:39:48.297061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1192/2465] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:48 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:49.317859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-316408d5-66e9-49db-b886-61d756cc1fc2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:49.318473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-316408d5-66e9-49db-b886-61d756cc1fc2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:49.325715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-316408d5-66e9-49db-b886-61d756cc1fc2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:49.326191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-316408d5-66e9-49db-b886-61d756cc1fc2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:49.326627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-316408d5-66e9-49db-b886-61d756cc1fc2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:49.327305 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-316408d5-66e9-49db-b886-61d756cc1fc2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:49.327758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-316408d5-66e9-49db-b886-61d756cc1fc2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:49.328180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-316408d5-66e9-49db-b886-61d756cc1fc2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:49.458141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-316408d5-66e9-49db-b886-61d756cc1fc2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:49.466712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-316408d5-66e9-49db-b886-61d756cc1fc2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152706 Sep 01 05:39:49.467279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1274/2466] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:49 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:49.999505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-23741d09-7447-43b5-ac65-64677bb2855c req-d2b8b14c-ef00-4144-a549-cbf63fa37f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd99adb-f38e-4d43-82b1-529010509f72", "name": "network-vif-deleted", "tag": "7ce60b54-510b-440d-9175-fd0f98028fab"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:50.009372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-23741d09-7447-43b5-ac65-64677bb2855c req-d2b8b14c-ef00-4144-a549-cbf63fa37f8a service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:50.009849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-23741d09-7447-43b5-ac65-64677bb2855c req-d2b8b14c-ef00-4144-a549-cbf63fa37f8a service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:50.010269 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-23741d09-7447-43b5-ac65-64677bb2855c req-d2b8b14c-ef00-4144-a549-cbf63fa37f8a service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:50.021988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-23741d09-7447-43b5-ac65-64677bb2855c req-d2b8b14c-ef00-4144-a549-cbf63fa37f8a service nova] Creating event network-vif-deleted:7ce60b54-510b-440d-9175-fd0f98028fab for instance 5fd99adb-f38e-4d43-82b1-529010509f72 on hv-cinder-85391 Sep 01 05:39:50.027486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-23741d09-7447-43b5-ac65-64677bb2855c req-d2b8b14c-ef00-4144-a549-cbf63fa37f8a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032291 Sep 01 05:39:50.028090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1193/2467] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:50.487736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4eb98783-3657-487e-a20e-32b9d76aa0c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:50.488347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4eb98783-3657-487e-a20e-32b9d76aa0c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:50.494664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4eb98783-3657-487e-a20e-32b9d76aa0c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:50.495137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4eb98783-3657-487e-a20e-32b9d76aa0c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:50.495566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4eb98783-3657-487e-a20e-32b9d76aa0c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:50.496333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4eb98783-3657-487e-a20e-32b9d76aa0c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:50.496804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4eb98783-3657-487e-a20e-32b9d76aa0c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:50.497220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4eb98783-3657-487e-a20e-32b9d76aa0c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:50.624483 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4eb98783-3657-487e-a20e-32b9d76aa0c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:50.632586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4eb98783-3657-487e-a20e-32b9d76aa0c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148780 Sep 01 05:39:50.633186 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1275/2468] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:50 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:51.656092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5f475806-d8b1-47b8-bfe0-ecfbe313ed71 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:51.656819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5f475806-d8b1-47b8-bfe0-ecfbe313ed71 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:51.663209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5f475806-d8b1-47b8-bfe0-ecfbe313ed71 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:51.663691 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5f475806-d8b1-47b8-bfe0-ecfbe313ed71 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:51.664125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5f475806-d8b1-47b8-bfe0-ecfbe313ed71 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:51.664814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5f475806-d8b1-47b8-bfe0-ecfbe313ed71 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:51.665265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5f475806-d8b1-47b8-bfe0-ecfbe313ed71 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:51.665685 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5f475806-d8b1-47b8-bfe0-ecfbe313ed71 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:51.795114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5f475806-d8b1-47b8-bfe0-ecfbe313ed71 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:51.810914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5f475806-d8b1-47b8-bfe0-ecfbe313ed71 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.160526 Sep 01 05:39:51.811493 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1194/2469] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:51 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:52.833552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4addf4f0-7b7a-4a9b-af32-c8410ed3baf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:52.834093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4addf4f0-7b7a-4a9b-af32-c8410ed3baf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:52.840796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4addf4f0-7b7a-4a9b-af32-c8410ed3baf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:52.841279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4addf4f0-7b7a-4a9b-af32-c8410ed3baf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:52.841718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4addf4f0-7b7a-4a9b-af32-c8410ed3baf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:52.842411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4addf4f0-7b7a-4a9b-af32-c8410ed3baf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:52.842866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4addf4f0-7b7a-4a9b-af32-c8410ed3baf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:52.843289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4addf4f0-7b7a-4a9b-af32-c8410ed3baf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:52.975687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4addf4f0-7b7a-4a9b-af32-c8410ed3baf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:52.984885 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4addf4f0-7b7a-4a9b-af32-c8410ed3baf5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155163 Sep 01 05:39:52.985461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1276/2470] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:52 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:54.006094 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d409ae96-716c-4e92-a444-5623fd0980b1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:54.006724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d409ae96-716c-4e92-a444-5623fd0980b1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:54.013700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d409ae96-716c-4e92-a444-5623fd0980b1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:54.014175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d409ae96-716c-4e92-a444-5623fd0980b1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:54.014604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d409ae96-716c-4e92-a444-5623fd0980b1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:54.015278 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d409ae96-716c-4e92-a444-5623fd0980b1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:54.015720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d409ae96-716c-4e92-a444-5623fd0980b1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:54.016162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d409ae96-716c-4e92-a444-5623fd0980b1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:54.148556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d409ae96-716c-4e92-a444-5623fd0980b1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:54.157205 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d409ae96-716c-4e92-a444-5623fd0980b1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154913 Sep 01 05:39:54.157763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1195/2471] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:54 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:55.178436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e99dc398-981a-400f-b1a8-02c249d1a04d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:55.178981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e99dc398-981a-400f-b1a8-02c249d1a04d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:55.181251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=28 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:55.187286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e99dc398-981a-400f-b1a8-02c249d1a04d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:55.187760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e99dc398-981a-400f-b1a8-02c249d1a04d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:55.188187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e99dc398-981a-400f-b1a8-02c249d1a04d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:55.188890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e99dc398-981a-400f-b1a8-02c249d1a04d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:55.189337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e99dc398-981a-400f-b1a8-02c249d1a04d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:55.189752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e99dc398-981a-400f-b1a8-02c249d1a04d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:55.316724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e99dc398-981a-400f-b1a8-02c249d1a04d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:55.325417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e99dc398-981a-400f-b1a8-02c249d1a04d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150964 Sep 01 05:39:55.325980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1277/2472] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:55 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:56.346445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-006202cb-a6c8-4219-a87a-7931bc76cca0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:56.347039 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-006202cb-a6c8-4219-a87a-7931bc76cca0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:56.349647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=28 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:56.356241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-006202cb-a6c8-4219-a87a-7931bc76cca0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:56.356721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-006202cb-a6c8-4219-a87a-7931bc76cca0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:56.357181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-006202cb-a6c8-4219-a87a-7931bc76cca0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:56.357868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-006202cb-a6c8-4219-a87a-7931bc76cca0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:56.358321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-006202cb-a6c8-4219-a87a-7931bc76cca0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:56.358745 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-006202cb-a6c8-4219-a87a-7931bc76cca0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:56.491038 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-006202cb-a6c8-4219-a87a-7931bc76cca0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:56.499326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-006202cb-a6c8-4219-a87a-7931bc76cca0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156803 Sep 01 05:39:56.499902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1196/2473] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:56 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:57.520927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e29c0859-2854-4d27-a5c1-2ce4ba815e44 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:57.521536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e29c0859-2854-4d27-a5c1-2ce4ba815e44 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:57.528520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e29c0859-2854-4d27-a5c1-2ce4ba815e44 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:57.529019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e29c0859-2854-4d27-a5c1-2ce4ba815e44 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:57.529446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e29c0859-2854-4d27-a5c1-2ce4ba815e44 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:57.530117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e29c0859-2854-4d27-a5c1-2ce4ba815e44 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:57.530558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e29c0859-2854-4d27-a5c1-2ce4ba815e44 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:57.530972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e29c0859-2854-4d27-a5c1-2ce4ba815e44 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:57.657329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e29c0859-2854-4d27-a5c1-2ce4ba815e44 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:57.665865 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e29c0859-2854-4d27-a5c1-2ce4ba815e44 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148833 Sep 01 05:39:57.666439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1278/2474] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:57 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:58.689296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-30dfe8c0-7353-4ee4-b32e-ac169d3728bc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:58.689975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-30dfe8c0-7353-4ee4-b32e-ac169d3728bc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:58.696596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30dfe8c0-7353-4ee4-b32e-ac169d3728bc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:58.697110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30dfe8c0-7353-4ee4-b32e-ac169d3728bc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:58.697546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30dfe8c0-7353-4ee4-b32e-ac169d3728bc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:58.698225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30dfe8c0-7353-4ee4-b32e-ac169d3728bc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:58.699667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30dfe8c0-7353-4ee4-b32e-ac169d3728bc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:58.700093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-30dfe8c0-7353-4ee4-b32e-ac169d3728bc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:58.827217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-30dfe8c0-7353-4ee4-b32e-ac169d3728bc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:58.835368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-30dfe8c0-7353-4ee4-b32e-ac169d3728bc tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150427 Sep 01 05:39:58.835926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1197/2475] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:58 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:59.857093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ec00164e-4c97-4550-841a-151ac36a0dc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:59.857688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ec00164e-4c97-4550-841a-151ac36a0dc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:59.864399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec00164e-4c97-4550-841a-151ac36a0dc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:59.864909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec00164e-4c97-4550-841a-151ac36a0dc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:59.865335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec00164e-4c97-4550-841a-151ac36a0dc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:59.866004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec00164e-4c97-4550-841a-151ac36a0dc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:59.866445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec00164e-4c97-4550-841a-151ac36a0dc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:59.866856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec00164e-4c97-4550-841a-151ac36a0dc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:59.999565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ec00164e-4c97-4550-841a-151ac36a0dc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:00.007962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ec00164e-4c97-4550-841a-151ac36a0dc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155365 Sep 01 05:40:00.008520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1279/2476] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:59 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:01.028958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e870e635-a948-47d2-8cd9-d05efabc475e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:01.029561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e870e635-a948-47d2-8cd9-d05efabc475e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:01.036373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e870e635-a948-47d2-8cd9-d05efabc475e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:01.036872 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e870e635-a948-47d2-8cd9-d05efabc475e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:01.037303 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e870e635-a948-47d2-8cd9-d05efabc475e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:01.037970 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e870e635-a948-47d2-8cd9-d05efabc475e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:01.038414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e870e635-a948-47d2-8cd9-d05efabc475e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:01.038829 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e870e635-a948-47d2-8cd9-d05efabc475e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:01.169523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e870e635-a948-47d2-8cd9-d05efabc475e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:01.177593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e870e635-a948-47d2-8cd9-d05efabc475e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152726 Sep 01 05:40:01.178160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1198/2477] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:01 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:02.199062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-138cecb0-893a-4a3f-97d0-c6e09a9a01f5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:02.199604 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-138cecb0-893a-4a3f-97d0-c6e09a9a01f5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:02.206022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-138cecb0-893a-4a3f-97d0-c6e09a9a01f5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:02.206492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-138cecb0-893a-4a3f-97d0-c6e09a9a01f5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:02.206922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-138cecb0-893a-4a3f-97d0-c6e09a9a01f5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:02.207595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-138cecb0-893a-4a3f-97d0-c6e09a9a01f5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:02.208036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-138cecb0-893a-4a3f-97d0-c6e09a9a01f5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:02.208450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-138cecb0-893a-4a3f-97d0-c6e09a9a01f5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:02.334855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-138cecb0-893a-4a3f-97d0-c6e09a9a01f5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:02.343592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-138cecb0-893a-4a3f-97d0-c6e09a9a01f5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148448 Sep 01 05:40:02.344159 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1280/2478] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:02 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:03.364757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b1019425-d3f7-47df-b40b-75ac55bb69d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:03.365322 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b1019425-d3f7-47df-b40b-75ac55bb69d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:03.372396 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1019425-d3f7-47df-b40b-75ac55bb69d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:03.372903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1019425-d3f7-47df-b40b-75ac55bb69d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:03.373337 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1019425-d3f7-47df-b40b-75ac55bb69d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:03.374016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1019425-d3f7-47df-b40b-75ac55bb69d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:03.374463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1019425-d3f7-47df-b40b-75ac55bb69d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:03.374879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b1019425-d3f7-47df-b40b-75ac55bb69d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:03.499978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b1019425-d3f7-47df-b40b-75ac55bb69d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:03.508133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b1019425-d3f7-47df-b40b-75ac55bb69d1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.147362 Sep 01 05:40:03.508699 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1199/2479] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:03 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:04.529758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4083c9ff-976a-4002-ae59-53ee5cdfb68e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:04.530429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4083c9ff-976a-4002-ae59-53ee5cdfb68e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:04.537861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4083c9ff-976a-4002-ae59-53ee5cdfb68e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:04.538338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4083c9ff-976a-4002-ae59-53ee5cdfb68e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:04.538763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4083c9ff-976a-4002-ae59-53ee5cdfb68e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:04.539434 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4083c9ff-976a-4002-ae59-53ee5cdfb68e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:04.539877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4083c9ff-976a-4002-ae59-53ee5cdfb68e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:04.540291 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4083c9ff-976a-4002-ae59-53ee5cdfb68e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:04.671609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4083c9ff-976a-4002-ae59-53ee5cdfb68e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:04.679653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4083c9ff-976a-4002-ae59-53ee5cdfb68e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154302 Sep 01 05:40:04.680215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1281/2480] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:04 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:05.702025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-02bc3126-f0ba-4bd0-8a41-8d48f1815144 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:05.702635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-02bc3126-f0ba-4bd0-8a41-8d48f1815144 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:05.709307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02bc3126-f0ba-4bd0-8a41-8d48f1815144 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:05.709782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02bc3126-f0ba-4bd0-8a41-8d48f1815144 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:05.710207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02bc3126-f0ba-4bd0-8a41-8d48f1815144 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:05.710880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02bc3126-f0ba-4bd0-8a41-8d48f1815144 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:05.711321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02bc3126-f0ba-4bd0-8a41-8d48f1815144 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:05.711736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-02bc3126-f0ba-4bd0-8a41-8d48f1815144 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:05.837034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-02bc3126-f0ba-4bd0-8a41-8d48f1815144 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:05.845903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-02bc3126-f0ba-4bd0-8a41-8d48f1815144 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148592 Sep 01 05:40:05.846462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1200/2481] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:05 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:06.866927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-60e82cb2-e81e-453f-8ee2-2db4cc32d2fe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:06.867566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-60e82cb2-e81e-453f-8ee2-2db4cc32d2fe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:06.874128 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60e82cb2-e81e-453f-8ee2-2db4cc32d2fe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:06.874597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60e82cb2-e81e-453f-8ee2-2db4cc32d2fe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:06.875019 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60e82cb2-e81e-453f-8ee2-2db4cc32d2fe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:06.875690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60e82cb2-e81e-453f-8ee2-2db4cc32d2fe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:06.876130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60e82cb2-e81e-453f-8ee2-2db4cc32d2fe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:06.876544 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60e82cb2-e81e-453f-8ee2-2db4cc32d2fe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:07.006219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-60e82cb2-e81e-453f-8ee2-2db4cc32d2fe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:07.014595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-60e82cb2-e81e-453f-8ee2-2db4cc32d2fe tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151524 Sep 01 05:40:07.015167 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1282/2482] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:06 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:08.035806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ac53aee9-555d-4ef4-b034-0569497c9987 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:08.036449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ac53aee9-555d-4ef4-b034-0569497c9987 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:08.043532 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ac53aee9-555d-4ef4-b034-0569497c9987 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:08.044010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ac53aee9-555d-4ef4-b034-0569497c9987 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:08.044446 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ac53aee9-555d-4ef4-b034-0569497c9987 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:08.045156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ac53aee9-555d-4ef4-b034-0569497c9987 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:08.045607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ac53aee9-555d-4ef4-b034-0569497c9987 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:08.046031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ac53aee9-555d-4ef4-b034-0569497c9987 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:08.048522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=80 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:08.414289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ac53aee9-555d-4ef4-b034-0569497c9987 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:08.423204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ac53aee9-555d-4ef4-b034-0569497c9987 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.391583 Sep 01 05:40:08.423757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1201/2483] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:08 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:40:09.444397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5fef0aaa-1425-4389-9420-633b36b53bbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:09.444946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5fef0aaa-1425-4389-9420-633b36b53bbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:09.451397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fef0aaa-1425-4389-9420-633b36b53bbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:09.451868 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fef0aaa-1425-4389-9420-633b36b53bbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:09.452299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fef0aaa-1425-4389-9420-633b36b53bbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:09.452998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fef0aaa-1425-4389-9420-633b36b53bbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:09.453442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fef0aaa-1425-4389-9420-633b36b53bbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:09.453857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5fef0aaa-1425-4389-9420-633b36b53bbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:09.578704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5fef0aaa-1425-4389-9420-633b36b53bbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:09.586789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5fef0aaa-1425-4389-9420-633b36b53bbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.146530 Sep 01 05:40:09.587347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1283/2484] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:09 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:10.609174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d7fee9b7-6fbe-48b8-91fe-77688db3b3ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:10.609782 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d7fee9b7-6fbe-48b8-91fe-77688db3b3ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:10.616183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d7fee9b7-6fbe-48b8-91fe-77688db3b3ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:10.616638 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d7fee9b7-6fbe-48b8-91fe-77688db3b3ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:10.617161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d7fee9b7-6fbe-48b8-91fe-77688db3b3ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:10.617832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d7fee9b7-6fbe-48b8-91fe-77688db3b3ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:10.618276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d7fee9b7-6fbe-48b8-91fe-77688db3b3ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:10.618687 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d7fee9b7-6fbe-48b8-91fe-77688db3b3ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:10.745832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d7fee9b7-6fbe-48b8-91fe-77688db3b3ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:10.754078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d7fee9b7-6fbe-48b8-91fe-77688db3b3ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149381 Sep 01 05:40:10.754643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1202/2485] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:10 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:11.774967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-641141bd-ad56-4b58-bbfd-071b43168675 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:11.775580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-641141bd-ad56-4b58-bbfd-071b43168675 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:11.782926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-641141bd-ad56-4b58-bbfd-071b43168675 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:11.783416 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-641141bd-ad56-4b58-bbfd-071b43168675 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:11.784128 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-641141bd-ad56-4b58-bbfd-071b43168675 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:11.784833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-641141bd-ad56-4b58-bbfd-071b43168675 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:11.785285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-641141bd-ad56-4b58-bbfd-071b43168675 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:11.785705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-641141bd-ad56-4b58-bbfd-071b43168675 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:11.918024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-641141bd-ad56-4b58-bbfd-071b43168675 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:11.926201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-641141bd-ad56-4b58-bbfd-071b43168675 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155089 Sep 01 05:40:11.926974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1284/2486] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:11 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:12.947600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-95227046-4f7e-4d42-8184-31fc38736c96 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:12.948213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-95227046-4f7e-4d42-8184-31fc38736c96 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:12.954190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-95227046-4f7e-4d42-8184-31fc38736c96 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:12.954667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-95227046-4f7e-4d42-8184-31fc38736c96 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:12.955108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-95227046-4f7e-4d42-8184-31fc38736c96 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:12.955786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-95227046-4f7e-4d42-8184-31fc38736c96 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:12.956232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-95227046-4f7e-4d42-8184-31fc38736c96 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:12.956653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-95227046-4f7e-4d42-8184-31fc38736c96 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:13.086441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-95227046-4f7e-4d42-8184-31fc38736c96 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:13.095139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-95227046-4f7e-4d42-8184-31fc38736c96 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151560 Sep 01 05:40:13.095711 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1203/2487] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:12 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:40:14.115370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-68a4f9ec-cf72-4f1f-a952-ab232a33f66d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:14.115988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-68a4f9ec-cf72-4f1f-a952-ab232a33f66d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:14.123461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68a4f9ec-cf72-4f1f-a952-ab232a33f66d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:14.123944 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68a4f9ec-cf72-4f1f-a952-ab232a33f66d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:14.124374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68a4f9ec-cf72-4f1f-a952-ab232a33f66d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:14.125093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68a4f9ec-cf72-4f1f-a952-ab232a33f66d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:14.125536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68a4f9ec-cf72-4f1f-a952-ab232a33f66d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:14.125980 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-68a4f9ec-cf72-4f1f-a952-ab232a33f66d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:14.251949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-68a4f9ec-cf72-4f1f-a952-ab232a33f66d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:14.259942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-68a4f9ec-cf72-4f1f-a952-ab232a33f66d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148415 Sep 01 05:40:14.260500 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1285/2488] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:14 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:15.282508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-18538089-e53d-4c6d-97ce-d5e6a5d59c8a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:15.283090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-18538089-e53d-4c6d-97ce-d5e6a5d59c8a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:15.289695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18538089-e53d-4c6d-97ce-d5e6a5d59c8a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:15.290168 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18538089-e53d-4c6d-97ce-d5e6a5d59c8a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:15.290598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18538089-e53d-4c6d-97ce-d5e6a5d59c8a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:15.291264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18538089-e53d-4c6d-97ce-d5e6a5d59c8a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:15.291708 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18538089-e53d-4c6d-97ce-d5e6a5d59c8a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:15.292811 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18538089-e53d-4c6d-97ce-d5e6a5d59c8a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:15.429145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-18538089-e53d-4c6d-97ce-d5e6a5d59c8a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:15.437223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-18538089-e53d-4c6d-97ce-d5e6a5d59c8a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.158770 Sep 01 05:40:15.437780 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1204/2489] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:15 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:16.458633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8e8cf96d-e882-407f-bda6-02a4ed4a32ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:16.459246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8e8cf96d-e882-407f-bda6-02a4ed4a32ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:16.466219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e8cf96d-e882-407f-bda6-02a4ed4a32ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:16.466700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e8cf96d-e882-407f-bda6-02a4ed4a32ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:16.467135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e8cf96d-e882-407f-bda6-02a4ed4a32ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:16.467825 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e8cf96d-e882-407f-bda6-02a4ed4a32ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:16.468279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e8cf96d-e882-407f-bda6-02a4ed4a32ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:16.468696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e8cf96d-e882-407f-bda6-02a4ed4a32ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:16.471197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=84 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:16.598008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8e8cf96d-e882-407f-bda6-02a4ed4a32ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:16.606682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8e8cf96d-e882-407f-bda6-02a4ed4a32ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151936 Sep 01 05:40:16.607239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1286/2490] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:16 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:17.627357 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4163f811-2e6d-4987-8cd1-3642fd9056a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:17.627965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4163f811-2e6d-4987-8cd1-3642fd9056a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:17.634442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4163f811-2e6d-4987-8cd1-3642fd9056a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:17.634933 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4163f811-2e6d-4987-8cd1-3642fd9056a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:17.635344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4163f811-2e6d-4987-8cd1-3642fd9056a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:17.636043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4163f811-2e6d-4987-8cd1-3642fd9056a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:17.636483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4163f811-2e6d-4987-8cd1-3642fd9056a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:17.636927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4163f811-2e6d-4987-8cd1-3642fd9056a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:17.766052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4163f811-2e6d-4987-8cd1-3642fd9056a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:17.774093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4163f811-2e6d-4987-8cd1-3642fd9056a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150551 Sep 01 05:40:17.774656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1205/2491] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:17 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:18.795572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9d2cd4d2-6555-45aa-b979-60d9f0a6b923 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:18.796187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9d2cd4d2-6555-45aa-b979-60d9f0a6b923 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:18.802610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d2cd4d2-6555-45aa-b979-60d9f0a6b923 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:18.803090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d2cd4d2-6555-45aa-b979-60d9f0a6b923 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:18.803523 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d2cd4d2-6555-45aa-b979-60d9f0a6b923 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:18.804203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d2cd4d2-6555-45aa-b979-60d9f0a6b923 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:18.804649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d2cd4d2-6555-45aa-b979-60d9f0a6b923 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:18.805095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d2cd4d2-6555-45aa-b979-60d9f0a6b923 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:18.934656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9d2cd4d2-6555-45aa-b979-60d9f0a6b923 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:18.942932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9d2cd4d2-6555-45aa-b979-60d9f0a6b923 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151323 Sep 01 05:40:18.943503 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1287/2492] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:18 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:19.966354 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a05bd768-f742-492e-a516-90bbc91413d4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:19.967007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a05bd768-f742-492e-a516-90bbc91413d4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:19.973553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a05bd768-f742-492e-a516-90bbc91413d4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:19.974029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a05bd768-f742-492e-a516-90bbc91413d4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:19.974456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a05bd768-f742-492e-a516-90bbc91413d4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:19.975134 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a05bd768-f742-492e-a516-90bbc91413d4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:19.975575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a05bd768-f742-492e-a516-90bbc91413d4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:19.975992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a05bd768-f742-492e-a516-90bbc91413d4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:20.104174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a05bd768-f742-492e-a516-90bbc91413d4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:20.112724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a05bd768-f742-492e-a516-90bbc91413d4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150971 Sep 01 05:40:20.113315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1206/2493] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:19 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:21.133768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-32722123-eb21-47e8-913d-fcf39611bcb0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:21.134385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-32722123-eb21-47e8-913d-fcf39611bcb0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:21.140801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32722123-eb21-47e8-913d-fcf39611bcb0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:21.141323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32722123-eb21-47e8-913d-fcf39611bcb0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:21.141760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32722123-eb21-47e8-913d-fcf39611bcb0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:21.142435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32722123-eb21-47e8-913d-fcf39611bcb0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:21.142887 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32722123-eb21-47e8-913d-fcf39611bcb0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:21.143309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-32722123-eb21-47e8-913d-fcf39611bcb0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:21.277919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-32722123-eb21-47e8-913d-fcf39611bcb0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:21.286475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-32722123-eb21-47e8-913d-fcf39611bcb0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156538 Sep 01 05:40:21.287031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1288/2494] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:21 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:22.309030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-07c20c98-feb4-435a-ad1c-c1aa021c018b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:22.309583 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-07c20c98-feb4-435a-ad1c-c1aa021c018b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:22.315952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07c20c98-feb4-435a-ad1c-c1aa021c018b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:22.316431 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07c20c98-feb4-435a-ad1c-c1aa021c018b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:22.316908 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07c20c98-feb4-435a-ad1c-c1aa021c018b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:22.317581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07c20c98-feb4-435a-ad1c-c1aa021c018b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:22.318027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07c20c98-feb4-435a-ad1c-c1aa021c018b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:22.318443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-07c20c98-feb4-435a-ad1c-c1aa021c018b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:22.446679 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-07c20c98-feb4-435a-ad1c-c1aa021c018b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:22.456248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-07c20c98-feb4-435a-ad1c-c1aa021c018b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152053 Sep 01 05:40:22.456827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1207/2495] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:22 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:23.477286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fa1d906f-e663-4f4e-9619-0dc2505b80ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:23.477933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fa1d906f-e663-4f4e-9619-0dc2505b80ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:23.484907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa1d906f-e663-4f4e-9619-0dc2505b80ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:23.485379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa1d906f-e663-4f4e-9619-0dc2505b80ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:23.485808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa1d906f-e663-4f4e-9619-0dc2505b80ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:23.486474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa1d906f-e663-4f4e-9619-0dc2505b80ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:23.486913 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa1d906f-e663-4f4e-9619-0dc2505b80ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:23.487326 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fa1d906f-e663-4f4e-9619-0dc2505b80ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:23.614555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fa1d906f-e663-4f4e-9619-0dc2505b80ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:23.622667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fa1d906f-e663-4f4e-9619-0dc2505b80ae tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149242 Sep 01 05:40:23.623233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1289/2496] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:23 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:24.643260 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c0554c94-e199-4cfb-b98f-89849829fd69 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:24.643906 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c0554c94-e199-4cfb-b98f-89849829fd69 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:24.650397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0554c94-e199-4cfb-b98f-89849829fd69 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:24.650895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0554c94-e199-4cfb-b98f-89849829fd69 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:24.651343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0554c94-e199-4cfb-b98f-89849829fd69 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:24.652027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0554c94-e199-4cfb-b98f-89849829fd69 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:24.652490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0554c94-e199-4cfb-b98f-89849829fd69 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:24.652929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c0554c94-e199-4cfb-b98f-89849829fd69 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:24.786501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c0554c94-e199-4cfb-b98f-89849829fd69 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:24.795203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c0554c94-e199-4cfb-b98f-89849829fd69 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155904 Sep 01 05:40:24.795760 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1208/2497] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:24 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:40:25.816057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fc582d5f-26f1-4b95-8778-40421145122b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:25.816658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fc582d5f-26f1-4b95-8778-40421145122b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:25.818959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=26 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:25.825013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc582d5f-26f1-4b95-8778-40421145122b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:25.825494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc582d5f-26f1-4b95-8778-40421145122b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:25.825926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc582d5f-26f1-4b95-8778-40421145122b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:25.826603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc582d5f-26f1-4b95-8778-40421145122b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:25.827054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc582d5f-26f1-4b95-8778-40421145122b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:25.827470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fc582d5f-26f1-4b95-8778-40421145122b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:25.958025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fc582d5f-26f1-4b95-8778-40421145122b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:25.966112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fc582d5f-26f1-4b95-8778-40421145122b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153939 Sep 01 05:40:25.966676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1290/2498] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:25 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:26.987553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5c23ebc2-e574-428b-98ae-2e633936caf7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:26.988190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5c23ebc2-e574-428b-98ae-2e633936caf7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:26.990499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=26 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:26.996132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c23ebc2-e574-428b-98ae-2e633936caf7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:26.996600 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c23ebc2-e574-428b-98ae-2e633936caf7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:26.997055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c23ebc2-e574-428b-98ae-2e633936caf7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:26.997733 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c23ebc2-e574-428b-98ae-2e633936caf7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:26.998176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c23ebc2-e574-428b-98ae-2e633936caf7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:26.998589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c23ebc2-e574-428b-98ae-2e633936caf7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:27.126047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5c23ebc2-e574-428b-98ae-2e633936caf7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:27.134254 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5c23ebc2-e574-428b-98ae-2e633936caf7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150501 Sep 01 05:40:27.134816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1209/2499] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:26 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:28.155411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cfaed94f-3514-4cb4-8cdf-f41db8004a2d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:28.155965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cfaed94f-3514-4cb4-8cdf-f41db8004a2d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:28.162731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfaed94f-3514-4cb4-8cdf-f41db8004a2d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:28.163211 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfaed94f-3514-4cb4-8cdf-f41db8004a2d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:28.163641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfaed94f-3514-4cb4-8cdf-f41db8004a2d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:28.164323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfaed94f-3514-4cb4-8cdf-f41db8004a2d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:28.164789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfaed94f-3514-4cb4-8cdf-f41db8004a2d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:28.165212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cfaed94f-3514-4cb4-8cdf-f41db8004a2d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:28.296235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cfaed94f-3514-4cb4-8cdf-f41db8004a2d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:28.304522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cfaed94f-3514-4cb4-8cdf-f41db8004a2d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153668 Sep 01 05:40:28.305130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1291/2500] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:28 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:29.325791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-34b2a8de-ff96-4135-8803-33ffb8e12c80 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:29.326996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-34b2a8de-ff96-4135-8803-33ffb8e12c80 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:29.332688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34b2a8de-ff96-4135-8803-33ffb8e12c80 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:29.333191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34b2a8de-ff96-4135-8803-33ffb8e12c80 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:29.333616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34b2a8de-ff96-4135-8803-33ffb8e12c80 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:29.334287 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34b2a8de-ff96-4135-8803-33ffb8e12c80 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:29.334727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34b2a8de-ff96-4135-8803-33ffb8e12c80 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:29.335141 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-34b2a8de-ff96-4135-8803-33ffb8e12c80 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:29.469349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-34b2a8de-ff96-4135-8803-33ffb8e12c80 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:29.477372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-34b2a8de-ff96-4135-8803-33ffb8e12c80 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156090 Sep 01 05:40:29.477936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1210/2501] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:29 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:40:30.500172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-76bf28a3-af7d-44b9-a7ce-0db9d3f702d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:30.500808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-76bf28a3-af7d-44b9-a7ce-0db9d3f702d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:30.507208 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76bf28a3-af7d-44b9-a7ce-0db9d3f702d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:30.507681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76bf28a3-af7d-44b9-a7ce-0db9d3f702d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:30.508109 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76bf28a3-af7d-44b9-a7ce-0db9d3f702d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:30.508791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76bf28a3-af7d-44b9-a7ce-0db9d3f702d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:30.509245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76bf28a3-af7d-44b9-a7ce-0db9d3f702d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:30.509660 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-76bf28a3-af7d-44b9-a7ce-0db9d3f702d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:30.636724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-76bf28a3-af7d-44b9-a7ce-0db9d3f702d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:30.644813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-76bf28a3-af7d-44b9-a7ce-0db9d3f702d6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148513 Sep 01 05:40:30.645376 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1292/2502] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:30 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:31.667618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-981c262f-6363-400a-9aec-400a8fec8528 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:31.668216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-981c262f-6363-400a-9aec-400a8fec8528 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:31.674751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-981c262f-6363-400a-9aec-400a8fec8528 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:31.675224 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-981c262f-6363-400a-9aec-400a8fec8528 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:31.675651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-981c262f-6363-400a-9aec-400a8fec8528 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:31.676320 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-981c262f-6363-400a-9aec-400a8fec8528 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:31.676762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-981c262f-6363-400a-9aec-400a8fec8528 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:31.677196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-981c262f-6363-400a-9aec-400a8fec8528 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:31.803100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-981c262f-6363-400a-9aec-400a8fec8528 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:31.811297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-981c262f-6363-400a-9aec-400a8fec8528 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148174 Sep 01 05:40:31.811863 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1211/2503] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:31 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:32.832952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9b824900-dd41-4019-b67e-14277c7fc8d3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:32.833573 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9b824900-dd41-4019-b67e-14277c7fc8d3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:32.840260 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b824900-dd41-4019-b67e-14277c7fc8d3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:32.840744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b824900-dd41-4019-b67e-14277c7fc8d3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:32.841207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b824900-dd41-4019-b67e-14277c7fc8d3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:32.841893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b824900-dd41-4019-b67e-14277c7fc8d3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:32.842345 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b824900-dd41-4019-b67e-14277c7fc8d3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:32.842769 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9b824900-dd41-4019-b67e-14277c7fc8d3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:32.974924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9b824900-dd41-4019-b67e-14277c7fc8d3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:32.983927 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9b824900-dd41-4019-b67e-14277c7fc8d3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154915 Sep 01 05:40:32.984496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1293/2504] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:32 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:34.005131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4214f80c-0d30-4107-b17e-077b99c80e12 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:34.005743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4214f80c-0d30-4107-b17e-077b99c80e12 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:34.012837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4214f80c-0d30-4107-b17e-077b99c80e12 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:34.013315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4214f80c-0d30-4107-b17e-077b99c80e12 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:34.013749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4214f80c-0d30-4107-b17e-077b99c80e12 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:34.014426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4214f80c-0d30-4107-b17e-077b99c80e12 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:34.014870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4214f80c-0d30-4107-b17e-077b99c80e12 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:34.015291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4214f80c-0d30-4107-b17e-077b99c80e12 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:34.148930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4214f80c-0d30-4107-b17e-077b99c80e12 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:34.157383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4214f80c-0d30-4107-b17e-077b99c80e12 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156188 Sep 01 05:40:34.157953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1212/2505] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:34 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:35.179586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e49fe74e-480a-4f26-a5f0-d61759b9283d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:35.180129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e49fe74e-480a-4f26-a5f0-d61759b9283d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:35.187301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e49fe74e-480a-4f26-a5f0-d61759b9283d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:35.187778 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e49fe74e-480a-4f26-a5f0-d61759b9283d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:35.188207 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e49fe74e-480a-4f26-a5f0-d61759b9283d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:35.188923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e49fe74e-480a-4f26-a5f0-d61759b9283d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:35.189373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e49fe74e-480a-4f26-a5f0-d61759b9283d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:35.189789 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e49fe74e-480a-4f26-a5f0-d61759b9283d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:35.317058 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e49fe74e-480a-4f26-a5f0-d61759b9283d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:35.325341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e49fe74e-480a-4f26-a5f0-d61759b9283d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149742 Sep 01 05:40:35.325907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1294/2506] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:35 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:36.346634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7b21ad17-6888-426a-8d57-0b116b2a4aac tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:36.347180 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7b21ad17-6888-426a-8d57-0b116b2a4aac tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:36.353607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b21ad17-6888-426a-8d57-0b116b2a4aac tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:36.354089 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b21ad17-6888-426a-8d57-0b116b2a4aac tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:36.354781 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b21ad17-6888-426a-8d57-0b116b2a4aac tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:36.355464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b21ad17-6888-426a-8d57-0b116b2a4aac tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:36.355913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b21ad17-6888-426a-8d57-0b116b2a4aac tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:36.356335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7b21ad17-6888-426a-8d57-0b116b2a4aac tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:36.484935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7b21ad17-6888-426a-8d57-0b116b2a4aac tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:36.493131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7b21ad17-6888-426a-8d57-0b116b2a4aac tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150452 Sep 01 05:40:36.493704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1213/2507] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:36 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:37.520661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-aeab778b-3876-4212-92c0-3bc231889e54 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:37.521315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-aeab778b-3876-4212-92c0-3bc231889e54 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:37.528277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aeab778b-3876-4212-92c0-3bc231889e54 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:37.528755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aeab778b-3876-4212-92c0-3bc231889e54 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:37.529210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aeab778b-3876-4212-92c0-3bc231889e54 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:37.529893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aeab778b-3876-4212-92c0-3bc231889e54 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:37.530339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aeab778b-3876-4212-92c0-3bc231889e54 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:37.530760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aeab778b-3876-4212-92c0-3bc231889e54 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:37.659972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-aeab778b-3876-4212-92c0-3bc231889e54 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:37.668831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-aeab778b-3876-4212-92c0-3bc231889e54 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151972 Sep 01 05:40:37.669395 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1295/2508] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:37 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:38.689895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-66153852-8103-40d4-973c-c326c0301e11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:38.690503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-66153852-8103-40d4-973c-c326c0301e11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:38.696822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66153852-8103-40d4-973c-c326c0301e11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:38.697301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66153852-8103-40d4-973c-c326c0301e11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:38.697756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66153852-8103-40d4-973c-c326c0301e11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:38.698939 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66153852-8103-40d4-973c-c326c0301e11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:38.699383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66153852-8103-40d4-973c-c326c0301e11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:38.699795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-66153852-8103-40d4-973c-c326c0301e11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:38.702284 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=78 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:38.827059 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-66153852-8103-40d4-973c-c326c0301e11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:38.835229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-66153852-8103-40d4-973c-c326c0301e11 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149467 Sep 01 05:40:38.835801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1214/2509] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:38 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:39.857659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-73864139-d4c7-4cdb-a454-ff438a1280d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:39.858263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-73864139-d4c7-4cdb-a454-ff438a1280d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:39.864406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73864139-d4c7-4cdb-a454-ff438a1280d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:39.864910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73864139-d4c7-4cdb-a454-ff438a1280d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:39.865350 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73864139-d4c7-4cdb-a454-ff438a1280d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:39.866024 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73864139-d4c7-4cdb-a454-ff438a1280d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:39.866466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73864139-d4c7-4cdb-a454-ff438a1280d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:39.866882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-73864139-d4c7-4cdb-a454-ff438a1280d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:39.996705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-73864139-d4c7-4cdb-a454-ff438a1280d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:40.005025 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-73864139-d4c7-4cdb-a454-ff438a1280d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151987 Sep 01 05:40:40.005630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1296/2510] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:39 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:41.026462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a4ebf071-bfbd-4cb4-9247-acfc5ecb86ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:41.027179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a4ebf071-bfbd-4cb4-9247-acfc5ecb86ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:41.033710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4ebf071-bfbd-4cb4-9247-acfc5ecb86ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:41.034191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4ebf071-bfbd-4cb4-9247-acfc5ecb86ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:41.034616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4ebf071-bfbd-4cb4-9247-acfc5ecb86ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:41.035466 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4ebf071-bfbd-4cb4-9247-acfc5ecb86ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:41.035914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4ebf071-bfbd-4cb4-9247-acfc5ecb86ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:41.036334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a4ebf071-bfbd-4cb4-9247-acfc5ecb86ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:41.169621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a4ebf071-bfbd-4cb4-9247-acfc5ecb86ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:41.177804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a4ebf071-bfbd-4cb4-9247-acfc5ecb86ce tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155330 Sep 01 05:40:41.178363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1215/2511] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:41 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:42.199974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ce15ecd7-b9a4-400f-b274-33220c29a850 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:42.200633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ce15ecd7-b9a4-400f-b274-33220c29a850 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:42.207012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce15ecd7-b9a4-400f-b274-33220c29a850 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:42.207481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce15ecd7-b9a4-400f-b274-33220c29a850 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:42.207910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce15ecd7-b9a4-400f-b274-33220c29a850 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:42.208579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce15ecd7-b9a4-400f-b274-33220c29a850 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:42.209053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce15ecd7-b9a4-400f-b274-33220c29a850 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:42.209469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ce15ecd7-b9a4-400f-b274-33220c29a850 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:42.336117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ce15ecd7-b9a4-400f-b274-33220c29a850 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:42.344492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ce15ecd7-b9a4-400f-b274-33220c29a850 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149160 Sep 01 05:40:42.345095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1297/2512] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:42 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:43.366368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-54aa51fd-9c0a-41d2-83ac-7d2450af5beb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:43.366924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-54aa51fd-9c0a-41d2-83ac-7d2450af5beb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:43.373085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-54aa51fd-9c0a-41d2-83ac-7d2450af5beb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:43.373556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-54aa51fd-9c0a-41d2-83ac-7d2450af5beb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:43.373979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-54aa51fd-9c0a-41d2-83ac-7d2450af5beb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:43.374648 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-54aa51fd-9c0a-41d2-83ac-7d2450af5beb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:43.375087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-54aa51fd-9c0a-41d2-83ac-7d2450af5beb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:43.375499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-54aa51fd-9c0a-41d2-83ac-7d2450af5beb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:43.507712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-54aa51fd-9c0a-41d2-83ac-7d2450af5beb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:43.516441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-54aa51fd-9c0a-41d2-83ac-7d2450af5beb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154034 Sep 01 05:40:43.517036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1216/2513] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:43 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:44.537246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-51b44169-e0f0-4cec-80b5-90511582a93e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:44.537859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-51b44169-e0f0-4cec-80b5-90511582a93e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:44.544931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51b44169-e0f0-4cec-80b5-90511582a93e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:44.545406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51b44169-e0f0-4cec-80b5-90511582a93e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:44.545837 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51b44169-e0f0-4cec-80b5-90511582a93e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:44.546520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51b44169-e0f0-4cec-80b5-90511582a93e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:44.546969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51b44169-e0f0-4cec-80b5-90511582a93e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:44.547390 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-51b44169-e0f0-4cec-80b5-90511582a93e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:44.676969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-51b44169-e0f0-4cec-80b5-90511582a93e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:44.685201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-51b44169-e0f0-4cec-80b5-90511582a93e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152099 Sep 01 05:40:44.685775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1298/2514] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:44 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:45.706613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f7b44e24-e09c-45fd-a205-8a223791c7e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:45.707209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f7b44e24-e09c-45fd-a205-8a223791c7e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:45.714178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7b44e24-e09c-45fd-a205-8a223791c7e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.715008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7b44e24-e09c-45fd-a205-8a223791c7e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.715447 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7b44e24-e09c-45fd-a205-8a223791c7e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:45.716250 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7b44e24-e09c-45fd-a205-8a223791c7e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.716705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7b44e24-e09c-45fd-a205-8a223791c7e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.717795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f7b44e24-e09c-45fd-a205-8a223791c7e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:45.941578 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f7b44e24-e09c-45fd-a205-8a223791c7e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:45.949715 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f7b44e24-e09c-45fd-a205-8a223791c7e1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.246927 Sep 01 05:40:45.950286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1217/2515] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:45 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:46.970597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-89be13d0-5394-4f11-b780-31047ac34cfd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:46.971204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-89be13d0-5394-4f11-b780-31047ac34cfd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:46.977524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89be13d0-5394-4f11-b780-31047ac34cfd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:46.977993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89be13d0-5394-4f11-b780-31047ac34cfd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:46.978418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89be13d0-5394-4f11-b780-31047ac34cfd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:46.979628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89be13d0-5394-4f11-b780-31047ac34cfd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:46.980160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89be13d0-5394-4f11-b780-31047ac34cfd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:46.980580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-89be13d0-5394-4f11-b780-31047ac34cfd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:46.983049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=78 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:47.109334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-89be13d0-5394-4f11-b780-31047ac34cfd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:47.117384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-89be13d0-5394-4f11-b780-31047ac34cfd tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150750 Sep 01 05:40:47.117943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1299/2516] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:46 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:48.139101 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ce1aece2-ccbe-4fb6-bb78-5de5bee7130c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:48.139710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ce1aece2-ccbe-4fb6-bb78-5de5bee7130c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:48.146338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce1aece2-ccbe-4fb6-bb78-5de5bee7130c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:48.146749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce1aece2-ccbe-4fb6-bb78-5de5bee7130c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:48.147176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce1aece2-ccbe-4fb6-bb78-5de5bee7130c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:48.147842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce1aece2-ccbe-4fb6-bb78-5de5bee7130c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:48.148282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce1aece2-ccbe-4fb6-bb78-5de5bee7130c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:48.148695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ce1aece2-ccbe-4fb6-bb78-5de5bee7130c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:48.280001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ce1aece2-ccbe-4fb6-bb78-5de5bee7130c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:48.288422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ce1aece2-ccbe-4fb6-bb78-5de5bee7130c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153441 Sep 01 05:40:48.289004 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1218/2517] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:48 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:49.310374 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0d6b82c9-004f-4f3c-89ed-43cecab49719 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:49.310940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0d6b82c9-004f-4f3c-89ed-43cecab49719 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:49.317202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d6b82c9-004f-4f3c-89ed-43cecab49719 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:49.317676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d6b82c9-004f-4f3c-89ed-43cecab49719 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:49.318104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d6b82c9-004f-4f3c-89ed-43cecab49719 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:49.318829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d6b82c9-004f-4f3c-89ed-43cecab49719 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:49.319272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d6b82c9-004f-4f3c-89ed-43cecab49719 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:49.319688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d6b82c9-004f-4f3c-89ed-43cecab49719 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:49.451178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0d6b82c9-004f-4f3c-89ed-43cecab49719 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:49.459359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0d6b82c9-004f-4f3c-89ed-43cecab49719 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153342 Sep 01 05:40:49.459918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1300/2518] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:49 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:50.480966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-850c2bed-a06a-497b-967f-c34e9f9b9804 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:50.481604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-850c2bed-a06a-497b-967f-c34e9f9b9804 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:50.487979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-850c2bed-a06a-497b-967f-c34e9f9b9804 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:50.488449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-850c2bed-a06a-497b-967f-c34e9f9b9804 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:50.488975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-850c2bed-a06a-497b-967f-c34e9f9b9804 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:50.489647 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-850c2bed-a06a-497b-967f-c34e9f9b9804 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:50.490090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-850c2bed-a06a-497b-967f-c34e9f9b9804 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:50.490504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-850c2bed-a06a-497b-967f-c34e9f9b9804 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:50.622352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-850c2bed-a06a-497b-967f-c34e9f9b9804 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:50.630546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-850c2bed-a06a-497b-967f-c34e9f9b9804 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154107 Sep 01 05:40:50.631114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1219/2519] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:50 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:51.653355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f3244202-9175-43de-b35b-750b83e52edf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:51.653967 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f3244202-9175-43de-b35b-750b83e52edf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:51.660683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3244202-9175-43de-b35b-750b83e52edf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:51.661192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3244202-9175-43de-b35b-750b83e52edf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:51.661619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3244202-9175-43de-b35b-750b83e52edf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:51.662290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3244202-9175-43de-b35b-750b83e52edf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:51.662731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3244202-9175-43de-b35b-750b83e52edf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:51.663174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f3244202-9175-43de-b35b-750b83e52edf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:51.790148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f3244202-9175-43de-b35b-750b83e52edf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:51.798776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f3244202-9175-43de-b35b-750b83e52edf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149335 Sep 01 05:40:51.799333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1301/2520] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:51 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:52.819450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e24f1513-0d75-45e1-8554-bded58dde946 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:52.820006 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e24f1513-0d75-45e1-8554-bded58dde946 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:52.826695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e24f1513-0d75-45e1-8554-bded58dde946 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:52.827169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e24f1513-0d75-45e1-8554-bded58dde946 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:52.827899 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e24f1513-0d75-45e1-8554-bded58dde946 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:52.828577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e24f1513-0d75-45e1-8554-bded58dde946 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:52.829050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e24f1513-0d75-45e1-8554-bded58dde946 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:52.829464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e24f1513-0d75-45e1-8554-bded58dde946 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:52.958422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e24f1513-0d75-45e1-8554-bded58dde946 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:52.967047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e24f1513-0d75-45e1-8554-bded58dde946 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151447 Sep 01 05:40:52.967632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1220/2521] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:52 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:53.988851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2f77bc04-e287-4ceb-8c9d-1908d9ed5a50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:53.989473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2f77bc04-e287-4ceb-8c9d-1908d9ed5a50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:53.996384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f77bc04-e287-4ceb-8c9d-1908d9ed5a50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:53.997039 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f77bc04-e287-4ceb-8c9d-1908d9ed5a50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:53.997324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f77bc04-e287-4ceb-8c9d-1908d9ed5a50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:53.998006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f77bc04-e287-4ceb-8c9d-1908d9ed5a50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:53.998486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f77bc04-e287-4ceb-8c9d-1908d9ed5a50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:53.998926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2f77bc04-e287-4ceb-8c9d-1908d9ed5a50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:54.130737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2f77bc04-e287-4ceb-8c9d-1908d9ed5a50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:54.140104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2f77bc04-e287-4ceb-8c9d-1908d9ed5a50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155166 Sep 01 05:40:54.140667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1302/2522] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:53 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:40:55.161702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-024b72b0-9245-4635-9963-2e3a63f6afb5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:55.162267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-024b72b0-9245-4635-9963-2e3a63f6afb5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:55.168632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-024b72b0-9245-4635-9963-2e3a63f6afb5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:55.169136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-024b72b0-9245-4635-9963-2e3a63f6afb5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:55.169565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-024b72b0-9245-4635-9963-2e3a63f6afb5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:55.170241 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-024b72b0-9245-4635-9963-2e3a63f6afb5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:55.170683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-024b72b0-9245-4635-9963-2e3a63f6afb5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:55.171095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-024b72b0-9245-4635-9963-2e3a63f6afb5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:55.301036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-024b72b0-9245-4635-9963-2e3a63f6afb5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:55.309228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-024b72b0-9245-4635-9963-2e3a63f6afb5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151654 Sep 01 05:40:55.309788 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1221/2523] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:55 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:56.330289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-421c52c7-c952-44fe-8b2b-f4dc81217e23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:56.330835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-421c52c7-c952-44fe-8b2b-f4dc81217e23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:56.333143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=26 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:56.339299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-421c52c7-c952-44fe-8b2b-f4dc81217e23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:56.339773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-421c52c7-c952-44fe-8b2b-f4dc81217e23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:56.340204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-421c52c7-c952-44fe-8b2b-f4dc81217e23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:56.340910 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-421c52c7-c952-44fe-8b2b-f4dc81217e23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:56.341357 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-421c52c7-c952-44fe-8b2b-f4dc81217e23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:56.341775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-421c52c7-c952-44fe-8b2b-f4dc81217e23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:56.474854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-421c52c7-c952-44fe-8b2b-f4dc81217e23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:56.483562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-421c52c7-c952-44fe-8b2b-f4dc81217e23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.157276 Sep 01 05:40:56.484120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1303/2524] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:56 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:57.504031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6ae12e49-42e0-46e5-9baa-071059847282 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:57.504635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6ae12e49-42e0-46e5-9baa-071059847282 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:57.506952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=26 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:57.512487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ae12e49-42e0-46e5-9baa-071059847282 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:57.512993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ae12e49-42e0-46e5-9baa-071059847282 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:57.513423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ae12e49-42e0-46e5-9baa-071059847282 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:57.514103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ae12e49-42e0-46e5-9baa-071059847282 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:57.514543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ae12e49-42e0-46e5-9baa-071059847282 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:57.514957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6ae12e49-42e0-46e5-9baa-071059847282 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:57.644632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6ae12e49-42e0-46e5-9baa-071059847282 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:57.652805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6ae12e49-42e0-46e5-9baa-071059847282 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152577 Sep 01 05:40:57.653372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1222/2525] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:57 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:58.673918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4a36dc89-2352-4ce2-b307-f3f24bf47fa3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:58.674519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4a36dc89-2352-4ce2-b307-f3f24bf47fa3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:58.680818 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a36dc89-2352-4ce2-b307-f3f24bf47fa3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:58.681300 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a36dc89-2352-4ce2-b307-f3f24bf47fa3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:58.681731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a36dc89-2352-4ce2-b307-f3f24bf47fa3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:58.682912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a36dc89-2352-4ce2-b307-f3f24bf47fa3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:58.683352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a36dc89-2352-4ce2-b307-f3f24bf47fa3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:58.683767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a36dc89-2352-4ce2-b307-f3f24bf47fa3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:58.811266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4a36dc89-2352-4ce2-b307-f3f24bf47fa3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:58.819415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4a36dc89-2352-4ce2-b307-f3f24bf47fa3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149360 Sep 01 05:40:58.820011 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1304/2526] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:58 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:59.840717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ef651ce2-0f03-41d0-8d4e-962500dcac53 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:59.841346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ef651ce2-0f03-41d0-8d4e-962500dcac53 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:59.847653 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef651ce2-0f03-41d0-8d4e-962500dcac53 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:59.848120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef651ce2-0f03-41d0-8d4e-962500dcac53 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:59.848550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef651ce2-0f03-41d0-8d4e-962500dcac53 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:59.849238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef651ce2-0f03-41d0-8d4e-962500dcac53 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:59.849681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef651ce2-0f03-41d0-8d4e-962500dcac53 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:59.850092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ef651ce2-0f03-41d0-8d4e-962500dcac53 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:59.979277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ef651ce2-0f03-41d0-8d4e-962500dcac53 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:59.989032 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ef651ce2-0f03-41d0-8d4e-962500dcac53 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152672 Sep 01 05:40:59.989536 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1223/2527] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:59 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:01.011222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d92133c9-6146-492a-bcb3-2c2fa55b2a94 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:01.011863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d92133c9-6146-492a-bcb3-2c2fa55b2a94 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:01.018277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d92133c9-6146-492a-bcb3-2c2fa55b2a94 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:01.018747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d92133c9-6146-492a-bcb3-2c2fa55b2a94 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:01.019173 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d92133c9-6146-492a-bcb3-2c2fa55b2a94 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:01.019845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d92133c9-6146-492a-bcb3-2c2fa55b2a94 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:01.020287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d92133c9-6146-492a-bcb3-2c2fa55b2a94 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:01.020700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d92133c9-6146-492a-bcb3-2c2fa55b2a94 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:01.150264 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d92133c9-6146-492a-bcb3-2c2fa55b2a94 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:01.159373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d92133c9-6146-492a-bcb3-2c2fa55b2a94 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152809 Sep 01 05:41:01.159936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1305/2528] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:01 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:02.181484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0dba5741-a126-4256-b2e1-872f8f8d29a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:02.182042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0dba5741-a126-4256-b2e1-872f8f8d29a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:02.188526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0dba5741-a126-4256-b2e1-872f8f8d29a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:02.189044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0dba5741-a126-4256-b2e1-872f8f8d29a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:02.189484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0dba5741-a126-4256-b2e1-872f8f8d29a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:02.190167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0dba5741-a126-4256-b2e1-872f8f8d29a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:02.190618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0dba5741-a126-4256-b2e1-872f8f8d29a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:02.191041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0dba5741-a126-4256-b2e1-872f8f8d29a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:02.322939 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0dba5741-a126-4256-b2e1-872f8f8d29a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:02.330999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0dba5741-a126-4256-b2e1-872f8f8d29a9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153519 Sep 01 05:41:02.331560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1224/2529] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:02 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:03.352982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e893dfc2-2bbb-4939-a84f-f4b476eab7b2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:03.353534 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e893dfc2-2bbb-4939-a84f-f4b476eab7b2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:03.361084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e893dfc2-2bbb-4939-a84f-f4b476eab7b2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:03.361562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e893dfc2-2bbb-4939-a84f-f4b476eab7b2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:03.362004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e893dfc2-2bbb-4939-a84f-f4b476eab7b2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:03.362683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e893dfc2-2bbb-4939-a84f-f4b476eab7b2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:03.363132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e893dfc2-2bbb-4939-a84f-f4b476eab7b2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:03.363552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e893dfc2-2bbb-4939-a84f-f4b476eab7b2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:03.492899 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e893dfc2-2bbb-4939-a84f-f4b476eab7b2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:03.501156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e893dfc2-2bbb-4939-a84f-f4b476eab7b2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152109 Sep 01 05:41:03.501725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1306/2530] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:03 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:04.522881 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-891e8efa-9b3d-41d5-92dc-5499f812b885 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:04.523499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-891e8efa-9b3d-41d5-92dc-5499f812b885 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:04.530608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-891e8efa-9b3d-41d5-92dc-5499f812b885 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:04.531090 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-891e8efa-9b3d-41d5-92dc-5499f812b885 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:04.531526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-891e8efa-9b3d-41d5-92dc-5499f812b885 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:04.532209 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-891e8efa-9b3d-41d5-92dc-5499f812b885 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:04.532661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-891e8efa-9b3d-41d5-92dc-5499f812b885 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:04.533110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-891e8efa-9b3d-41d5-92dc-5499f812b885 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:04.666397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-891e8efa-9b3d-41d5-92dc-5499f812b885 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:04.675935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-891e8efa-9b3d-41d5-92dc-5499f812b885 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156954 Sep 01 05:41:04.676501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1225/2531] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:04 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:05.697527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-191298a1-04b2-47b4-b272-a149e1da9b6a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:05.698132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-191298a1-04b2-47b4-b272-a149e1da9b6a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:05.704666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-191298a1-04b2-47b4-b272-a149e1da9b6a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:05.705169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-191298a1-04b2-47b4-b272-a149e1da9b6a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:05.705597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-191298a1-04b2-47b4-b272-a149e1da9b6a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:05.706266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-191298a1-04b2-47b4-b272-a149e1da9b6a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:05.706709 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-191298a1-04b2-47b4-b272-a149e1da9b6a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:05.707125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-191298a1-04b2-47b4-b272-a149e1da9b6a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:05.833411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-191298a1-04b2-47b4-b272-a149e1da9b6a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:05.842012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-191298a1-04b2-47b4-b272-a149e1da9b6a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.148313 Sep 01 05:41:05.842571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1307/2532] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:05 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:06.862776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dca3c570-8c46-47f4-92fb-fd692a7ed75b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:06.863414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dca3c570-8c46-47f4-92fb-fd692a7ed75b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:06.869904 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dca3c570-8c46-47f4-92fb-fd692a7ed75b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:06.870384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dca3c570-8c46-47f4-92fb-fd692a7ed75b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:06.870849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dca3c570-8c46-47f4-92fb-fd692a7ed75b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:06.871862 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dca3c570-8c46-47f4-92fb-fd692a7ed75b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:06.872321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dca3c570-8c46-47f4-92fb-fd692a7ed75b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:06.872743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dca3c570-8c46-47f4-92fb-fd692a7ed75b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:07.007217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dca3c570-8c46-47f4-92fb-fd692a7ed75b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:07.016470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dca3c570-8c46-47f4-92fb-fd692a7ed75b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.157630 Sep 01 05:41:07.017067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1226/2533] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:06 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:08.038708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-08b67e56-0243-47ec-b5e7-5abe726aeeb3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:08.039319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-08b67e56-0243-47ec-b5e7-5abe726aeeb3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:08.045827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08b67e56-0243-47ec-b5e7-5abe726aeeb3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:08.046302 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08b67e56-0243-47ec-b5e7-5abe726aeeb3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:08.046731 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08b67e56-0243-47ec-b5e7-5abe726aeeb3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:08.047406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08b67e56-0243-47ec-b5e7-5abe726aeeb3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:08.047851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08b67e56-0243-47ec-b5e7-5abe726aeeb3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:08.048270 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-08b67e56-0243-47ec-b5e7-5abe726aeeb3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:08.181173 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-08b67e56-0243-47ec-b5e7-5abe726aeeb3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:08.189306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-08b67e56-0243-47ec-b5e7-5abe726aeeb3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154627 Sep 01 05:41:08.189870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1308/2534] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:08 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:09.209809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1cc41ccf-783a-4913-bff1-40a7a15fc56e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:09.210392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1cc41ccf-783a-4913-bff1-40a7a15fc56e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:09.216916 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1cc41ccf-783a-4913-bff1-40a7a15fc56e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:09.217398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1cc41ccf-783a-4913-bff1-40a7a15fc56e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:09.217831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1cc41ccf-783a-4913-bff1-40a7a15fc56e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:09.218512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1cc41ccf-783a-4913-bff1-40a7a15fc56e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:09.218961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1cc41ccf-783a-4913-bff1-40a7a15fc56e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:09.219381 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1cc41ccf-783a-4913-bff1-40a7a15fc56e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:09.223285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=78 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:09.346721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1cc41ccf-783a-4913-bff1-40a7a15fc56e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:09.354902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1cc41ccf-783a-4913-bff1-40a7a15fc56e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149041 Sep 01 05:41:09.356052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1227/2535] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:09 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:10.377371 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-45caaf8a-46f1-4cce-9bb3-c265c134d894 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:10.377979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-45caaf8a-46f1-4cce-9bb3-c265c134d894 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:10.384244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45caaf8a-46f1-4cce-9bb3-c265c134d894 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:10.384715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45caaf8a-46f1-4cce-9bb3-c265c134d894 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:10.385169 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45caaf8a-46f1-4cce-9bb3-c265c134d894 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:10.385836 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45caaf8a-46f1-4cce-9bb3-c265c134d894 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:10.386279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45caaf8a-46f1-4cce-9bb3-c265c134d894 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:10.386706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-45caaf8a-46f1-4cce-9bb3-c265c134d894 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:10.512456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-45caaf8a-46f1-4cce-9bb3-c265c134d894 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:10.520557 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-45caaf8a-46f1-4cce-9bb3-c265c134d894 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.147046 Sep 01 05:41:10.521166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1309/2536] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:10 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:11.542543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-75bac6c6-f05a-4200-a326-e23d1fdef3bb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:11.543422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-75bac6c6-f05a-4200-a326-e23d1fdef3bb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:11.549948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-75bac6c6-f05a-4200-a326-e23d1fdef3bb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:11.550427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-75bac6c6-f05a-4200-a326-e23d1fdef3bb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:11.550883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-75bac6c6-f05a-4200-a326-e23d1fdef3bb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:11.551558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-75bac6c6-f05a-4200-a326-e23d1fdef3bb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:11.552007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-75bac6c6-f05a-4200-a326-e23d1fdef3bb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:11.552428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-75bac6c6-f05a-4200-a326-e23d1fdef3bb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:11.686278 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-75bac6c6-f05a-4200-a326-e23d1fdef3bb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:11.694409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-75bac6c6-f05a-4200-a326-e23d1fdef3bb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155755 Sep 01 05:41:11.694968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1228/2537] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:11 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:12.716292 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-aba379a1-cf62-4f2d-bc4e-514ace59c641 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:12.717004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-aba379a1-cf62-4f2d-bc4e-514ace59c641 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:12.723501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aba379a1-cf62-4f2d-bc4e-514ace59c641 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:12.723971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aba379a1-cf62-4f2d-bc4e-514ace59c641 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:12.724397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aba379a1-cf62-4f2d-bc4e-514ace59c641 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:12.725096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aba379a1-cf62-4f2d-bc4e-514ace59c641 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:12.725544 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aba379a1-cf62-4f2d-bc4e-514ace59c641 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:12.725957 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-aba379a1-cf62-4f2d-bc4e-514ace59c641 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:12.856314 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-aba379a1-cf62-4f2d-bc4e-514ace59c641 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:12.864380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-aba379a1-cf62-4f2d-bc4e-514ace59c641 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152088 Sep 01 05:41:12.864970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1310/2538] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:12 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:13.886918 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ad6e2bf8-63de-40ba-9ce3-edca34e94b06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:13.887669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ad6e2bf8-63de-40ba-9ce3-edca34e94b06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:13.893910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ad6e2bf8-63de-40ba-9ce3-edca34e94b06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:13.894389 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ad6e2bf8-63de-40ba-9ce3-edca34e94b06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:13.894821 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ad6e2bf8-63de-40ba-9ce3-edca34e94b06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:13.895509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ad6e2bf8-63de-40ba-9ce3-edca34e94b06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:13.895954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ad6e2bf8-63de-40ba-9ce3-edca34e94b06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:13.896377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ad6e2bf8-63de-40ba-9ce3-edca34e94b06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:14.024018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ad6e2bf8-63de-40ba-9ce3-edca34e94b06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:14.033092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ad6e2bf8-63de-40ba-9ce3-edca34e94b06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150667 Sep 01 05:41:14.033929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1229/2539] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:13 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:15.055289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cc879a44-2dce-4f78-a56c-deac437424c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:15.055941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cc879a44-2dce-4f78-a56c-deac437424c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:15.063133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc879a44-2dce-4f78-a56c-deac437424c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:15.063618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc879a44-2dce-4f78-a56c-deac437424c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:15.064059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc879a44-2dce-4f78-a56c-deac437424c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:15.064751 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc879a44-2dce-4f78-a56c-deac437424c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:15.065227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc879a44-2dce-4f78-a56c-deac437424c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:15.065651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cc879a44-2dce-4f78-a56c-deac437424c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:15.207905 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cc879a44-2dce-4f78-a56c-deac437424c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:15.217682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cc879a44-2dce-4f78-a56c-deac437424c2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.166265 Sep 01 05:41:15.218267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1311/2540] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:15 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:16.241081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-738430f8-9452-4e57-8dc0-2573d87964e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:16.241632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-738430f8-9452-4e57-8dc0-2573d87964e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:16.248734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-738430f8-9452-4e57-8dc0-2573d87964e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:16.249244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-738430f8-9452-4e57-8dc0-2573d87964e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:16.249683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-738430f8-9452-4e57-8dc0-2573d87964e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:16.250359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-738430f8-9452-4e57-8dc0-2573d87964e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:16.250810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-738430f8-9452-4e57-8dc0-2573d87964e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:16.251229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-738430f8-9452-4e57-8dc0-2573d87964e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:16.379527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-738430f8-9452-4e57-8dc0-2573d87964e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:16.388052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-738430f8-9452-4e57-8dc0-2573d87964e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150913 Sep 01 05:41:16.388605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1230/2541] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:16 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:17.408901 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9d603f4f-8389-44ca-95ad-1eb956e13496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:17.409510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9d603f4f-8389-44ca-95ad-1eb956e13496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:17.415810 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d603f4f-8389-44ca-95ad-1eb956e13496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:17.416286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d603f4f-8389-44ca-95ad-1eb956e13496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:17.416714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d603f4f-8389-44ca-95ad-1eb956e13496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:17.417410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d603f4f-8389-44ca-95ad-1eb956e13496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:17.417854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d603f4f-8389-44ca-95ad-1eb956e13496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:17.418271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d603f4f-8389-44ca-95ad-1eb956e13496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:17.422084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=78 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:17.548724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9d603f4f-8389-44ca-95ad-1eb956e13496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:17.556857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9d603f4f-8389-44ca-95ad-1eb956e13496 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152198 Sep 01 05:41:17.557456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1312/2542] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:17 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:18.578929 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-90e4ca82-67f4-4fbf-863f-d4d1718d4cd4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:18.579530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-90e4ca82-67f4-4fbf-863f-d4d1718d4cd4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:18.586031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90e4ca82-67f4-4fbf-863f-d4d1718d4cd4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:18.586514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90e4ca82-67f4-4fbf-863f-d4d1718d4cd4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:18.586947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90e4ca82-67f4-4fbf-863f-d4d1718d4cd4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:18.587618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90e4ca82-67f4-4fbf-863f-d4d1718d4cd4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:18.588066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90e4ca82-67f4-4fbf-863f-d4d1718d4cd4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:18.588487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-90e4ca82-67f4-4fbf-863f-d4d1718d4cd4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:18.722986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-90e4ca82-67f4-4fbf-863f-d4d1718d4cd4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:18.731662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-90e4ca82-67f4-4fbf-863f-d4d1718d4cd4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156658 Sep 01 05:41:18.732220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1231/2543] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:18 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:41:19.752686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2a23215e-75c2-4d71-a953-09d10b353013 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:19.753312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2a23215e-75c2-4d71-a953-09d10b353013 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:19.759857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a23215e-75c2-4d71-a953-09d10b353013 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:19.760335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a23215e-75c2-4d71-a953-09d10b353013 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:19.760785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a23215e-75c2-4d71-a953-09d10b353013 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:19.762117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a23215e-75c2-4d71-a953-09d10b353013 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:19.762565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a23215e-75c2-4d71-a953-09d10b353013 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:19.762986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a23215e-75c2-4d71-a953-09d10b353013 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:19.889946 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2a23215e-75c2-4d71-a953-09d10b353013 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:19.898464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2a23215e-75c2-4d71-a953-09d10b353013 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149656 Sep 01 05:41:19.899045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1313/2544] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:19 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:41:20.920451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fe287ff4-a8ee-4632-83fc-13ab068014a8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:20.921086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fe287ff4-a8ee-4632-83fc-13ab068014a8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:20.927639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe287ff4-a8ee-4632-83fc-13ab068014a8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:20.928119 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe287ff4-a8ee-4632-83fc-13ab068014a8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:20.928553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe287ff4-a8ee-4632-83fc-13ab068014a8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:20.929264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe287ff4-a8ee-4632-83fc-13ab068014a8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:20.929741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe287ff4-a8ee-4632-83fc-13ab068014a8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:20.930164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fe287ff4-a8ee-4632-83fc-13ab068014a8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:21.062884 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fe287ff4-a8ee-4632-83fc-13ab068014a8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:21.070990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fe287ff4-a8ee-4632-83fc-13ab068014a8 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154911 Sep 01 05:41:21.071548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1232/2545] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:20 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:22.092053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ec2bee13-7b44-4935-b230-e6bb3be279f0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:22.092673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ec2bee13-7b44-4935-b230-e6bb3be279f0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:22.099113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec2bee13-7b44-4935-b230-e6bb3be279f0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:22.099592 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec2bee13-7b44-4935-b230-e6bb3be279f0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:22.100029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec2bee13-7b44-4935-b230-e6bb3be279f0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:22.100716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec2bee13-7b44-4935-b230-e6bb3be279f0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:22.101195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec2bee13-7b44-4935-b230-e6bb3be279f0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:22.101621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec2bee13-7b44-4935-b230-e6bb3be279f0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:22.230267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ec2bee13-7b44-4935-b230-e6bb3be279f0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:22.238677 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ec2bee13-7b44-4935-b230-e6bb3be279f0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150724 Sep 01 05:41:22.239278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1314/2546] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:22 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:23.260728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4a9cdd15-84a0-45f9-9567-23d7b828df06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:23.261357 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4a9cdd15-84a0-45f9-9567-23d7b828df06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:23.267897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a9cdd15-84a0-45f9-9567-23d7b828df06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:23.268373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a9cdd15-84a0-45f9-9567-23d7b828df06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:23.268832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a9cdd15-84a0-45f9-9567-23d7b828df06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:23.269511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a9cdd15-84a0-45f9-9567-23d7b828df06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:23.269959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a9cdd15-84a0-45f9-9567-23d7b828df06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:23.270375 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4a9cdd15-84a0-45f9-9567-23d7b828df06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:23.400146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4a9cdd15-84a0-45f9-9567-23d7b828df06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:23.408313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4a9cdd15-84a0-45f9-9567-23d7b828df06 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151607 Sep 01 05:41:23.409174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1233/2547] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:23 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:24.430247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ef32803d-d740-4c06-be30-4d1d97ffeb2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:24.430856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ef32803d-d740-4c06-be30-4d1d97ffeb2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:24.438267 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ef32803d-d740-4c06-be30-4d1d97ffeb2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:24.438842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ef32803d-d740-4c06-be30-4d1d97ffeb2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:24.439281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ef32803d-d740-4c06-be30-4d1d97ffeb2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:24.439960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ef32803d-d740-4c06-be30-4d1d97ffeb2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:24.440408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ef32803d-d740-4c06-be30-4d1d97ffeb2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:24.440850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ef32803d-d740-4c06-be30-4d1d97ffeb2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:24.577385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ef32803d-d740-4c06-be30-4d1d97ffeb2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:24.585458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ef32803d-d740-4c06-be30-4d1d97ffeb2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.159163 Sep 01 05:41:24.586022 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1315/2548] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:24 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:25.606261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0002219e-87df-4b77-aa65-3b752151a511 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:25.606874 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0002219e-87df-4b77-aa65-3b752151a511 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:25.613279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0002219e-87df-4b77-aa65-3b752151a511 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:25.613751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0002219e-87df-4b77-aa65-3b752151a511 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:25.614179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0002219e-87df-4b77-aa65-3b752151a511 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:25.614852 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0002219e-87df-4b77-aa65-3b752151a511 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:25.615296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0002219e-87df-4b77-aa65-3b752151a511 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:25.615718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0002219e-87df-4b77-aa65-3b752151a511 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:25.743363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0002219e-87df-4b77-aa65-3b752151a511 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:25.751580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0002219e-87df-4b77-aa65-3b752151a511 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149247 Sep 01 05:41:25.752178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1234/2549] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:25 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:26.773201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e39b3045-2366-406c-84e3-354dbe0aa390 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:26.773811 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e39b3045-2366-406c-84e3-354dbe0aa390 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:26.776200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=26 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:26.781717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e39b3045-2366-406c-84e3-354dbe0aa390 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:26.782191 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e39b3045-2366-406c-84e3-354dbe0aa390 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:26.782620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e39b3045-2366-406c-84e3-354dbe0aa390 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:26.783293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e39b3045-2366-406c-84e3-354dbe0aa390 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:26.784004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e39b3045-2366-406c-84e3-354dbe0aa390 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:26.784420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e39b3045-2366-406c-84e3-354dbe0aa390 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:26.913703 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e39b3045-2366-406c-84e3-354dbe0aa390 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:26.922934 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e39b3045-2366-406c-84e3-354dbe0aa390 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153544 Sep 01 05:41:26.923509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1316/2550] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:26 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:27.944057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1d2a8680-5926-4ad9-81f0-444e58f99b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:27.944664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1d2a8680-5926-4ad9-81f0-444e58f99b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:27.946983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=26 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:27.952610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d2a8680-5926-4ad9-81f0-444e58f99b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:27.953109 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d2a8680-5926-4ad9-81f0-444e58f99b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:27.953535 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d2a8680-5926-4ad9-81f0-444e58f99b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:27.954214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d2a8680-5926-4ad9-81f0-444e58f99b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:27.954654 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d2a8680-5926-4ad9-81f0-444e58f99b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:27.955067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d2a8680-5926-4ad9-81f0-444e58f99b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:28.083823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1d2a8680-5926-4ad9-81f0-444e58f99b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:28.092648 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1d2a8680-5926-4ad9-81f0-444e58f99b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152479 Sep 01 05:41:28.093249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1235/2551] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:27 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:29.113642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-af8a378d-9cd1-4d1d-997d-f2e0ec6c9247 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:29.114288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-af8a378d-9cd1-4d1d-997d-f2e0ec6c9247 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:29.121313 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af8a378d-9cd1-4d1d-997d-f2e0ec6c9247 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:29.121775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af8a378d-9cd1-4d1d-997d-f2e0ec6c9247 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:29.122215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af8a378d-9cd1-4d1d-997d-f2e0ec6c9247 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:29.122883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af8a378d-9cd1-4d1d-997d-f2e0ec6c9247 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:29.123325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af8a378d-9cd1-4d1d-997d-f2e0ec6c9247 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:29.123739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af8a378d-9cd1-4d1d-997d-f2e0ec6c9247 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:29.255192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-af8a378d-9cd1-4d1d-997d-f2e0ec6c9247 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:29.265921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-af8a378d-9cd1-4d1d-997d-f2e0ec6c9247 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156059 Sep 01 05:41:29.266508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1317/2552] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:29 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:30.288427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3c93d943-a2eb-43d4-8009-717da5c6b504 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:30.288986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3c93d943-a2eb-43d4-8009-717da5c6b504 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:30.296058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c93d943-a2eb-43d4-8009-717da5c6b504 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:30.296529 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c93d943-a2eb-43d4-8009-717da5c6b504 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:30.296990 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c93d943-a2eb-43d4-8009-717da5c6b504 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:30.297665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c93d943-a2eb-43d4-8009-717da5c6b504 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:30.298104 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c93d943-a2eb-43d4-8009-717da5c6b504 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:30.298513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c93d943-a2eb-43d4-8009-717da5c6b504 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:30.431339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3c93d943-a2eb-43d4-8009-717da5c6b504 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:30.440033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3c93d943-a2eb-43d4-8009-717da5c6b504 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155507 Sep 01 05:41:30.440592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1236/2553] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:30 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:31.461075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c29bd6a4-c811-4127-b247-3f512c6a7bc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:31.461689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c29bd6a4-c811-4127-b247-3f512c6a7bc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:31.468117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c29bd6a4-c811-4127-b247-3f512c6a7bc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:31.468590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c29bd6a4-c811-4127-b247-3f512c6a7bc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:31.469067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c29bd6a4-c811-4127-b247-3f512c6a7bc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:31.469749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c29bd6a4-c811-4127-b247-3f512c6a7bc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:31.470197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c29bd6a4-c811-4127-b247-3f512c6a7bc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:31.470618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c29bd6a4-c811-4127-b247-3f512c6a7bc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:31.598989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c29bd6a4-c811-4127-b247-3f512c6a7bc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:31.607666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c29bd6a4-c811-4127-b247-3f512c6a7bc1 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150461 Sep 01 05:41:31.608224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1318/2554] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:31 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:32.628924 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-aa57b1fb-b54c-44bd-91ef-7e69fccd7d2b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:32.629556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-aa57b1fb-b54c-44bd-91ef-7e69fccd7d2b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:32.635931 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa57b1fb-b54c-44bd-91ef-7e69fccd7d2b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:32.637064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa57b1fb-b54c-44bd-91ef-7e69fccd7d2b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:32.637672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa57b1fb-b54c-44bd-91ef-7e69fccd7d2b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:32.638347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa57b1fb-b54c-44bd-91ef-7e69fccd7d2b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:32.638794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa57b1fb-b54c-44bd-91ef-7e69fccd7d2b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:32.639207 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa57b1fb-b54c-44bd-91ef-7e69fccd7d2b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:32.766193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-aa57b1fb-b54c-44bd-91ef-7e69fccd7d2b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:32.774245 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-aa57b1fb-b54c-44bd-91ef-7e69fccd7d2b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149236 Sep 01 05:41:32.774814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1237/2555] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:32 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:33.798124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ae056c7e-a588-473f-b793-16692d8ba665 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:33.798761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ae056c7e-a588-473f-b793-16692d8ba665 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:33.805218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae056c7e-a588-473f-b793-16692d8ba665 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:33.805696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae056c7e-a588-473f-b793-16692d8ba665 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:33.806129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae056c7e-a588-473f-b793-16692d8ba665 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:33.806808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae056c7e-a588-473f-b793-16692d8ba665 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:33.807256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae056c7e-a588-473f-b793-16692d8ba665 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:33.807674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ae056c7e-a588-473f-b793-16692d8ba665 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:33.937787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ae056c7e-a588-473f-b793-16692d8ba665 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:33.945945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ae056c7e-a588-473f-b793-16692d8ba665 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153548 Sep 01 05:41:33.946512 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1319/2556] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:33 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:41:34.966973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6948258b-5a3e-47a9-a96e-0a1cc7a97b73 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:34.967580 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6948258b-5a3e-47a9-a96e-0a1cc7a97b73 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:34.974176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6948258b-5a3e-47a9-a96e-0a1cc7a97b73 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:34.974646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6948258b-5a3e-47a9-a96e-0a1cc7a97b73 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:34.975070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6948258b-5a3e-47a9-a96e-0a1cc7a97b73 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:34.975740 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6948258b-5a3e-47a9-a96e-0a1cc7a97b73 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:34.976179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6948258b-5a3e-47a9-a96e-0a1cc7a97b73 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:34.976593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6948258b-5a3e-47a9-a96e-0a1cc7a97b73 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:35.107762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6948258b-5a3e-47a9-a96e-0a1cc7a97b73 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:35.115904 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6948258b-5a3e-47a9-a96e-0a1cc7a97b73 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152962 Sep 01 05:41:35.116468 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1238/2557] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:34 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:36.137062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-04783445-7ae6-4153-b20d-c1a4d72d57d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:36.137673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-04783445-7ae6-4153-b20d-c1a4d72d57d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:36.144109 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04783445-7ae6-4153-b20d-c1a4d72d57d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:36.144581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04783445-7ae6-4153-b20d-c1a4d72d57d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:36.145095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04783445-7ae6-4153-b20d-c1a4d72d57d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:36.145714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04783445-7ae6-4153-b20d-c1a4d72d57d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:36.146141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04783445-7ae6-4153-b20d-c1a4d72d57d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:36.146556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04783445-7ae6-4153-b20d-c1a4d72d57d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:36.277528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-04783445-7ae6-4153-b20d-c1a4d72d57d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:36.285869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-04783445-7ae6-4153-b20d-c1a4d72d57d0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152758 Sep 01 05:41:36.286427 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1320/2558] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:36 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:37.307474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9301acd1-2eac-4967-8e57-8e6fe5255381 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:37.308067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9301acd1-2eac-4967-8e57-8e6fe5255381 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:37.314621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9301acd1-2eac-4967-8e57-8e6fe5255381 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:37.315104 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9301acd1-2eac-4967-8e57-8e6fe5255381 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:37.315544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9301acd1-2eac-4967-8e57-8e6fe5255381 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:37.316234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9301acd1-2eac-4967-8e57-8e6fe5255381 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:37.316684 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9301acd1-2eac-4967-8e57-8e6fe5255381 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:37.317135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9301acd1-2eac-4967-8e57-8e6fe5255381 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:37.444799 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9301acd1-2eac-4967-8e57-8e6fe5255381 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:37.453505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9301acd1-2eac-4967-8e57-8e6fe5255381 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149965 Sep 01 05:41:37.454070 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1239/2559] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:37 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:38.475343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c1457b55-d346-4743-a3ef-6c65ad35a7c4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:38.475898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c1457b55-d346-4743-a3ef-6c65ad35a7c4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:38.482394 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1457b55-d346-4743-a3ef-6c65ad35a7c4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:38.482866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1457b55-d346-4743-a3ef-6c65ad35a7c4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:38.483299 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1457b55-d346-4743-a3ef-6c65ad35a7c4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:38.483965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1457b55-d346-4743-a3ef-6c65ad35a7c4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:38.484404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1457b55-d346-4743-a3ef-6c65ad35a7c4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:38.484840 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c1457b55-d346-4743-a3ef-6c65ad35a7c4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:38.613294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c1457b55-d346-4743-a3ef-6c65ad35a7c4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:38.621505 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c1457b55-d346-4743-a3ef-6c65ad35a7c4 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150166 Sep 01 05:41:38.622075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1321/2560] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:38 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:39.642412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-472c5faa-55bc-4052-b1b5-56ac71041ea3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:39.643025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-472c5faa-55bc-4052-b1b5-56ac71041ea3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:39.649398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-472c5faa-55bc-4052-b1b5-56ac71041ea3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:39.649878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-472c5faa-55bc-4052-b1b5-56ac71041ea3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:39.650309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-472c5faa-55bc-4052-b1b5-56ac71041ea3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:39.650974 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-472c5faa-55bc-4052-b1b5-56ac71041ea3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:39.651478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-472c5faa-55bc-4052-b1b5-56ac71041ea3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:39.652608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-472c5faa-55bc-4052-b1b5-56ac71041ea3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:39.655124 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=78 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:39.784656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-472c5faa-55bc-4052-b1b5-56ac71041ea3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:39.792854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-472c5faa-55bc-4052-b1b5-56ac71041ea3 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154262 Sep 01 05:41:39.793490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1240/2561] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:39 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:40.814356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-75d092f4-ed44-4be7-9364-e7efce99e480 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:40.814947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-75d092f4-ed44-4be7-9364-e7efce99e480 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:40.821898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-75d092f4-ed44-4be7-9364-e7efce99e480 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:40.822372 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-75d092f4-ed44-4be7-9364-e7efce99e480 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:40.823001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-75d092f4-ed44-4be7-9364-e7efce99e480 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:40.824509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-75d092f4-ed44-4be7-9364-e7efce99e480 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:40.824983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-75d092f4-ed44-4be7-9364-e7efce99e480 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:40.825404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-75d092f4-ed44-4be7-9364-e7efce99e480 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:40.957408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-75d092f4-ed44-4be7-9364-e7efce99e480 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:40.965530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-75d092f4-ed44-4be7-9364-e7efce99e480 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155000 Sep 01 05:41:40.966094 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1322/2562] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:40 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:41.986417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f8ab5285-6329-48b2-ae56-66ac7a951729 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:41.987030 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f8ab5285-6329-48b2-ae56-66ac7a951729 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:41.993953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8ab5285-6329-48b2-ae56-66ac7a951729 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:41.994432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8ab5285-6329-48b2-ae56-66ac7a951729 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:41.994866 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8ab5285-6329-48b2-ae56-66ac7a951729 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:41.995573 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8ab5285-6329-48b2-ae56-66ac7a951729 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:41.996020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8ab5285-6329-48b2-ae56-66ac7a951729 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:41.996438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f8ab5285-6329-48b2-ae56-66ac7a951729 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:42.125498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f8ab5285-6329-48b2-ae56-66ac7a951729 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:42.133783 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f8ab5285-6329-48b2-ae56-66ac7a951729 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151310 Sep 01 05:41:42.134348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1241/2563] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:41 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:43.154609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2598815e-093d-4762-adb0-20544f30ac2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:43.155152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2598815e-093d-4762-adb0-20544f30ac2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:43.161879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2598815e-093d-4762-adb0-20544f30ac2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:43.162361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2598815e-093d-4762-adb0-20544f30ac2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:43.162793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2598815e-093d-4762-adb0-20544f30ac2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:43.163473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2598815e-093d-4762-adb0-20544f30ac2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:43.163922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2598815e-093d-4762-adb0-20544f30ac2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:43.164346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2598815e-093d-4762-adb0-20544f30ac2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:43.291821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2598815e-093d-4762-adb0-20544f30ac2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:43.300312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2598815e-093d-4762-adb0-20544f30ac2e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149783 Sep 01 05:41:43.301013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1323/2564] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:43 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:44.322371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1504f4e9-fa59-4078-9a14-630e25e066e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:44.322979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1504f4e9-fa59-4078-9a14-630e25e066e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:44.329949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1504f4e9-fa59-4078-9a14-630e25e066e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:44.330426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1504f4e9-fa59-4078-9a14-630e25e066e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:44.330859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1504f4e9-fa59-4078-9a14-630e25e066e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:44.331531 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1504f4e9-fa59-4078-9a14-630e25e066e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:44.331977 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1504f4e9-fa59-4078-9a14-630e25e066e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:44.332398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1504f4e9-fa59-4078-9a14-630e25e066e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:44.463100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1504f4e9-fa59-4078-9a14-630e25e066e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:44.472500 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1504f4e9-fa59-4078-9a14-630e25e066e7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154120 Sep 01 05:41:44.473136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1242/2565] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:44 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:45.494522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e479c548-cf17-48e7-872e-38d17c0e81f9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:45.495170 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e479c548-cf17-48e7-872e-38d17c0e81f9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:45.502591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e479c548-cf17-48e7-872e-38d17c0e81f9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:45.503076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e479c548-cf17-48e7-872e-38d17c0e81f9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:45.503491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e479c548-cf17-48e7-872e-38d17c0e81f9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:45.504161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e479c548-cf17-48e7-872e-38d17c0e81f9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:45.504603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e479c548-cf17-48e7-872e-38d17c0e81f9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:45.505047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e479c548-cf17-48e7-872e-38d17c0e81f9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:45.635323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e479c548-cf17-48e7-872e-38d17c0e81f9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:45.644051 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e479c548-cf17-48e7-872e-38d17c0e81f9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153395 Sep 01 05:41:45.644606 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1324/2566] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:45 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:46.665128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9365715b-81b4-41c0-9987-6cbf9ed2a338 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:46.665808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9365715b-81b4-41c0-9987-6cbf9ed2a338 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:46.672098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9365715b-81b4-41c0-9987-6cbf9ed2a338 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:46.672572 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9365715b-81b4-41c0-9987-6cbf9ed2a338 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:46.673034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9365715b-81b4-41c0-9987-6cbf9ed2a338 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:46.673713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9365715b-81b4-41c0-9987-6cbf9ed2a338 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:46.674156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9365715b-81b4-41c0-9987-6cbf9ed2a338 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:46.674568 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9365715b-81b4-41c0-9987-6cbf9ed2a338 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:46.806398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9365715b-81b4-41c0-9987-6cbf9ed2a338 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:46.815084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9365715b-81b4-41c0-9987-6cbf9ed2a338 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153899 Sep 01 05:41:46.815644 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1243/2567] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:46 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:47.835600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1d559951-be82-4f97-850f-f4f07913b10c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:47.836195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1d559951-be82-4f97-850f-f4f07913b10c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:47.842718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d559951-be82-4f97-850f-f4f07913b10c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:47.843195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d559951-be82-4f97-850f-f4f07913b10c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:47.843625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d559951-be82-4f97-850f-f4f07913b10c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:47.844303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d559951-be82-4f97-850f-f4f07913b10c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:47.844752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d559951-be82-4f97-850f-f4f07913b10c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:47.845197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1d559951-be82-4f97-850f-f4f07913b10c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:47.847686 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=78 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:47.975681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1d559951-be82-4f97-850f-f4f07913b10c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:47.984764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1d559951-be82-4f97-850f-f4f07913b10c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153149 Sep 01 05:41:47.985352 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1325/2568] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:47 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:49.006843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bb1083d2-a801-49d3-a7cd-189105227e34 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:49.007457 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bb1083d2-a801-49d3-a7cd-189105227e34 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:49.014575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb1083d2-a801-49d3-a7cd-189105227e34 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:49.015055 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb1083d2-a801-49d3-a7cd-189105227e34 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:49.015489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb1083d2-a801-49d3-a7cd-189105227e34 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:49.016164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb1083d2-a801-49d3-a7cd-189105227e34 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:49.016622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb1083d2-a801-49d3-a7cd-189105227e34 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:49.017066 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bb1083d2-a801-49d3-a7cd-189105227e34 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:49.144767 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bb1083d2-a801-49d3-a7cd-189105227e34 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:49.154174 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bb1083d2-a801-49d3-a7cd-189105227e34 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151176 Sep 01 05:41:49.155144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1244/2569] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:49 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:49.319152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2a43349e-88cd-4887-b9ee-3aaea72398e4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:49.319669 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2a43349e-88cd-4887-b9ee-3aaea72398e4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:49.326212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a43349e-88cd-4887-b9ee-3aaea72398e4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:49.326696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a43349e-88cd-4887-b9ee-3aaea72398e4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:49.327136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a43349e-88cd-4887-b9ee-3aaea72398e4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:49.327826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a43349e-88cd-4887-b9ee-3aaea72398e4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:49.328281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a43349e-88cd-4887-b9ee-3aaea72398e4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:49.328721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a43349e-88cd-4887-b9ee-3aaea72398e4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:49.342667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-2a43349e-88cd-4887-b9ee-3aaea72398e4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] HTTP exception thrown: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2a43349e-88cd-4887-b9ee-3aaea72398e4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Request method failure captured: Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: DELETE /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 HTTP/1.1 Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED-1ohArlcqyRQ3GM507mA8OeXhOwsTxgdizBpUNvCXmYXtRJMNdNMgvI2W73Djx5cuX-C6AuLvmhil688UiqvfZJECg1ycfiaSmD_FKvrkAwJR5Xs7U03aCnPlyNSCUltTGf9uM8U0IVZaVqbGURDD7lAhQ22x2H6IZ5nnsuIOeX5w Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 6c302f5c44be49e5ae6e7e6b8b1f6c1c Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:41:49.344368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:41:49.346227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6c302f5c44be49e5ae6e7e6b8b1f6c1c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}] Sep 01 05:41:49.346227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:41:49.346227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 6c302f5c44be49e5ae6e7e6b8b1f6c1c Sep 01 05:41:49.346227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:41:49.346227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeTestJSON-846640785-project Sep 01 05:41:49.346227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:41:49.346227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:41:49.346227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 11f90807029244ecb6ad7cf6e4d2ad80 Sep 01 05:41:49.346227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeTestJSON-846640785-project Sep 01 05:41:49.346227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:41:49.346227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:41:49.346227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '3674edea-d05c-428c-896e-938f3891acc1'} Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:49.347437 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:41:49.349383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:41:49.351102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2a43349e-88cd-4887-b9ee-3aaea72398e4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Returning 404 to user: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:49.351102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2a43349e-88cd-4887-b9ee-3aaea72398e4 tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 404 len: 111 microversion: 2.1 time: 0.030463 Sep 01 05:41:49.351102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1326/2570] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:41:49 2022] DELETE /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:41:49.354214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-756f8a90-caf0-43a5-9fe7-1ad7e743f37d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:49.354893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-756f8a90-caf0-43a5-9fe7-1ad7e743f37d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] [instance: 3674edea-d05c-428c-896e-938f3891acc1] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:49.361524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-756f8a90-caf0-43a5-9fe7-1ad7e743f37d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:49.362009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-756f8a90-caf0-43a5-9fe7-1ad7e743f37d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:49.362438 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-756f8a90-caf0-43a5-9fe7-1ad7e743f37d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:49.363110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-756f8a90-caf0-43a5-9fe7-1ad7e743f37d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:49.363550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-756f8a90-caf0-43a5-9fe7-1ad7e743f37d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:49.363963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-756f8a90-caf0-43a5-9fe7-1ad7e743f37d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:49.377243 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-756f8a90-caf0-43a5-9fe7-1ad7e743f37d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] HTTP exception thrown: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-756f8a90-caf0-43a5-9fe7-1ad7e743f37d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Request method failure captured: Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 HTTP/1.1 Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED-1ohArlcqyRQ3GM507mA8OeXhOwsTxgdizBpUNvCXmYXtRJMNdNMgvI2W73Djx5cuX-C6AuLvmhil688UiqvfZJECg1ycfiaSmD_FKvrkAwJR5Xs7U03aCnPlyNSCUltTGf9uM8U0IVZaVqbGURDD7lAhQ22x2H6IZ5nnsuIOeX5w Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 6c302f5c44be49e5ae6e7e6b8b1f6c1c Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:41:49.378851 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:41:49.380548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6c302f5c44be49e5ae6e7e6b8b1f6c1c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6c302f5c44be49e5ae6e7e6b8b1f6c1c"}]}] Sep 01 05:41:49.380548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:41:49.380548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 6c302f5c44be49e5ae6e7e6b8b1f6c1c Sep 01 05:41:49.380548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-AttachVolumeTestJSON-846640785 Sep 01 05:41:49.380548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-AttachVolumeTestJSON-846640785-project Sep 01 05:41:49.380548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:41:49.380548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:41:49.380548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 11f90807029244ecb6ad7cf6e4d2ad80 Sep 01 05:41:49.380548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-AttachVolumeTestJSON-846640785-project Sep 01 05:41:49.380548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:41:49.380548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:41:49.380548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '3674edea-d05c-428c-896e-938f3891acc1'} Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:41:49.381719 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. Sep 01 05:41:49.383412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:41:49.384980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-756f8a90-caf0-43a5-9fe7-1ad7e743f37d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] Returning 404 to user: Instance 3674edea-d05c-428c-896e-938f3891acc1 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:41:49.384980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-756f8a90-caf0-43a5-9fe7-1ad7e743f37d tempest-AttachVolumeTestJSON-846640785 tempest-AttachVolumeTestJSON-846640785-project] 10.222.0.49 "GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1" status: 404 len: 111 microversion: 2.1 time: 0.029821 Sep 01 05:41:49.384980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1245/2571] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:49 2022] GET /compute/v2.1/servers/3674edea-d05c-428c-896e-938f3891acc1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:41:50.176801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-091815a4-0dc5-435f-a68e-d15a07611f9e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:50.177432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-091815a4-0dc5-435f-a68e-d15a07611f9e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:50.183346 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-091815a4-0dc5-435f-a68e-d15a07611f9e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:50.183834 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-091815a4-0dc5-435f-a68e-d15a07611f9e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:50.184271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-091815a4-0dc5-435f-a68e-d15a07611f9e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:50.185116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-091815a4-0dc5-435f-a68e-d15a07611f9e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:50.185866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-091815a4-0dc5-435f-a68e-d15a07611f9e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:50.186630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-091815a4-0dc5-435f-a68e-d15a07611f9e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:50.323419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-091815a4-0dc5-435f-a68e-d15a07611f9e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:50.333487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-091815a4-0dc5-435f-a68e-d15a07611f9e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.160516 Sep 01 05:41:50.334075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1327/2572] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:50 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:51.355698 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-aa16cb8e-c2ce-46e7-8524-29f826b27b50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:51.356306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-aa16cb8e-c2ce-46e7-8524-29f826b27b50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:51.362737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa16cb8e-c2ce-46e7-8524-29f826b27b50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:51.363221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa16cb8e-c2ce-46e7-8524-29f826b27b50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:51.363655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa16cb8e-c2ce-46e7-8524-29f826b27b50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:51.364353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa16cb8e-c2ce-46e7-8524-29f826b27b50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:51.364849 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa16cb8e-c2ce-46e7-8524-29f826b27b50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:51.365401 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aa16cb8e-c2ce-46e7-8524-29f826b27b50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:51.602299 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-aa16cb8e-c2ce-46e7-8524-29f826b27b50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:51.611975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-aa16cb8e-c2ce-46e7-8524-29f826b27b50 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.260308 Sep 01 05:41:51.612835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1246/2573] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:51 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:52.634452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0ff1eb80-90d1-49d9-9058-80fbf0e317aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:52.636099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0ff1eb80-90d1-49d9-9058-80fbf0e317aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:52.644065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ff1eb80-90d1-49d9-9058-80fbf0e317aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:52.645206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ff1eb80-90d1-49d9-9058-80fbf0e317aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:52.645902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ff1eb80-90d1-49d9-9058-80fbf0e317aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:52.646785 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ff1eb80-90d1-49d9-9058-80fbf0e317aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:52.657764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ff1eb80-90d1-49d9-9058-80fbf0e317aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:52.658323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0ff1eb80-90d1-49d9-9058-80fbf0e317aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:52.946826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0ff1eb80-90d1-49d9-9058-80fbf0e317aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:52.956225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0ff1eb80-90d1-49d9-9058-80fbf0e317aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.326026 Sep 01 05:41:52.956824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1328/2574] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:52 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:53.978446 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a8794e29-0ed5-4ca1-ad9b-60b900934e95 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:53.979100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a8794e29-0ed5-4ca1-ad9b-60b900934e95 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:53.997522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a8794e29-0ed5-4ca1-ad9b-60b900934e95 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:53.998071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a8794e29-0ed5-4ca1-ad9b-60b900934e95 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:53.998504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a8794e29-0ed5-4ca1-ad9b-60b900934e95 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:53.999565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a8794e29-0ed5-4ca1-ad9b-60b900934e95 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:54.000019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a8794e29-0ed5-4ca1-ad9b-60b900934e95 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:54.000441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a8794e29-0ed5-4ca1-ad9b-60b900934e95 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:54.138417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a8794e29-0ed5-4ca1-ad9b-60b900934e95 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:54.146734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a8794e29-0ed5-4ca1-ad9b-60b900934e95 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.172078 Sep 01 05:41:54.147336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1247/2575] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:53 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:55.171429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d92aeb2a-e59e-4344-a18a-8602d46c718e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:55.172620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d92aeb2a-e59e-4344-a18a-8602d46c718e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:55.179097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d92aeb2a-e59e-4344-a18a-8602d46c718e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:55.179838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d92aeb2a-e59e-4344-a18a-8602d46c718e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:55.180274 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d92aeb2a-e59e-4344-a18a-8602d46c718e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:55.180993 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d92aeb2a-e59e-4344-a18a-8602d46c718e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:55.181440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d92aeb2a-e59e-4344-a18a-8602d46c718e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:55.181859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d92aeb2a-e59e-4344-a18a-8602d46c718e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:55.410330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d92aeb2a-e59e-4344-a18a-8602d46c718e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:55.419758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d92aeb2a-e59e-4344-a18a-8602d46c718e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.253210 Sep 01 05:41:55.420824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1329/2576] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:55 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:56.444623 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d900dd2a-bc6e-45ac-b237-852cc2c25cdb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:56.446658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d900dd2a-bc6e-45ac-b237-852cc2c25cdb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:56.454628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d900dd2a-bc6e-45ac-b237-852cc2c25cdb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:56.455393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d900dd2a-bc6e-45ac-b237-852cc2c25cdb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:56.455826 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d900dd2a-bc6e-45ac-b237-852cc2c25cdb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:56.456591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d900dd2a-bc6e-45ac-b237-852cc2c25cdb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:56.457098 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d900dd2a-bc6e-45ac-b237-852cc2c25cdb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:56.457516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d900dd2a-bc6e-45ac-b237-852cc2c25cdb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:56.675465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d900dd2a-bc6e-45ac-b237-852cc2c25cdb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:56.685940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d900dd2a-bc6e-45ac-b237-852cc2c25cdb tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.245647 Sep 01 05:41:56.685940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1248/2577] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:56 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:57.707369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9941ffe6-d844-4a34-8e93-060fd73abfdf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:57.708196 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9941ffe6-d844-4a34-8e93-060fd73abfdf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:57.710782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=28 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:57.717144 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9941ffe6-d844-4a34-8e93-060fd73abfdf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:57.717636 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9941ffe6-d844-4a34-8e93-060fd73abfdf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:57.718099 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9941ffe6-d844-4a34-8e93-060fd73abfdf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:57.718798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9941ffe6-d844-4a34-8e93-060fd73abfdf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:57.719247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9941ffe6-d844-4a34-8e93-060fd73abfdf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:57.719668 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9941ffe6-d844-4a34-8e93-060fd73abfdf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:57.877712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9941ffe6-d844-4a34-8e93-060fd73abfdf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:57.886666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9941ffe6-d844-4a34-8e93-060fd73abfdf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.183373 Sep 01 05:41:57.901723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1330/2578] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:57 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:41:58.274913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1e172111-e948-446b-a5dd-1c33236ba772 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: .version_select at 0x7f9628484820>, body: {"keypair": {"name": "tempest-keypair-1119308910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACiP0g8I65Y/Chmq7dY5r7zDmgmWWgsGNnyIr3Hj3g+We6xrg1PX1kmMgAojEJZCuRCpz3en79vCR4L6zAptVW4D5XdsOICsWN8KmPUt4tuRWkpq2E6VTDGs0tEDGhM8g=="}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:41:58.280669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=28 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:58.299892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-1e172111-e948-446b-a5dd-1c33236ba772 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for project 206f93c129394a4badf489d8c7c45b16. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:41:58.307358 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-1e172111-e948-446b-a5dd-1c33236ba772 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for user 2e8c9e2056464b9299ff765507323869 and project 206f93c129394a4badf489d8c7c45b16. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:41:58.348481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1e172111-e948-446b-a5dd-1c33236ba772 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.196783 Sep 01 05:41:58.349242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1249/2579] 10.222.0.49 () {60 vars in 1159 bytes} [Thu Sep 1 05:41:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:58.910171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2967354a-2f31-490e-860f-f1d85a12a592 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:58.911160 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2967354a-2f31-490e-860f-f1d85a12a592 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:58.927389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2967354a-2f31-490e-860f-f1d85a12a592 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:58.928287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2967354a-2f31-490e-860f-f1d85a12a592 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:58.928862 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2967354a-2f31-490e-860f-f1d85a12a592 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:58.929522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2967354a-2f31-490e-860f-f1d85a12a592 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:58.930173 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2967354a-2f31-490e-860f-f1d85a12a592 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:58.930767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2967354a-2f31-490e-860f-f1d85a12a592 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:59.129936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2967354a-2f31-490e-860f-f1d85a12a592 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:59.139879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2967354a-2f31-490e-860f-f1d85a12a592 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.235148 Sep 01 05:41:59.140727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1331/2580] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:58 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:00.012844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1044972126", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bf7b767-c598-4723-849f-bfb972eb4c62"}], "security_groups": [{"name": "tempest-securitygroup--572020884"}], "key_name": "tempest-keypair-1119308910", "user_data": "}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:42:00.119841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.network.neutron [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] validate_networks() for [('3bf7b767-c598-4723-849f-bfb972eb4c62', None, None, None, None, None)] {{(pid=120674) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:42:00.161832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2ed429e2-fde0-4c13-bf98-14c60d30422c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:00.168096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2ed429e2-fde0-4c13-bf98-14c60d30422c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:00.179953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2ed429e2-fde0-4c13-bf98-14c60d30422c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:00.180438 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2ed429e2-fde0-4c13-bf98-14c60d30422c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:00.180893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2ed429e2-fde0-4c13-bf98-14c60d30422c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:00.181593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2ed429e2-fde0-4c13-bf98-14c60d30422c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:00.182074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2ed429e2-fde0-4c13-bf98-14c60d30422c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:00.182432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2ed429e2-fde0-4c13-bf98-14c60d30422c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:00.337776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2ed429e2-fde0-4c13-bf98-14c60d30422c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:00.348475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2ed429e2-fde0-4c13-bf98-14c60d30422c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.190195 Sep 01 05:42:00.349416 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1332/2581] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:00 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:00.628842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Flavor limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:42:00.629275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Image limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:42:00.629960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Flavor pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:42:00.630434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Image pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:42:00.630838 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:42:00.640178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:00.640659 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:00.641123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:00.641839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:00.642283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:00.642696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:00.660277 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for project 206f93c129394a4badf489d8c7c45b16. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:42:00.664229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for user 2e8c9e2056464b9299ff765507323869 and project 206f93c129394a4badf489d8c7c45b16. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:42:00.675363 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Going to run 1 instances... {{(pid=120674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:42:00.677819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:42:00.727495 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2d085d03-699b-4c75-893c-03d16de9871b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.719872 Sep 01 05:42:00.734723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1250/2582] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:42:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:42:00.739903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-63a35102-0842-4aa6-893c-dcb9e42775fb tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:00.741033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-63a35102-0842-4aa6-893c-dcb9e42775fb tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:00.800125 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-63a35102-0842-4aa6-893c-dcb9e42775fb tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:00.808218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-63a35102-0842-4aa6-893c-dcb9e42775fb tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 200 len: 1242 microversion: 2.1 time: 0.072254 Sep 01 05:42:00.810228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1333/2583] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:00 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:01.371437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8cd5275f-7d65-4a6e-86da-186e40776446 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:01.372701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8cd5275f-7d65-4a6e-86da-186e40776446 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:01.380555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8cd5275f-7d65-4a6e-86da-186e40776446 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:01.381481 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8cd5275f-7d65-4a6e-86da-186e40776446 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:01.382068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8cd5275f-7d65-4a6e-86da-186e40776446 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:01.382972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8cd5275f-7d65-4a6e-86da-186e40776446 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:01.383504 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8cd5275f-7d65-4a6e-86da-186e40776446 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:01.384028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8cd5275f-7d65-4a6e-86da-186e40776446 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:01.530575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8cd5275f-7d65-4a6e-86da-186e40776446 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:01.540062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8cd5275f-7d65-4a6e-86da-186e40776446 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.173373 Sep 01 05:42:01.541078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1251/2584] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:01 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:01.833451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-14127cb3-3142-4e3b-8e10-9df897d138f7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:01.834180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-14127cb3-3142-4e3b-8e10-9df897d138f7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:01.842378 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14127cb3-3142-4e3b-8e10-9df897d138f7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:01.842877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14127cb3-3142-4e3b-8e10-9df897d138f7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:01.843319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14127cb3-3142-4e3b-8e10-9df897d138f7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:01.846499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14127cb3-3142-4e3b-8e10-9df897d138f7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:01.846979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14127cb3-3142-4e3b-8e10-9df897d138f7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:01.847421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14127cb3-3142-4e3b-8e10-9df897d138f7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:01.920219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-14127cb3-3142-4e3b-8e10-9df897d138f7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:01.936572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-14127cb3-3142-4e3b-8e10-9df897d138f7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 200 len: 1302 microversion: 2.1 time: 0.108682 Sep 01 05:42:01.941887 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1334/2585] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:01 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 1302 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:42:02.562628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e282eb2b-9447-434f-93e6-99d73865d8ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:02.563462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e282eb2b-9447-434f-93e6-99d73865d8ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:02.571442 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e282eb2b-9447-434f-93e6-99d73865d8ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:02.571935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e282eb2b-9447-434f-93e6-99d73865d8ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:02.572370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e282eb2b-9447-434f-93e6-99d73865d8ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:02.573742 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e282eb2b-9447-434f-93e6-99d73865d8ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:02.574206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e282eb2b-9447-434f-93e6-99d73865d8ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:02.574631 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e282eb2b-9447-434f-93e6-99d73865d8ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:02.963659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8a93aea5-2810-46c4-b737-f5de84db642f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:02.964230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8a93aea5-2810-46c4-b737-f5de84db642f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:02.972457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a93aea5-2810-46c4-b737-f5de84db642f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:02.972985 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a93aea5-2810-46c4-b737-f5de84db642f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:02.973426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a93aea5-2810-46c4-b737-f5de84db642f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:02.974129 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a93aea5-2810-46c4-b737-f5de84db642f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:02.974585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a93aea5-2810-46c4-b737-f5de84db642f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:02.975010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8a93aea5-2810-46c4-b737-f5de84db642f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:03.066751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e282eb2b-9447-434f-93e6-99d73865d8ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:03.075566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e282eb2b-9447-434f-93e6-99d73865d8ab tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.516416 Sep 01 05:42:03.085069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1252/2586] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:02 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:03.116819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8a93aea5-2810-46c4-b737-f5de84db642f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:03.125779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8a93aea5-2810-46c4-b737-f5de84db642f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 200 len: 1367 microversion: 2.1 time: 0.166055 Sep 01 05:42:03.126356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1335/2587] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:02 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:42:03.595635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-1851f8a5-9400-4060-95a6-bce1811b75ed req-ab5c1e5b-cac3-4b29-a43f-1e20f17f0ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58be5ab6-9a40-44cb-a30a-bbdea2a55083", "tag": "1579edf6-11e1-424c-aec8-43c8085da5cb"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:42:03.605644 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-1851f8a5-9400-4060-95a6-bce1811b75ed req-ab5c1e5b-cac3-4b29-a43f-1e20f17f0ca7 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:03.606841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-1851f8a5-9400-4060-95a6-bce1811b75ed req-ab5c1e5b-cac3-4b29-a43f-1e20f17f0ca7 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:03.607337 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-1851f8a5-9400-4060-95a6-bce1811b75ed req-ab5c1e5b-cac3-4b29-a43f-1e20f17f0ca7 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:03.626515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-1851f8a5-9400-4060-95a6-bce1811b75ed req-ab5c1e5b-cac3-4b29-a43f-1e20f17f0ca7 service nova] Creating event network-changed:1579edf6-11e1-424c-aec8-43c8085da5cb for instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 on hv-cinder-85391 Sep 01 05:42:03.632764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-1851f8a5-9400-4060-95a6-bce1811b75ed req-ab5c1e5b-cac3-4b29-a43f-1e20f17f0ca7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041198 Sep 01 05:42:03.633397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1253/2588] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:42:04.097386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-97696f03-140f-4bee-a0dc-74d74a10c05f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:04.097940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-97696f03-140f-4bee-a0dc-74d74a10c05f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:04.104260 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97696f03-140f-4bee-a0dc-74d74a10c05f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:04.104764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97696f03-140f-4bee-a0dc-74d74a10c05f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:04.105218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97696f03-140f-4bee-a0dc-74d74a10c05f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:04.105907 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97696f03-140f-4bee-a0dc-74d74a10c05f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:04.106362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97696f03-140f-4bee-a0dc-74d74a10c05f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:04.106787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97696f03-140f-4bee-a0dc-74d74a10c05f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:04.146132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5c491834-a608-490b-99d2-3af7b1296285 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:04.146837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5c491834-a608-490b-99d2-3af7b1296285 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:04.153661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c491834-a608-490b-99d2-3af7b1296285 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:04.154526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c491834-a608-490b-99d2-3af7b1296285 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:04.155001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c491834-a608-490b-99d2-3af7b1296285 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:04.155701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c491834-a608-490b-99d2-3af7b1296285 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:04.156156 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c491834-a608-490b-99d2-3af7b1296285 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:04.156584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5c491834-a608-490b-99d2-3af7b1296285 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:04.242355 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-97696f03-140f-4bee-a0dc-74d74a10c05f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:04.251255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-97696f03-140f-4bee-a0dc-74d74a10c05f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.157810 Sep 01 05:42:04.251834 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1336/2589] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:04 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:04.303603 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5c491834-a608-490b-99d2-3af7b1296285 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:04.312342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5c491834-a608-490b-99d2-3af7b1296285 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 200 len: 1367 microversion: 2.1 time: 0.170282 Sep 01 05:42:04.313217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1254/2590] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:04 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:42:05.271381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-df0a5111-853c-41e2-864d-a2bf7e157c75 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:05.272000 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-df0a5111-853c-41e2-864d-a2bf7e157c75 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:05.279271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df0a5111-853c-41e2-864d-a2bf7e157c75 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:05.279783 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df0a5111-853c-41e2-864d-a2bf7e157c75 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:05.280217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df0a5111-853c-41e2-864d-a2bf7e157c75 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:05.280931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df0a5111-853c-41e2-864d-a2bf7e157c75 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:05.281379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df0a5111-853c-41e2-864d-a2bf7e157c75 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:05.281798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-df0a5111-853c-41e2-864d-a2bf7e157c75 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:05.333672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-491c5ee7-4a7d-45e4-b699-f42ba69fc2e9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:05.334269 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-491c5ee7-4a7d-45e4-b699-f42ba69fc2e9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:05.341823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-491c5ee7-4a7d-45e4-b699-f42ba69fc2e9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:05.342335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-491c5ee7-4a7d-45e4-b699-f42ba69fc2e9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:05.342774 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-491c5ee7-4a7d-45e4-b699-f42ba69fc2e9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:05.343620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-491c5ee7-4a7d-45e4-b699-f42ba69fc2e9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:05.344072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-491c5ee7-4a7d-45e4-b699-f42ba69fc2e9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:05.344491 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-491c5ee7-4a7d-45e4-b699-f42ba69fc2e9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:05.413429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-df0a5111-853c-41e2-864d-a2bf7e157c75 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:05.421875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-df0a5111-853c-41e2-864d-a2bf7e157c75 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154286 Sep 01 05:42:05.422452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1337/2591] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:05 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:05.477432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-491c5ee7-4a7d-45e4-b699-f42ba69fc2e9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:05.485761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-491c5ee7-4a7d-45e4-b699-f42ba69fc2e9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 200 len: 1367 microversion: 2.1 time: 0.156042 Sep 01 05:42:05.486314 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1255/2592] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:05 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:42:06.443246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0e8da38c-6ba6-418c-aec7-03258b71eed7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:06.443805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0e8da38c-6ba6-418c-aec7-03258b71eed7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:06.450221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0e8da38c-6ba6-418c-aec7-03258b71eed7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:06.450807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0e8da38c-6ba6-418c-aec7-03258b71eed7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:06.451248 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0e8da38c-6ba6-418c-aec7-03258b71eed7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:06.451932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0e8da38c-6ba6-418c-aec7-03258b71eed7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:06.452391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0e8da38c-6ba6-418c-aec7-03258b71eed7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:06.452840 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0e8da38c-6ba6-418c-aec7-03258b71eed7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:06.506828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-089e9af8-1862-4a6e-ad55-ee8571b93add tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:06.507479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-089e9af8-1862-4a6e-ad55-ee8571b93add tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:06.514634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-089e9af8-1862-4a6e-ad55-ee8571b93add tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:06.515115 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-089e9af8-1862-4a6e-ad55-ee8571b93add tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:06.515556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-089e9af8-1862-4a6e-ad55-ee8571b93add tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:06.516242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-089e9af8-1862-4a6e-ad55-ee8571b93add tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:06.516690 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-089e9af8-1862-4a6e-ad55-ee8571b93add tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:06.517137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-089e9af8-1862-4a6e-ad55-ee8571b93add tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:06.587151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0e8da38c-6ba6-418c-aec7-03258b71eed7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:06.595940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0e8da38c-6ba6-418c-aec7-03258b71eed7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156754 Sep 01 05:42:06.596750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1338/2593] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:06 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:06.648509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-089e9af8-1862-4a6e-ad55-ee8571b93add tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:06.656768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-089e9af8-1862-4a6e-ad55-ee8571b93add tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 200 len: 1367 microversion: 2.1 time: 0.153778 Sep 01 05:42:06.657365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1256/2594] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:06 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:42:07.616859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f30f3426-30ac-4e88-89e8-520e21671319 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:07.617415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f30f3426-30ac-4e88-89e8-520e21671319 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:07.624002 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f30f3426-30ac-4e88-89e8-520e21671319 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:07.624486 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f30f3426-30ac-4e88-89e8-520e21671319 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:07.624952 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f30f3426-30ac-4e88-89e8-520e21671319 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:07.625634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f30f3426-30ac-4e88-89e8-520e21671319 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:07.626080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f30f3426-30ac-4e88-89e8-520e21671319 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:07.626498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f30f3426-30ac-4e88-89e8-520e21671319 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:07.677712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ffae1e83-abee-422e-b8a7-1ff24b41bc2c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:07.678406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ffae1e83-abee-422e-b8a7-1ff24b41bc2c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:07.685153 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ffae1e83-abee-422e-b8a7-1ff24b41bc2c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:07.685639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ffae1e83-abee-422e-b8a7-1ff24b41bc2c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:07.686060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ffae1e83-abee-422e-b8a7-1ff24b41bc2c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:07.686735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ffae1e83-abee-422e-b8a7-1ff24b41bc2c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:07.687179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ffae1e83-abee-422e-b8a7-1ff24b41bc2c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:07.687598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ffae1e83-abee-422e-b8a7-1ff24b41bc2c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:07.757711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f30f3426-30ac-4e88-89e8-520e21671319 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:07.767143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f30f3426-30ac-4e88-89e8-520e21671319 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154193 Sep 01 05:42:07.767715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1339/2595] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:07 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:07.818434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ffae1e83-abee-422e-b8a7-1ff24b41bc2c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:07.827279 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ffae1e83-abee-422e-b8a7-1ff24b41bc2c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 200 len: 1367 microversion: 2.1 time: 0.153472 Sep 01 05:42:07.827847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1257/2596] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:07 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:42:08.788091 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-42b66bf0-8734-4385-89f3-d66542853086 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:08.788711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-42b66bf0-8734-4385-89f3-d66542853086 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:08.795112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42b66bf0-8734-4385-89f3-d66542853086 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:08.795597 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42b66bf0-8734-4385-89f3-d66542853086 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:08.796035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42b66bf0-8734-4385-89f3-d66542853086 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:08.796726 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42b66bf0-8734-4385-89f3-d66542853086 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:08.797223 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42b66bf0-8734-4385-89f3-d66542853086 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:08.797651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-42b66bf0-8734-4385-89f3-d66542853086 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:08.847846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-94279e40-4879-482c-ad1f-cc7f913729f9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:08.848489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-94279e40-4879-482c-ad1f-cc7f913729f9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:08.855703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94279e40-4879-482c-ad1f-cc7f913729f9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:08.856411 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94279e40-4879-482c-ad1f-cc7f913729f9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:08.857374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94279e40-4879-482c-ad1f-cc7f913729f9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:08.858228 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94279e40-4879-482c-ad1f-cc7f913729f9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:08.858689 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94279e40-4879-482c-ad1f-cc7f913729f9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:08.859258 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-94279e40-4879-482c-ad1f-cc7f913729f9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:08.946069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-42b66bf0-8734-4385-89f3-d66542853086 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:08.956678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-42b66bf0-8734-4385-89f3-d66542853086 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.172611 Sep 01 05:42:08.957644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1340/2597] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:08 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:08.995770 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-2960f781-d4b0-430d-8bc8-c8f49b7daf42 req-9d4eff8a-7108-44f4-8ae8-b9bf97af2b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58be5ab6-9a40-44cb-a30a-bbdea2a55083", "name": "network-vif-plugged", "status": "completed", "tag": "1579edf6-11e1-424c-aec8-43c8085da5cb"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:42:09.003321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-94279e40-4879-482c-ad1f-cc7f913729f9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:09.014717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-2960f781-d4b0-430d-8bc8-c8f49b7daf42 req-9d4eff8a-7108-44f4-8ae8-b9bf97af2b2b service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:09.015280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-94279e40-4879-482c-ad1f-cc7f913729f9 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 200 len: 1367 microversion: 2.1 time: 0.171439 Sep 01 05:42:09.015418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-2960f781-d4b0-430d-8bc8-c8f49b7daf42 req-9d4eff8a-7108-44f4-8ae8-b9bf97af2b2b service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:09.015948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-2960f781-d4b0-430d-8bc8-c8f49b7daf42 req-9d4eff8a-7108-44f4-8ae8-b9bf97af2b2b service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:09.028499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-2960f781-d4b0-430d-8bc8-c8f49b7daf42 req-9d4eff8a-7108-44f4-8ae8-b9bf97af2b2b service nova] Creating event network-vif-plugged:1579edf6-11e1-424c-aec8-43c8085da5cb for instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 on hv-cinder-85391 Sep 01 05:42:09.029295 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1258/2598] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:08 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:42:09.034236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-2960f781-d4b0-430d-8bc8-c8f49b7daf42 req-9d4eff8a-7108-44f4-8ae8-b9bf97af2b2b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041899 Sep 01 05:42:09.034902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1341/2599] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:42:09.978986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4de9e347-e9fc-402c-8fea-21d7de588a51 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:09.979601 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4de9e347-e9fc-402c-8fea-21d7de588a51 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:09.986034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4de9e347-e9fc-402c-8fea-21d7de588a51 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:09.986513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4de9e347-e9fc-402c-8fea-21d7de588a51 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:09.986951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4de9e347-e9fc-402c-8fea-21d7de588a51 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:09.988017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4de9e347-e9fc-402c-8fea-21d7de588a51 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:09.988113 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4de9e347-e9fc-402c-8fea-21d7de588a51 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:09.988556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4de9e347-e9fc-402c-8fea-21d7de588a51 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:09.992553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=96 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:10.038572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c7ca2255-7c4c-4bdd-b4c2-a820b7652892 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:10.039268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c7ca2255-7c4c-4bdd-b4c2-a820b7652892 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:10.045850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7ca2255-7c4c-4bdd-b4c2-a820b7652892 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:10.046332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7ca2255-7c4c-4bdd-b4c2-a820b7652892 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:10.046763 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7ca2255-7c4c-4bdd-b4c2-a820b7652892 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:10.047448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7ca2255-7c4c-4bdd-b4c2-a820b7652892 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:10.047896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7ca2255-7c4c-4bdd-b4c2-a820b7652892 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:10.048312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7ca2255-7c4c-4bdd-b4c2-a820b7652892 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:10.124531 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4de9e347-e9fc-402c-8fea-21d7de588a51 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:10.132958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4de9e347-e9fc-402c-8fea-21d7de588a51 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.157883 Sep 01 05:42:10.133567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1259/2600] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:09 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:10.180565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c7ca2255-7c4c-4bdd-b4c2-a820b7652892 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:10.189397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c7ca2255-7c4c-4bdd-b4c2-a820b7652892 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 200 len: 1367 microversion: 2.1 time: 0.155688 Sep 01 05:42:10.189966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1342/2601] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:10 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:42:11.154361 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-670af002-32f7-44b3-af56-a8529143f42f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:11.154901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-670af002-32f7-44b3-af56-a8529143f42f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:11.156703 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:11.157463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=10 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:11.163921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-670af002-32f7-44b3-af56-a8529143f42f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:11.164421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-670af002-32f7-44b3-af56-a8529143f42f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:11.164873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-670af002-32f7-44b3-af56-a8529143f42f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:11.165547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-670af002-32f7-44b3-af56-a8529143f42f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:11.165988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-670af002-32f7-44b3-af56-a8529143f42f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:11.166399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-670af002-32f7-44b3-af56-a8529143f42f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:11.211101 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c50e01eb-493d-484f-aebd-478f822aa4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:11.211750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c50e01eb-493d-484f-aebd-478f822aa4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:11.213739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:11.220232 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c50e01eb-493d-484f-aebd-478f822aa4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:11.220712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c50e01eb-493d-484f-aebd-478f822aa4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:11.221173 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c50e01eb-493d-484f-aebd-478f822aa4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:11.221888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c50e01eb-493d-484f-aebd-478f822aa4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:11.222336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c50e01eb-493d-484f-aebd-478f822aa4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:11.222758 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c50e01eb-493d-484f-aebd-478f822aa4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:11.298358 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-670af002-32f7-44b3-af56-a8529143f42f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:11.306480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-670af002-32f7-44b3-af56-a8529143f42f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156163 Sep 01 05:42:11.307048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1260/2602] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:11 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:11.359413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c50e01eb-493d-484f-aebd-478f822aa4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:11.367026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c50e01eb-493d-484f-aebd-478f822aa4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 200 len: 1557 microversion: 2.1 time: 0.159881 Sep 01 05:42:11.367721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1343/2603] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:11 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:42:11.388252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8ef44361-b85e-4e6b-b426-88fa735c484f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:11.388752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8ef44361-b85e-4e6b-b426-88fa735c484f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:11.394667 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ef44361-b85e-4e6b-b426-88fa735c484f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:11.395148 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ef44361-b85e-4e6b-b426-88fa735c484f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:11.395584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ef44361-b85e-4e6b-b426-88fa735c484f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:11.396265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ef44361-b85e-4e6b-b426-88fa735c484f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:11.396716 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ef44361-b85e-4e6b-b426-88fa735c484f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:11.397173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8ef44361-b85e-4e6b-b426-88fa735c484f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:11.472529 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8ef44361-b85e-4e6b-b426-88fa735c484f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088292 Sep 01 05:42:11.473169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1261/2604] 10.222.0.49 () {58 vars in 1275 bytes} [Thu Sep 1 05:42:11 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:42:12.328243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-02856d23-a5d5-4b8c-9ef0-32b2feea1dc6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:12.328858 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-02856d23-a5d5-4b8c-9ef0-32b2feea1dc6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:12.335245 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-02856d23-a5d5-4b8c-9ef0-32b2feea1dc6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:12.335717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-02856d23-a5d5-4b8c-9ef0-32b2feea1dc6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:12.336148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-02856d23-a5d5-4b8c-9ef0-32b2feea1dc6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:12.336848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-02856d23-a5d5-4b8c-9ef0-32b2feea1dc6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:12.337296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-02856d23-a5d5-4b8c-9ef0-32b2feea1dc6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:12.337708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-02856d23-a5d5-4b8c-9ef0-32b2feea1dc6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:12.341757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=100 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:12.470609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-1413741c-ff8c-4835-8bbb-00d90b3f588c req-a16f9ae2-3a9c-411f-9794-7ee8ecfafc5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58be5ab6-9a40-44cb-a30a-bbdea2a55083", "tag": "1579edf6-11e1-424c-aec8-43c8085da5cb"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:42:12.480173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-1413741c-ff8c-4835-8bbb-00d90b3f588c req-a16f9ae2-3a9c-411f-9794-7ee8ecfafc5f service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:12.480651 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-1413741c-ff8c-4835-8bbb-00d90b3f588c req-a16f9ae2-3a9c-411f-9794-7ee8ecfafc5f service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:12.481114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-1413741c-ff8c-4835-8bbb-00d90b3f588c req-a16f9ae2-3a9c-411f-9794-7ee8ecfafc5f service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:12.486529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-02856d23-a5d5-4b8c-9ef0-32b2feea1dc6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:12.492654 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-1413741c-ff8c-4835-8bbb-00d90b3f588c req-a16f9ae2-3a9c-411f-9794-7ee8ecfafc5f service nova] Creating event network-changed:1579edf6-11e1-424c-aec8-43c8085da5cb for instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 on hv-cinder-85391 Sep 01 05:42:12.497063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-02856d23-a5d5-4b8c-9ef0-32b2feea1dc6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.172267 Sep 01 05:42:12.498248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-1413741c-ff8c-4835-8bbb-00d90b3f588c req-a16f9ae2-3a9c-411f-9794-7ee8ecfafc5f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098595 Sep 01 05:42:12.499145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1262/2606] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:42:12.500030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1344/2606] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:12 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:13.520752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7f263843-2308-426f-af69-9bb290308dbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:13.521478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7f263843-2308-426f-af69-9bb290308dbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:13.527676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7f263843-2308-426f-af69-9bb290308dbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:13.528100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7f263843-2308-426f-af69-9bb290308dbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:13.528540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7f263843-2308-426f-af69-9bb290308dbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:13.529888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7f263843-2308-426f-af69-9bb290308dbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:13.530337 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7f263843-2308-426f-af69-9bb290308dbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:13.530760 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7f263843-2308-426f-af69-9bb290308dbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:13.665978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7f263843-2308-426f-af69-9bb290308dbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:13.674139 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7f263843-2308-426f-af69-9bb290308dbf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.158220 Sep 01 05:42:13.674731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1263/2607] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:13 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:14.695229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-de459f7e-5785-4bd4-b33a-177f6402ae99 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:14.695775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-de459f7e-5785-4bd4-b33a-177f6402ae99 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:14.703368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de459f7e-5785-4bd4-b33a-177f6402ae99 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:14.703837 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de459f7e-5785-4bd4-b33a-177f6402ae99 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:14.704263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de459f7e-5785-4bd4-b33a-177f6402ae99 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:14.704969 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de459f7e-5785-4bd4-b33a-177f6402ae99 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:14.705418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de459f7e-5785-4bd4-b33a-177f6402ae99 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:14.705831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de459f7e-5785-4bd4-b33a-177f6402ae99 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:14.835285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-de459f7e-5785-4bd4-b33a-177f6402ae99 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:14.843873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-de459f7e-5785-4bd4-b33a-177f6402ae99 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152863 Sep 01 05:42:14.844441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1345/2608] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:14 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:15.864910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6a8c1b6a-d536-4776-9c93-94e36bc2427f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:15.865556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6a8c1b6a-d536-4776-9c93-94e36bc2427f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:15.872276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6a8c1b6a-d536-4776-9c93-94e36bc2427f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:15.873440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6a8c1b6a-d536-4776-9c93-94e36bc2427f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:15.873960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6a8c1b6a-d536-4776-9c93-94e36bc2427f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:15.874644 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6a8c1b6a-d536-4776-9c93-94e36bc2427f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:15.875086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6a8c1b6a-d536-4776-9c93-94e36bc2427f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:15.875544 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6a8c1b6a-d536-4776-9c93-94e36bc2427f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:16.023560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6a8c1b6a-d536-4776-9c93-94e36bc2427f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:16.034219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6a8c1b6a-d536-4776-9c93-94e36bc2427f tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.173036 Sep 01 05:42:16.034796 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1264/2609] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:15 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:17.058259 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c4489fe7-5a92-4d26-8e54-d8f1a9218b62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:17.058878 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c4489fe7-5a92-4d26-8e54-d8f1a9218b62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:17.066354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4489fe7-5a92-4d26-8e54-d8f1a9218b62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:17.066841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4489fe7-5a92-4d26-8e54-d8f1a9218b62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:17.067285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4489fe7-5a92-4d26-8e54-d8f1a9218b62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:17.067972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4489fe7-5a92-4d26-8e54-d8f1a9218b62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:17.068423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4489fe7-5a92-4d26-8e54-d8f1a9218b62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:17.068874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c4489fe7-5a92-4d26-8e54-d8f1a9218b62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:17.199706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c4489fe7-5a92-4d26-8e54-d8f1a9218b62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:17.207858 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c4489fe7-5a92-4d26-8e54-d8f1a9218b62 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153753 Sep 01 05:42:17.208428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1346/2610] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:17 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:18.228184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-44280140-573e-49a4-b0da-2d74923cbfb7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:18.228814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-44280140-573e-49a4-b0da-2d74923cbfb7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:18.235915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44280140-573e-49a4-b0da-2d74923cbfb7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:18.236385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44280140-573e-49a4-b0da-2d74923cbfb7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:18.236848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44280140-573e-49a4-b0da-2d74923cbfb7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:18.237527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44280140-573e-49a4-b0da-2d74923cbfb7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:18.237968 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44280140-573e-49a4-b0da-2d74923cbfb7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:18.238383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44280140-573e-49a4-b0da-2d74923cbfb7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:18.365326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-44280140-573e-49a4-b0da-2d74923cbfb7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:18.373480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-44280140-573e-49a4-b0da-2d74923cbfb7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149095 Sep 01 05:42:18.374050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1265/2611] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:18 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:19.394382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-22b7a6ea-8655-4521-9126-b11c16e40b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:19.394983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-22b7a6ea-8655-4521-9126-b11c16e40b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:19.401465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22b7a6ea-8655-4521-9126-b11c16e40b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:19.401940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22b7a6ea-8655-4521-9126-b11c16e40b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:19.402380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22b7a6ea-8655-4521-9126-b11c16e40b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:19.403198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22b7a6ea-8655-4521-9126-b11c16e40b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:19.403660 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22b7a6ea-8655-4521-9126-b11c16e40b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:19.404976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-22b7a6ea-8655-4521-9126-b11c16e40b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:19.536790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-22b7a6ea-8655-4521-9126-b11c16e40b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:19.545030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-22b7a6ea-8655-4521-9126-b11c16e40b5d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154495 Sep 01 05:42:19.545591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1347/2612] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:19 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:20.566898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3cc3b06d-9c6f-4ef1-b0c0-3778d17215bf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:20.567510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3cc3b06d-9c6f-4ef1-b0c0-3778d17215bf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:20.573982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3cc3b06d-9c6f-4ef1-b0c0-3778d17215bf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:20.574459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3cc3b06d-9c6f-4ef1-b0c0-3778d17215bf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:20.574890 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3cc3b06d-9c6f-4ef1-b0c0-3778d17215bf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:20.575571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3cc3b06d-9c6f-4ef1-b0c0-3778d17215bf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:20.576173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3cc3b06d-9c6f-4ef1-b0c0-3778d17215bf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:20.576756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3cc3b06d-9c6f-4ef1-b0c0-3778d17215bf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:20.707709 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-3cc3b06d-9c6f-4ef1-b0c0-3778d17215bf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:20.715895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3cc3b06d-9c6f-4ef1-b0c0-3778d17215bf tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153094 Sep 01 05:42:20.717242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1266/2613] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:20 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:21.738048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ec81e6b8-dc98-4396-b60e-c1e9f2d8c31b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:21.738675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ec81e6b8-dc98-4396-b60e-c1e9f2d8c31b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:21.745366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec81e6b8-dc98-4396-b60e-c1e9f2d8c31b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:21.745841 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec81e6b8-dc98-4396-b60e-c1e9f2d8c31b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:21.746268 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec81e6b8-dc98-4396-b60e-c1e9f2d8c31b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:21.746942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec81e6b8-dc98-4396-b60e-c1e9f2d8c31b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:21.747385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec81e6b8-dc98-4396-b60e-c1e9f2d8c31b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:21.748440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ec81e6b8-dc98-4396-b60e-c1e9f2d8c31b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:21.880893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ec81e6b8-dc98-4396-b60e-c1e9f2d8c31b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:21.889269 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ec81e6b8-dc98-4396-b60e-c1e9f2d8c31b tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154889 Sep 01 05:42:21.895829 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1348/2614] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:21 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:22.910675 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0b3bf525-5036-4200-8a9c-7dd688bc9520 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:22.911289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0b3bf525-5036-4200-8a9c-7dd688bc9520 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:22.917803 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b3bf525-5036-4200-8a9c-7dd688bc9520 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:22.918285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b3bf525-5036-4200-8a9c-7dd688bc9520 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:22.918718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b3bf525-5036-4200-8a9c-7dd688bc9520 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:22.919397 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b3bf525-5036-4200-8a9c-7dd688bc9520 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:22.919927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b3bf525-5036-4200-8a9c-7dd688bc9520 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:22.920380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0b3bf525-5036-4200-8a9c-7dd688bc9520 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:23.053223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0b3bf525-5036-4200-8a9c-7dd688bc9520 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:23.062595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0b3bf525-5036-4200-8a9c-7dd688bc9520 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.156077 Sep 01 05:42:23.063169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1267/2615] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:22 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:24.083779 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-21937bd4-0ddd-4549-b783-906d415ead9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:24.084414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-21937bd4-0ddd-4549-b783-906d415ead9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:24.090805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21937bd4-0ddd-4549-b783-906d415ead9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:24.091283 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21937bd4-0ddd-4549-b783-906d415ead9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:24.091764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21937bd4-0ddd-4549-b783-906d415ead9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:24.092444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21937bd4-0ddd-4549-b783-906d415ead9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:24.092923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21937bd4-0ddd-4549-b783-906d415ead9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:24.093347 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21937bd4-0ddd-4549-b783-906d415ead9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:24.221491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-21937bd4-0ddd-4549-b783-906d415ead9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:24.229688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-21937bd4-0ddd-4549-b783-906d415ead9c tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149814 Sep 01 05:42:24.230256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1349/2616] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:24 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:25.251553 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-99156a0b-a020-4126-8c1b-41356bf21402 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:25.252213 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-99156a0b-a020-4126-8c1b-41356bf21402 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:25.258797 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-99156a0b-a020-4126-8c1b-41356bf21402 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:25.259276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-99156a0b-a020-4126-8c1b-41356bf21402 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:25.259708 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-99156a0b-a020-4126-8c1b-41356bf21402 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:25.260423 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-99156a0b-a020-4126-8c1b-41356bf21402 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:25.260909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-99156a0b-a020-4126-8c1b-41356bf21402 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:25.261333 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-99156a0b-a020-4126-8c1b-41356bf21402 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:25.390058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-99156a0b-a020-4126-8c1b-41356bf21402 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:25.398169 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-99156a0b-a020-4126-8c1b-41356bf21402 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150791 Sep 01 05:42:25.398730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1268/2617] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:25 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:26.421111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2fe89704-c2e7-4c69-95f7-f4530bf41248 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:26.421663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2fe89704-c2e7-4c69-95f7-f4530bf41248 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:26.428071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fe89704-c2e7-4c69-95f7-f4530bf41248 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:26.428547 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fe89704-c2e7-4c69-95f7-f4530bf41248 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:26.429021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fe89704-c2e7-4c69-95f7-f4530bf41248 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:26.429707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fe89704-c2e7-4c69-95f7-f4530bf41248 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:26.430158 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fe89704-c2e7-4c69-95f7-f4530bf41248 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:26.430581 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2fe89704-c2e7-4c69-95f7-f4530bf41248 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:26.560964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2fe89704-c2e7-4c69-95f7-f4530bf41248 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:26.569117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2fe89704-c2e7-4c69-95f7-f4530bf41248 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152529 Sep 01 05:42:26.569683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1350/2618] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:26 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:27.591617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0807f8f0-75eb-4189-a536-f628ad98c29a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:27.592215 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0807f8f0-75eb-4189-a536-f628ad98c29a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:27.598789 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0807f8f0-75eb-4189-a536-f628ad98c29a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:27.599269 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0807f8f0-75eb-4189-a536-f628ad98c29a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:27.599701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0807f8f0-75eb-4189-a536-f628ad98c29a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:27.600379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0807f8f0-75eb-4189-a536-f628ad98c29a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:27.600865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0807f8f0-75eb-4189-a536-f628ad98c29a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:27.601288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0807f8f0-75eb-4189-a536-f628ad98c29a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:27.733166 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0807f8f0-75eb-4189-a536-f628ad98c29a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:27.741308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0807f8f0-75eb-4189-a536-f628ad98c29a tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153591 Sep 01 05:42:27.741877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1269/2619] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:27 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:28.764501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-822e25bf-90b2-4922-9e9d-60d0d1884057 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:28.765149 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-822e25bf-90b2-4922-9e9d-60d0d1884057 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:28.767480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=44 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:28.773243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-822e25bf-90b2-4922-9e9d-60d0d1884057 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:28.773720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-822e25bf-90b2-4922-9e9d-60d0d1884057 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:28.774153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-822e25bf-90b2-4922-9e9d-60d0d1884057 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:28.775074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-822e25bf-90b2-4922-9e9d-60d0d1884057 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:28.775620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-822e25bf-90b2-4922-9e9d-60d0d1884057 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:28.776027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-822e25bf-90b2-4922-9e9d-60d0d1884057 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:28.906318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-822e25bf-90b2-4922-9e9d-60d0d1884057 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:28.914773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-822e25bf-90b2-4922-9e9d-60d0d1884057 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154893 Sep 01 05:42:28.915351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1351/2620] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:28 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:29.936135 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2c86233c-1e8d-4bc2-96a4-100e78df86aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:29.942216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2c86233c-1e8d-4bc2-96a4-100e78df86aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:29.942216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:29.947880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c86233c-1e8d-4bc2-96a4-100e78df86aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:29.948361 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c86233c-1e8d-4bc2-96a4-100e78df86aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:29.948818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c86233c-1e8d-4bc2-96a4-100e78df86aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:29.949506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c86233c-1e8d-4bc2-96a4-100e78df86aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:29.949957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c86233c-1e8d-4bc2-96a4-100e78df86aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:29.950374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2c86233c-1e8d-4bc2-96a4-100e78df86aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:30.081816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2c86233c-1e8d-4bc2-96a4-100e78df86aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:30.090358 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2c86233c-1e8d-4bc2-96a4-100e78df86aa tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.158489 Sep 01 05:42:30.090926 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1270/2621] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:29 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:31.111826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0f132265-1bec-4ce1-ada2-eb27460fc1c6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:31.112439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0f132265-1bec-4ce1-ada2-eb27460fc1c6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:31.118819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f132265-1bec-4ce1-ada2-eb27460fc1c6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:31.119287 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f132265-1bec-4ce1-ada2-eb27460fc1c6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:31.119714 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f132265-1bec-4ce1-ada2-eb27460fc1c6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:31.120381 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f132265-1bec-4ce1-ada2-eb27460fc1c6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:31.120843 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f132265-1bec-4ce1-ada2-eb27460fc1c6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:31.121261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0f132265-1bec-4ce1-ada2-eb27460fc1c6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:31.251138 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0f132265-1bec-4ce1-ada2-eb27460fc1c6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:31.259306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0f132265-1bec-4ce1-ada2-eb27460fc1c6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151347 Sep 01 05:42:31.259870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1352/2622] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:31 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:32.282210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d6cdfafa-386f-46c3-8184-742d527f47b9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:32.282817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d6cdfafa-386f-46c3-8184-742d527f47b9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:32.289473 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6cdfafa-386f-46c3-8184-742d527f47b9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:32.289953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6cdfafa-386f-46c3-8184-742d527f47b9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:32.290387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6cdfafa-386f-46c3-8184-742d527f47b9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:32.291065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6cdfafa-386f-46c3-8184-742d527f47b9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:32.291511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6cdfafa-386f-46c3-8184-742d527f47b9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:32.291932 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d6cdfafa-386f-46c3-8184-742d527f47b9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:32.421516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d6cdfafa-386f-46c3-8184-742d527f47b9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:32.429670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d6cdfafa-386f-46c3-8184-742d527f47b9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152010 Sep 01 05:42:32.430177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1271/2623] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:32 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:33.449501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d1fc2cb1-6da8-44ee-9d10-c52c524eb8c0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:33.450117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d1fc2cb1-6da8-44ee-9d10-c52c524eb8c0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:33.456931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1fc2cb1-6da8-44ee-9d10-c52c524eb8c0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:33.457414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1fc2cb1-6da8-44ee-9d10-c52c524eb8c0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:33.457849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1fc2cb1-6da8-44ee-9d10-c52c524eb8c0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:33.458530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1fc2cb1-6da8-44ee-9d10-c52c524eb8c0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:33.458982 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1fc2cb1-6da8-44ee-9d10-c52c524eb8c0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:33.459408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d1fc2cb1-6da8-44ee-9d10-c52c524eb8c0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:33.594816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d1fc2cb1-6da8-44ee-9d10-c52c524eb8c0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:33.602883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d1fc2cb1-6da8-44ee-9d10-c52c524eb8c0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.157250 Sep 01 05:42:33.603442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1353/2624] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:33 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:34.625106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7d1539f9-e32e-4d20-831e-332f443a62be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:34.625672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7d1539f9-e32e-4d20-831e-332f443a62be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:34.632313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7d1539f9-e32e-4d20-831e-332f443a62be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:34.632791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7d1539f9-e32e-4d20-831e-332f443a62be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:34.633232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7d1539f9-e32e-4d20-831e-332f443a62be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:34.633902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7d1539f9-e32e-4d20-831e-332f443a62be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:34.634342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7d1539f9-e32e-4d20-831e-332f443a62be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:34.634752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7d1539f9-e32e-4d20-831e-332f443a62be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:34.764949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7d1539f9-e32e-4d20-831e-332f443a62be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:34.773041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7d1539f9-e32e-4d20-831e-332f443a62be tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152607 Sep 01 05:42:34.773606 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1272/2625] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:34 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:35.794874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c765063a-2b96-4c47-b57f-1021fe52f999 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:35.795484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c765063a-2b96-4c47-b57f-1021fe52f999 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:35.801988 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c765063a-2b96-4c47-b57f-1021fe52f999 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:35.802472 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c765063a-2b96-4c47-b57f-1021fe52f999 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:35.802909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c765063a-2b96-4c47-b57f-1021fe52f999 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:35.803595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c765063a-2b96-4c47-b57f-1021fe52f999 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:35.804048 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c765063a-2b96-4c47-b57f-1021fe52f999 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:35.804471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c765063a-2b96-4c47-b57f-1021fe52f999 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:35.931672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c765063a-2b96-4c47-b57f-1021fe52f999 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:35.940575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c765063a-2b96-4c47-b57f-1021fe52f999 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149685 Sep 01 05:42:35.941179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1354/2626] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:35 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:36.961965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a5a4d668-f973-451b-8b45-948212936b23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:36.962575 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a5a4d668-f973-451b-8b45-948212936b23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:36.969736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5a4d668-f973-451b-8b45-948212936b23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:36.970212 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5a4d668-f973-451b-8b45-948212936b23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:36.970643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5a4d668-f973-451b-8b45-948212936b23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:36.971318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5a4d668-f973-451b-8b45-948212936b23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:36.971767 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5a4d668-f973-451b-8b45-948212936b23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:36.972185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a5a4d668-f973-451b-8b45-948212936b23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:37.104391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a5a4d668-f973-451b-8b45-948212936b23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:37.113251 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a5a4d668-f973-451b-8b45-948212936b23 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155174 Sep 01 05:42:37.113809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1273/2627] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:36 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:38.134799 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-071e8800-ec26-4299-a5b3-5ba13debe6e9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:38.135415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-071e8800-ec26-4299-a5b3-5ba13debe6e9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:38.142975 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-071e8800-ec26-4299-a5b3-5ba13debe6e9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:38.143451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-071e8800-ec26-4299-a5b3-5ba13debe6e9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:38.143883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-071e8800-ec26-4299-a5b3-5ba13debe6e9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:38.144562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-071e8800-ec26-4299-a5b3-5ba13debe6e9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:38.145046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-071e8800-ec26-4299-a5b3-5ba13debe6e9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:38.145467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-071e8800-ec26-4299-a5b3-5ba13debe6e9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:38.276411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-071e8800-ec26-4299-a5b3-5ba13debe6e9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:38.284942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-071e8800-ec26-4299-a5b3-5ba13debe6e9 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154179 Sep 01 05:42:38.285514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1355/2628] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:38 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:39.305814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ca82a8b8-72d5-402f-b9e0-c690382d57e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:39.306422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ca82a8b8-72d5-402f-b9e0-c690382d57e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:39.313385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca82a8b8-72d5-402f-b9e0-c690382d57e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:39.313859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca82a8b8-72d5-402f-b9e0-c690382d57e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:39.314283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca82a8b8-72d5-402f-b9e0-c690382d57e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:39.314952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca82a8b8-72d5-402f-b9e0-c690382d57e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:39.315394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca82a8b8-72d5-402f-b9e0-c690382d57e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:39.315808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ca82a8b8-72d5-402f-b9e0-c690382d57e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:39.443794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ca82a8b8-72d5-402f-b9e0-c690382d57e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:39.452597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ca82a8b8-72d5-402f-b9e0-c690382d57e6 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150597 Sep 01 05:42:39.453197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1274/2629] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:39 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:40.474034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4505fc0f-f6d0-4de3-8a10-4e7918d60a4e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:40.474582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4505fc0f-f6d0-4de3-8a10-4e7918d60a4e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:40.481082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4505fc0f-f6d0-4de3-8a10-4e7918d60a4e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:40.481568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4505fc0f-f6d0-4de3-8a10-4e7918d60a4e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:40.482006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4505fc0f-f6d0-4de3-8a10-4e7918d60a4e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:40.483036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4505fc0f-f6d0-4de3-8a10-4e7918d60a4e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:40.483492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4505fc0f-f6d0-4de3-8a10-4e7918d60a4e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:40.483923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4505fc0f-f6d0-4de3-8a10-4e7918d60a4e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:40.613509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4505fc0f-f6d0-4de3-8a10-4e7918d60a4e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:40.621694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4505fc0f-f6d0-4de3-8a10-4e7918d60a4e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151698 Sep 01 05:42:40.622271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1356/2630] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:40 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:41.642552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-09f53e44-55b3-4c94-bae8-0d1c1a297ac7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:41.643100 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-09f53e44-55b3-4c94-bae8-0d1c1a297ac7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:41.649517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09f53e44-55b3-4c94-bae8-0d1c1a297ac7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:41.650023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09f53e44-55b3-4c94-bae8-0d1c1a297ac7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:41.650454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09f53e44-55b3-4c94-bae8-0d1c1a297ac7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:41.651129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09f53e44-55b3-4c94-bae8-0d1c1a297ac7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:41.651577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09f53e44-55b3-4c94-bae8-0d1c1a297ac7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:41.651995 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-09f53e44-55b3-4c94-bae8-0d1c1a297ac7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:41.656804 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=90 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:41.782656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-09f53e44-55b3-4c94-bae8-0d1c1a297ac7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:41.790996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-09f53e44-55b3-4c94-bae8-0d1c1a297ac7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152649 Sep 01 05:42:41.791565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1275/2631] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:41 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:42.813190 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d2bb1533-f111-458d-b0c0-92512f5ef176 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:42.813802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d2bb1533-f111-458d-b0c0-92512f5ef176 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:42.820247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2bb1533-f111-458d-b0c0-92512f5ef176 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:42.820718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2bb1533-f111-458d-b0c0-92512f5ef176 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:42.821176 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2bb1533-f111-458d-b0c0-92512f5ef176 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:42.821844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2bb1533-f111-458d-b0c0-92512f5ef176 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:42.822289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2bb1533-f111-458d-b0c0-92512f5ef176 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:42.822711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d2bb1533-f111-458d-b0c0-92512f5ef176 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:42.825177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=78 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:42.953605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d2bb1533-f111-458d-b0c0-92512f5ef176 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:42.961756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d2bb1533-f111-458d-b0c0-92512f5ef176 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152859 Sep 01 05:42:42.962325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1357/2632] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:42 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:43.983421 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-504eb4ee-fc29-4c77-acef-449bb134bb45 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:43.984025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-504eb4ee-fc29-4c77-acef-449bb134bb45 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:43.990145 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-504eb4ee-fc29-4c77-acef-449bb134bb45 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:43.990622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-504eb4ee-fc29-4c77-acef-449bb134bb45 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:43.991054 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-504eb4ee-fc29-4c77-acef-449bb134bb45 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:43.991728 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-504eb4ee-fc29-4c77-acef-449bb134bb45 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:43.992177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-504eb4ee-fc29-4c77-acef-449bb134bb45 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:43.992596 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-504eb4ee-fc29-4c77-acef-449bb134bb45 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:44.117093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-504eb4ee-fc29-4c77-acef-449bb134bb45 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:44.125457 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-504eb4ee-fc29-4c77-acef-449bb134bb45 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.146675 Sep 01 05:42:44.126026 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1276/2633] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:43 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:45.147547 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d8f2c073-2fdb-4a82-bc41-6cc277c16d4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:45.148121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d8f2c073-2fdb-4a82-bc41-6cc277c16d4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:45.154642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8f2c073-2fdb-4a82-bc41-6cc277c16d4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:45.155116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8f2c073-2fdb-4a82-bc41-6cc277c16d4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:45.155545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8f2c073-2fdb-4a82-bc41-6cc277c16d4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:45.156222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8f2c073-2fdb-4a82-bc41-6cc277c16d4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:45.156672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8f2c073-2fdb-4a82-bc41-6cc277c16d4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:45.157117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d8f2c073-2fdb-4a82-bc41-6cc277c16d4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:45.287334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d8f2c073-2fdb-4a82-bc41-6cc277c16d4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:45.296493 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d8f2c073-2fdb-4a82-bc41-6cc277c16d4d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.152824 Sep 01 05:42:45.297095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1358/2634] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:45 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:46.317403 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f2923318-595a-49ef-86fa-e03d1073fd82 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:46.318017 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f2923318-595a-49ef-86fa-e03d1073fd82 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:46.324646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2923318-595a-49ef-86fa-e03d1073fd82 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:46.325150 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2923318-595a-49ef-86fa-e03d1073fd82 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:46.325581 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2923318-595a-49ef-86fa-e03d1073fd82 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:46.326952 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2923318-595a-49ef-86fa-e03d1073fd82 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:46.327487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2923318-595a-49ef-86fa-e03d1073fd82 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:46.327907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f2923318-595a-49ef-86fa-e03d1073fd82 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:46.458724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f2923318-595a-49ef-86fa-e03d1073fd82 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:46.467035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f2923318-595a-49ef-86fa-e03d1073fd82 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153373 Sep 01 05:42:46.467636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1277/2635] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:46 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:46.646570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-616079fa-f513-4423-91d2-43a22025160b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:46.647132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-616079fa-f513-4423-91d2-43a22025160b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:46.653571 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-616079fa-f513-4423-91d2-43a22025160b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:46.654095 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-616079fa-f513-4423-91d2-43a22025160b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:46.654713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-616079fa-f513-4423-91d2-43a22025160b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:46.655389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-616079fa-f513-4423-91d2-43a22025160b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:46.655835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-616079fa-f513-4423-91d2-43a22025160b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:46.656279 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-616079fa-f513-4423-91d2-43a22025160b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:46.679275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-616079fa-f513-4423-91d2-43a22025160b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/ips" status: 200 len: 150 microversion: 2.1 time: 0.036692 Sep 01 05:42:46.679819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1359/2636] 10.222.0.49 () {58 vars in 1248 bytes} [Thu Sep 1 05:42:46 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:42:47.489695 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1411623d-f260-4650-ab74-30da84ab5944 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:47.490105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1411623d-f260-4650-ab74-30da84ab5944 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:47.496475 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1411623d-f260-4650-ab74-30da84ab5944 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:47.497072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1411623d-f260-4650-ab74-30da84ab5944 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:47.497506 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1411623d-f260-4650-ab74-30da84ab5944 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:47.498214 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1411623d-f260-4650-ab74-30da84ab5944 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:47.498734 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1411623d-f260-4650-ab74-30da84ab5944 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:47.499175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1411623d-f260-4650-ab74-30da84ab5944 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:48.099903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-1411623d-f260-4650-ab74-30da84ab5944 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:48.108111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1411623d-f260-4650-ab74-30da84ab5944 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.622769 Sep 01 05:42:48.108677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1278/2637] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:47 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:49.128591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f73c7ef4-67ee-4221-b907-c7964527fff0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:49.129242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f73c7ef4-67ee-4221-b907-c7964527fff0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:49.135722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f73c7ef4-67ee-4221-b907-c7964527fff0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:49.136205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f73c7ef4-67ee-4221-b907-c7964527fff0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:49.136642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f73c7ef4-67ee-4221-b907-c7964527fff0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:49.137359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f73c7ef4-67ee-4221-b907-c7964527fff0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:49.137813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f73c7ef4-67ee-4221-b907-c7964527fff0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:49.138237 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f73c7ef4-67ee-4221-b907-c7964527fff0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:49.267651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f73c7ef4-67ee-4221-b907-c7964527fff0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:49.275830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f73c7ef4-67ee-4221-b907-c7964527fff0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.151109 Sep 01 05:42:49.276421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1360/2638] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:49 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:50.297557 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-65d3aeee-5fe7-46fe-96ba-ccde6442e0a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:50.298167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-65d3aeee-5fe7-46fe-96ba-ccde6442e0a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:50.304646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-65d3aeee-5fe7-46fe-96ba-ccde6442e0a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:50.305159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-65d3aeee-5fe7-46fe-96ba-ccde6442e0a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:50.305591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-65d3aeee-5fe7-46fe-96ba-ccde6442e0a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:50.306264 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-65d3aeee-5fe7-46fe-96ba-ccde6442e0a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:50.306713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-65d3aeee-5fe7-46fe-96ba-ccde6442e0a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:50.307137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-65d3aeee-5fe7-46fe-96ba-ccde6442e0a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:50.440895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-65d3aeee-5fe7-46fe-96ba-ccde6442e0a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:50.448981 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-65d3aeee-5fe7-46fe-96ba-ccde6442e0a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155318 Sep 01 05:42:50.449549 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1279/2639] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:50 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:51.470319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-87cb88a1-1b95-4ad7-acaf-364edd91021e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:51.470916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-87cb88a1-1b95-4ad7-acaf-364edd91021e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:51.477308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87cb88a1-1b95-4ad7-acaf-364edd91021e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:51.477776 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87cb88a1-1b95-4ad7-acaf-364edd91021e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:51.478200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87cb88a1-1b95-4ad7-acaf-364edd91021e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:51.478868 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87cb88a1-1b95-4ad7-acaf-364edd91021e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:51.479310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87cb88a1-1b95-4ad7-acaf-364edd91021e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:51.479724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87cb88a1-1b95-4ad7-acaf-364edd91021e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:51.611497 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-87cb88a1-1b95-4ad7-acaf-364edd91021e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:51.619649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-87cb88a1-1b95-4ad7-acaf-364edd91021e tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153293 Sep 01 05:42:51.620204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1361/2640] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:51 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:52.641906 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-44dee466-7fed-43a5-b374-4ae595290b76 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:52.642515 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-44dee466-7fed-43a5-b374-4ae595290b76 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:52.649084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44dee466-7fed-43a5-b374-4ae595290b76 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:52.649563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44dee466-7fed-43a5-b374-4ae595290b76 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:52.649996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44dee466-7fed-43a5-b374-4ae595290b76 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:52.650677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44dee466-7fed-43a5-b374-4ae595290b76 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:52.651120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44dee466-7fed-43a5-b374-4ae595290b76 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:52.651541 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44dee466-7fed-43a5-b374-4ae595290b76 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:52.778321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-44dee466-7fed-43a5-b374-4ae595290b76 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:52.786763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-44dee466-7fed-43a5-b374-4ae595290b76 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149585 Sep 01 05:42:52.787318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1280/2641] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:52 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:53.808008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e8a38967-ae7b-4c4a-9565-b3820c26584d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:53.808600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e8a38967-ae7b-4c4a-9565-b3820c26584d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:53.815047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8a38967-ae7b-4c4a-9565-b3820c26584d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:53.815521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8a38967-ae7b-4c4a-9565-b3820c26584d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:53.815951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8a38967-ae7b-4c4a-9565-b3820c26584d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:53.816626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8a38967-ae7b-4c4a-9565-b3820c26584d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:53.817213 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8a38967-ae7b-4c4a-9565-b3820c26584d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:53.817634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e8a38967-ae7b-4c4a-9565-b3820c26584d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:53.949113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e8a38967-ae7b-4c4a-9565-b3820c26584d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:53.958285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e8a38967-ae7b-4c4a-9565-b3820c26584d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.154100 Sep 01 05:42:53.958850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1362/2642] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:53 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:54.979674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c4cde781-1b9f-4c0f-b687-becb398a21d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:54.980293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c4cde781-1b9f-4c0f-b687-becb398a21d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:54.987543 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4cde781-1b9f-4c0f-b687-becb398a21d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:54.988025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4cde781-1b9f-4c0f-b687-becb398a21d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:54.988464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4cde781-1b9f-4c0f-b687-becb398a21d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:54.989220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4cde781-1b9f-4c0f-b687-becb398a21d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:54.989679 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4cde781-1b9f-4c0f-b687-becb398a21d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:54.990105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c4cde781-1b9f-4c0f-b687-becb398a21d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:55.115427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c4cde781-1b9f-4c0f-b687-becb398a21d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:55.123706 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c4cde781-1b9f-4c0f-b687-becb398a21d2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.147705 Sep 01 05:42:55.124499 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1281/2643] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:54 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:42:56.144725 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b8168c7d-96f9-4a07-9861-e14417711311 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:56.145402 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b8168c7d-96f9-4a07-9861-e14417711311 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:56.147890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:42:56.148021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:42:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 (ip 10.222.0.49) !!! Sep 01 05:42:56.155017 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8168c7d-96f9-4a07-9861-e14417711311 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:56.155531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8168c7d-96f9-4a07-9861-e14417711311 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:56.155966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8168c7d-96f9-4a07-9861-e14417711311 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:56.156655 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8168c7d-96f9-4a07-9861-e14417711311 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:56.157133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8168c7d-96f9-4a07-9861-e14417711311 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:56.157556 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b8168c7d-96f9-4a07-9861-e14417711311 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:56.287406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b8168c7d-96f9-4a07-9861-e14417711311 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:56.296132 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b8168c7d-96f9-4a07-9861-e14417711311 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155314 Sep 01 05:42:56.296724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1363/2644] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:56 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:57.317220 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e4331840-4896-4d87-a81b-9306a5fe77e2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:57.317766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e4331840-4896-4d87-a81b-9306a5fe77e2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:57.324199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4331840-4896-4d87-a81b-9306a5fe77e2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:57.324681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4331840-4896-4d87-a81b-9306a5fe77e2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:57.325149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4331840-4896-4d87-a81b-9306a5fe77e2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:57.325834 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4331840-4896-4d87-a81b-9306a5fe77e2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:57.326297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4331840-4896-4d87-a81b-9306a5fe77e2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:57.326724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4331840-4896-4d87-a81b-9306a5fe77e2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:57.455855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e4331840-4896-4d87-a81b-9306a5fe77e2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:57.463940 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e4331840-4896-4d87-a81b-9306a5fe77e2 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.150700 Sep 01 05:42:57.464502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1282/2645] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:57 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:58.485743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e59d8423-f77f-43d2-8683-a1a9cbf4cac5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:58.486272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e59d8423-f77f-43d2-8683-a1a9cbf4cac5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:58.492611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e59d8423-f77f-43d2-8683-a1a9cbf4cac5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:58.493113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e59d8423-f77f-43d2-8683-a1a9cbf4cac5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:58.493542 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e59d8423-f77f-43d2-8683-a1a9cbf4cac5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:58.494224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e59d8423-f77f-43d2-8683-a1a9cbf4cac5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:58.494666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e59d8423-f77f-43d2-8683-a1a9cbf4cac5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:58.495083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e59d8423-f77f-43d2-8683-a1a9cbf4cac5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:58.626748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-e59d8423-f77f-43d2-8683-a1a9cbf4cac5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:58.634922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e59d8423-f77f-43d2-8683-a1a9cbf4cac5 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153359 Sep 01 05:42:58.635488 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1364/2646] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:58 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:59.657053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7e8c0fda-627e-4600-b57a-15a69344a1d7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:59.657679 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7e8c0fda-627e-4600-b57a-15a69344a1d7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:59.664344 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e8c0fda-627e-4600-b57a-15a69344a1d7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:59.664860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e8c0fda-627e-4600-b57a-15a69344a1d7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:59.665294 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e8c0fda-627e-4600-b57a-15a69344a1d7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:59.665980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e8c0fda-627e-4600-b57a-15a69344a1d7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:59.666435 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e8c0fda-627e-4600-b57a-15a69344a1d7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:59.666855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7e8c0fda-627e-4600-b57a-15a69344a1d7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:59.794367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7e8c0fda-627e-4600-b57a-15a69344a1d7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:59.802729 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7e8c0fda-627e-4600-b57a-15a69344a1d7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.149696 Sep 01 05:42:59.803290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1283/2647] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:59 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:00.823263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-752b909a-9370-4080-8a7c-e91f2901ded0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:00.823875 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-752b909a-9370-4080-8a7c-e91f2901ded0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:00.826205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=28 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:00.832136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-752b909a-9370-4080-8a7c-e91f2901ded0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:00.832615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-752b909a-9370-4080-8a7c-e91f2901ded0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:00.833076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-752b909a-9370-4080-8a7c-e91f2901ded0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:00.833761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-752b909a-9370-4080-8a7c-e91f2901ded0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:00.834208 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-752b909a-9370-4080-8a7c-e91f2901ded0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:00.834630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-752b909a-9370-4080-8a7c-e91f2901ded0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:00.964513 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-752b909a-9370-4080-8a7c-e91f2901ded0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:00.973344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-752b909a-9370-4080-8a7c-e91f2901ded0 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.153965 Sep 01 05:43:00.973906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1365/2648] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:00 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:01.994218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bc895a6a-c408-4363-afbf-8641a702832d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:01.994853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bc895a6a-c408-4363-afbf-8641a702832d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:01.997211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=28 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:02.002845 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc895a6a-c408-4363-afbf-8641a702832d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:02.003317 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc895a6a-c408-4363-afbf-8641a702832d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:02.003775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc895a6a-c408-4363-afbf-8641a702832d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:02.004561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc895a6a-c408-4363-afbf-8641a702832d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:02.005040 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc895a6a-c408-4363-afbf-8641a702832d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:02.005454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bc895a6a-c408-4363-afbf-8641a702832d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:02.137158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-bc895a6a-c408-4363-afbf-8641a702832d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:02.146138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bc895a6a-c408-4363-afbf-8641a702832d tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.155708 Sep 01 05:43:02.146655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1284/2649] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:01 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:03.305722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0d23fad3-0e6d-4ae0-a26b-61478101c683 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:03.306336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0d23fad3-0e6d-4ae0-a26b-61478101c683 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:03.312274 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d23fad3-0e6d-4ae0-a26b-61478101c683 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:03.312741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d23fad3-0e6d-4ae0-a26b-61478101c683 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:03.313208 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d23fad3-0e6d-4ae0-a26b-61478101c683 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:03.313879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d23fad3-0e6d-4ae0-a26b-61478101c683 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:03.314322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d23fad3-0e6d-4ae0-a26b-61478101c683 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:03.314736 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0d23fad3-0e6d-4ae0-a26b-61478101c683 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:03.445797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0d23fad3-0e6d-4ae0-a26b-61478101c683 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:03.453977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0d23fad3-0e6d-4ae0-a26b-61478101c683 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.289767 Sep 01 05:43:03.454554 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1366/2650] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:03 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:04.475855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-659ac876-9e7f-49de-85c5-c33fefd7b8a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:04.476407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-659ac876-9e7f-49de-85c5-c33fefd7b8a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] [instance: 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:04.484108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-659ac876-9e7f-49de-85c5-c33fefd7b8a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:04.484595 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-659ac876-9e7f-49de-85c5-c33fefd7b8a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:04.485067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-659ac876-9e7f-49de-85c5-c33fefd7b8a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:04.485756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-659ac876-9e7f-49de-85c5-c33fefd7b8a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:04.486206 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-659ac876-9e7f-49de-85c5-c33fefd7b8a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:04.486634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-659ac876-9e7f-49de-85c5-c33fefd7b8a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:04.633005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-659ac876-9e7f-49de-85c5-c33fefd7b8a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109c732f418442a9bf997fba70669fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cc7e7b1b9f43a18651ab25d5c2b4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:04.650530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-659ac876-9e7f-49de-85c5-c33fefd7b8a7 tempest-VolumesSnapshotTestJSON-1059052017 tempest-VolumesSnapshotTestJSON-1059052017-project] 10.222.0.49 "GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73" status: 200 len: 1558 microversion: 2.1 time: 0.178524 Sep 01 05:43:04.651486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1285/2651] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:04 2022] GET /compute/v2.1/servers/9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:05.359539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=3 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:05.360271 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=57 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:05.361475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:45:05.361644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:45:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad (ip 10.222.0.49) !!! Sep 01 05:45:05.362868 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:45:05.363012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:45:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad (ip 10.222.0.49) !!! Sep 01 05:45:05.368073 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fb837dd3-e928-4c49-98a1-3410c9f00687 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:05.368558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fb837dd3-e928-4c49-98a1-3410c9f00687 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:05.382871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fb837dd3-e928-4c49-98a1-3410c9f00687 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:05.383351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fb837dd3-e928-4c49-98a1-3410c9f00687 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:05.383782 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fb837dd3-e928-4c49-98a1-3410c9f00687 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:05.384459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fb837dd3-e928-4c49-98a1-3410c9f00687 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:05.384932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fb837dd3-e928-4c49-98a1-3410c9f00687 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:05.385351 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-fb837dd3-e928-4c49-98a1-3410c9f00687 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:05.410266 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fb837dd3-e928-4c49-98a1-3410c9f00687 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:45:05.482742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fb837dd3-e928-4c49-98a1-3410c9f00687 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 204 len: 0 microversion: 2.20 time: 0.124582 Sep 01 05:45:05.483343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1367/2652] 10.222.0.49 () {60 vars in 1280 bytes} [Thu Sep 1 05:45:05 2022] DELETE /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:45:05.490524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6ad2bde5-1ebe-46c0-970d-2b18d473a978] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 05:45:05.491076 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:05.491790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=65 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:05.493041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:45:05.493190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:45:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad (ip 10.222.0.49) !!! Sep 01 05:45:05.494242 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:45:05.494360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:45:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad (ip 10.222.0.49) !!! Sep 01 05:45:05.495306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:45:05.495427 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:45:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad (ip 10.222.0.49) !!! Sep 01 05:45:05.499472 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-21f184da-1389-481f-b757-293e44340218 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:05.500092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-21f184da-1389-481f-b757-293e44340218 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:05.512335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21f184da-1389-481f-b757-293e44340218 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:05.512842 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21f184da-1389-481f-b757-293e44340218 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:05.513285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21f184da-1389-481f-b757-293e44340218 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:05.513978 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21f184da-1389-481f-b757-293e44340218 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:05.514433 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21f184da-1389-481f-b757-293e44340218 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:05.514858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21f184da-1389-481f-b757-293e44340218 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:05.727229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-21f184da-1389-481f-b757-293e44340218 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:05.735367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-21f184da-1389-481f-b757-293e44340218 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:05.736839 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-21f184da-1389-481f-b757-293e44340218 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:05.737988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-21f184da-1389-481f-b757-293e44340218 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 200 len: 1724 microversion: 2.20 time: 0.250270 Sep 01 05:45:05.738722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1286/2653] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:05 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:06.735490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-8ce29616-2a25-4f85-97f3-bf59efef139d req-71ebfcd9-6f4e-4a7c-99ac-f5afb3d673b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63e3cab-2de7-4da7-a5ba-432a2b389fad", "name": "network-vif-deleted", "tag": "22c143eb-58c0-47e9-946d-d7fcc7267075"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:06.745983 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-8ce29616-2a25-4f85-97f3-bf59efef139d req-71ebfcd9-6f4e-4a7c-99ac-f5afb3d673b9 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:06.746464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-8ce29616-2a25-4f85-97f3-bf59efef139d req-71ebfcd9-6f4e-4a7c-99ac-f5afb3d673b9 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:06.746896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-8ce29616-2a25-4f85-97f3-bf59efef139d req-71ebfcd9-6f4e-4a7c-99ac-f5afb3d673b9 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:06.761911 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-18e7b9d9-17de-4deb-a8ee-3ec81e2ddca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:06.762550 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-18e7b9d9-17de-4deb-a8ee-3ec81e2ddca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:06.770230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-8ce29616-2a25-4f85-97f3-bf59efef139d req-71ebfcd9-6f4e-4a7c-99ac-f5afb3d673b9 service nova] Creating event network-vif-deleted:22c143eb-58c0-47e9-946d-d7fcc7267075 for instance c63e3cab-2de7-4da7-a5ba-432a2b389fad on hv-cinder-85391 Sep 01 05:45:06.774555 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18e7b9d9-17de-4deb-a8ee-3ec81e2ddca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:06.774936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18e7b9d9-17de-4deb-a8ee-3ec81e2ddca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:06.775373 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18e7b9d9-17de-4deb-a8ee-3ec81e2ddca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:06.776072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18e7b9d9-17de-4deb-a8ee-3ec81e2ddca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:06.776534 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18e7b9d9-17de-4deb-a8ee-3ec81e2ddca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:06.776998 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-18e7b9d9-17de-4deb-a8ee-3ec81e2ddca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:06.785696 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-8ce29616-2a25-4f85-97f3-bf59efef139d req-71ebfcd9-6f4e-4a7c-99ac-f5afb3d673b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054169 Sep 01 05:45:06.787010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1368/2654] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:45:06.790948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] [6ad2bde5-1ebe-46c0-970d-2b18d473a978] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 35640. Sep 01 05:45:06.852445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-18e7b9d9-17de-4deb-a8ee-3ec81e2ddca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:06.861391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-18e7b9d9-17de-4deb-a8ee-3ec81e2ddca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:06.863147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-18e7b9d9-17de-4deb-a8ee-3ec81e2ddca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0b6981c4d53405fbe0395ccbcb9f015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a33ba1fe1ff4325b80a02053b1db739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:06.865317 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-18e7b9d9-17de-4deb-a8ee-3ec81e2ddca3 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 200 len: 1366 microversion: 2.20 time: 0.106512 Sep 01 05:45:06.866424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1287/2655] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:06 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:45:07.889822 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bdea6dca-f8f3-4e7a-8285-064faa75cb55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:07.890527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bdea6dca-f8f3-4e7a-8285-064faa75cb55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:07.896726 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdea6dca-f8f3-4e7a-8285-064faa75cb55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:07.897246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdea6dca-f8f3-4e7a-8285-064faa75cb55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:07.897682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdea6dca-f8f3-4e7a-8285-064faa75cb55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:07.898369 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdea6dca-f8f3-4e7a-8285-064faa75cb55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:07.898821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdea6dca-f8f3-4e7a-8285-064faa75cb55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:07.899246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdea6dca-f8f3-4e7a-8285-064faa75cb55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:07.913332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-bdea6dca-f8f3-4e7a-8285-064faa75cb55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] HTTP exception thrown: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bdea6dca-f8f3-4e7a-8285-064faa75cb55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Request method failure captured: Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad HTTP/1.1 Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED-uT9bLu0AO2jZsoJR1id1NQ1Cb0kzJLLeVtKLIS_65rzdZws9Ovv2RmV7sTZOUg72U27n7c9XPjrR8Zi9BwVGJxr-gaiXu9H1X2rJ0rA3yIrcdwaDRk-9iHtkrfj-aiewxzKJNri45-Tw0_AFgfe1gAQ6OBbakIhlLRIHiEzuVkrc Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 3a33ba1fe1ff4325b80a02053b1db739 Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:45:07.915009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:45:07.916710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3a33ba1fe1ff4325b80a02053b1db739", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a33ba1fe1ff4325b80a02053b1db739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a33ba1fe1ff4325b80a02053b1db739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3a33ba1fe1ff4325b80a02053b1db739"}]}] Sep 01 05:45:07.916710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:45:07.916710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 3a33ba1fe1ff4325b80a02053b1db739 Sep 01 05:45:07.916710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:45:07.916710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeShelveTestJSON-2072305825-project Sep 01 05:45:07.916710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:45:07.916710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:45:07.916710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: d0b6981c4d53405fbe0395ccbcb9f015 Sep 01 05:45:07.916710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2072305825-project Sep 01 05:45:07.916710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:45:07.916710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:45:07.916710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': 'c63e3cab-2de7-4da7-a5ba-432a2b389fad'} Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:45:07.917700 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:45:07.919348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:45:07.921576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bdea6dca-f8f3-4e7a-8285-064faa75cb55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Returning 404 to user: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:45:07.921576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bdea6dca-f8f3-4e7a-8285-064faa75cb55 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 404 len: 111 microversion: 2.20 time: 0.031415 Sep 01 05:45:07.921576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1369/2656] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:45:07 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:45:07.925267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-14bd37d4-0e8f-4cfe-b024-fb09e7621ee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '.version_select at 0x7f962854f3a0>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:07.947807 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-14bd37d4-0e8f-4cfe-b024-fb09e7621ee4 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-943622288" status: 204 len: 0 microversion: 2.20 time: 0.026391 Sep 01 05:45:07.948380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1288/2657] 10.222.0.49 () {60 vars in 1259 bytes} [Thu Sep 1 05:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-943622288 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:49:48.155294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-e90e79ba-bae1-4d99-85db-5b6f84bd9538 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb1cf25c-f9ed-4408-a9f8-10d7dd03a7ae"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:48.157724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-e90e79ba-bae1-4d99-85db-5b6f84bd9538 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:48.161764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed62eb87-dc53-466a-a89e-de9ffa3084ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 05:49:48.162255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:48.163761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:48.165272 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:49:48.165420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:49:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-volume_attachments (ip 10.222.0.49) !!! Sep 01 05:49:48.168380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:49:48.168537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:49:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-volume_attachments (ip 10.222.0.49) !!! Sep 01 05:49:48.169624 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:49:48.169744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:49:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-volume_attachments (ip 10.222.0.49) !!! Sep 01 05:49:48.180219 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e90e79ba-bae1-4d99-85db-5b6f84bd9538 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:48.180870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e90e79ba-bae1-4d99-85db-5b6f84bd9538 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:48.181680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e90e79ba-bae1-4d99-85db-5b6f84bd9538 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:48.182403 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e90e79ba-bae1-4d99-85db-5b6f84bd9538 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:48.182998 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e90e79ba-bae1-4d99-85db-5b6f84bd9538 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:48.183464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-e90e79ba-bae1-4d99-85db-5b6f84bd9538 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:49.116072 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6ad2bde5-1ebe-46c0-970d-2b18d473a978] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:49:49.117184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=12 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:49.117887 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:49.119032 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:49:49.119159 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:49:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e (ip 10.222.0.49) !!! Sep 01 05:49:49.121352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:49:49.121474 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:49:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e (ip 10.222.0.49) !!! Sep 01 05:49:49.122723 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:49:49.122854 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:49:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e (ip 10.222.0.49) !!! Sep 01 05:49:49.130835 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-602bb874-df27-4348-8750-f4a712a0a927 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:49.131332 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-602bb874-df27-4348-8750-f4a712a0a927 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:49.148436 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-602bb874-df27-4348-8750-f4a712a0a927 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:49.149316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-602bb874-df27-4348-8750-f4a712a0a927 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:49.149752 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-602bb874-df27-4348-8750-f4a712a0a927 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:49.150443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-602bb874-df27-4348-8750-f4a712a0a927 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:49.150895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-602bb874-df27-4348-8750-f4a712a0a927 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:49.151317 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-602bb874-df27-4348-8750-f4a712a0a927 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:49.173084 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed62eb87-dc53-466a-a89e-de9ffa3084ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 35786. Sep 01 05:49:49.183121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-602bb874-df27-4348-8750-f4a712a0a927 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Going to try to terminate instance {{(pid=120674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:49:49.266382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-602bb874-df27-4348-8750-f4a712a0a927 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "DELETE /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 204 len: 0 microversion: 2.1 time: 0.151694 Sep 01 05:49:49.266977 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1289/2658] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:49:49 2022] DELETE /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:49:49.276286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b52d556f-6ad7-4c76-b6b8-ad43106d0e81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:49.277021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b52d556f-6ad7-4c76-b6b8-ad43106d0e81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:49.284078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b52d556f-6ad7-4c76-b6b8-ad43106d0e81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:49.284822 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b52d556f-6ad7-4c76-b6b8-ad43106d0e81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:49.285367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b52d556f-6ad7-4c76-b6b8-ad43106d0e81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:49.286056 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b52d556f-6ad7-4c76-b6b8-ad43106d0e81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:49.286547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b52d556f-6ad7-4c76-b6b8-ad43106d0e81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:49.287162 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b52d556f-6ad7-4c76-b6b8-ad43106d0e81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:49.298312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-e90e79ba-bae1-4d99-85db-5b6f84bd9538 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.147889 Sep 01 05:49:49.298919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1370/2659] 10.222.0.49 () {60 vars in 1323 bytes} [Thu Sep 1 05:49:48 2022] POST /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-volume_attachments => generated 194 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:49.422954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b52d556f-6ad7-4c76-b6b8-ad43106d0e81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:49.430801 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b52d556f-6ad7-4c76-b6b8-ad43106d0e81 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1508 microversion: 2.1 time: 0.159401 Sep 01 05:49:49.431360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1290/2660] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:49 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:49:50.452147 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9517067d-6b18-495f-8f20-4a535177e9df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:50.452887 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9517067d-6b18-495f-8f20-4a535177e9df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:50.458930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9517067d-6b18-495f-8f20-4a535177e9df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:50.459414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9517067d-6b18-495f-8f20-4a535177e9df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:50.459863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9517067d-6b18-495f-8f20-4a535177e9df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:50.460550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9517067d-6b18-495f-8f20-4a535177e9df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:50.461031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9517067d-6b18-495f-8f20-4a535177e9df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:50.461455 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9517067d-6b18-495f-8f20-4a535177e9df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:50.592516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9517067d-6b18-495f-8f20-4a535177e9df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:50.600263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9517067d-6b18-495f-8f20-4a535177e9df tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1508 microversion: 2.1 time: 0.152668 Sep 01 05:49:50.601418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1371/2661] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:50 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:51.447441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] [6ad2bde5-1ebe-46c0-970d-2b18d473a978] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 35816. Sep 01 05:49:51.547887 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-3b6e3115-6de7-41bc-9979-703256ef55f1 req-c804c3f1-d88d-475b-948e-99566b2faba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad1a0f8-dc03-4662-8e60-d9b7995d1f73", "name": "network-vif-unplugged", "status": "completed", "tag": "88da57a0-b17d-4528-bf1f-950f12d1e685"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:51.558755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-3b6e3115-6de7-41bc-9979-703256ef55f1 req-c804c3f1-d88d-475b-948e-99566b2faba0 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:51.559237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-3b6e3115-6de7-41bc-9979-703256ef55f1 req-c804c3f1-d88d-475b-948e-99566b2faba0 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:51.559666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-3b6e3115-6de7-41bc-9979-703256ef55f1 req-c804c3f1-d88d-475b-948e-99566b2faba0 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:51.574154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-3b6e3115-6de7-41bc-9979-703256ef55f1 req-c804c3f1-d88d-475b-948e-99566b2faba0 service nova] Creating event network-vif-unplugged:88da57a0-b17d-4528-bf1f-950f12d1e685 for instance 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 on hv-cinder-85391 Sep 01 05:49:51.579879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-3b6e3115-6de7-41bc-9979-703256ef55f1 req-c804c3f1-d88d-475b-948e-99566b2faba0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152394 Sep 01 05:49:51.581104 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1291/2662] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:51.622540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2a392770-de57-44ec-8462-29c8daad1ac2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:51.623083 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2a392770-de57-44ec-8462-29c8daad1ac2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:51.631230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a392770-de57-44ec-8462-29c8daad1ac2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:51.631783 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a392770-de57-44ec-8462-29c8daad1ac2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:51.632691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a392770-de57-44ec-8462-29c8daad1ac2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:51.633743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a392770-de57-44ec-8462-29c8daad1ac2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:51.634367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a392770-de57-44ec-8462-29c8daad1ac2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:51.635358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2a392770-de57-44ec-8462-29c8daad1ac2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:51.777607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2a392770-de57-44ec-8462-29c8daad1ac2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:51.786479 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2a392770-de57-44ec-8462-29c8daad1ac2 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1508 microversion: 2.1 time: 0.168461 Sep 01 05:49:51.787614 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1372/2663] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:51 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:52.090368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-fc6de4c9-72ad-4f19-a5a6-daa3c55cd321 req-6e7f9791-b629-45f1-a1a5-1797c4bc1df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad1a0f8-dc03-4662-8e60-d9b7995d1f73", "name": "network-vif-deleted", "tag": "88da57a0-b17d-4528-bf1f-950f12d1e685"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:52.101626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-fc6de4c9-72ad-4f19-a5a6-daa3c55cd321 req-6e7f9791-b629-45f1-a1a5-1797c4bc1df3 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:52.102366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-fc6de4c9-72ad-4f19-a5a6-daa3c55cd321 req-6e7f9791-b629-45f1-a1a5-1797c4bc1df3 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:52.102891 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-fc6de4c9-72ad-4f19-a5a6-daa3c55cd321 req-6e7f9791-b629-45f1-a1a5-1797c4bc1df3 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:52.117566 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-fc6de4c9-72ad-4f19-a5a6-daa3c55cd321 req-6e7f9791-b629-45f1-a1a5-1797c4bc1df3 service nova] Creating event network-vif-deleted:88da57a0-b17d-4528-bf1f-950f12d1e685 for instance 9ad1a0f8-dc03-4662-8e60-d9b7995d1f73 on hv-cinder-85391 Sep 01 05:49:52.123379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-fc6de4c9-72ad-4f19-a5a6-daa3c55cd321 req-6e7f9791-b629-45f1-a1a5-1797c4bc1df3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096979 Sep 01 05:49:52.124053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1292/2664] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:52.462750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-11e1c87a-f6b4-48fa-8b1d-fabc659d2c83 req-2e7dc523-23f5-4527-90b6-606ffdd70ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266d4ced-afe8-4d91-a857-192e9315a28e", "name": "network-vif-deleted", "tag": "0d853372-0a5c-486f-98d3-6a3c853acda7"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:52.472421 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-11e1c87a-f6b4-48fa-8b1d-fabc659d2c83 req-2e7dc523-23f5-4527-90b6-606ffdd70ace service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:52.472924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-11e1c87a-f6b4-48fa-8b1d-fabc659d2c83 req-2e7dc523-23f5-4527-90b6-606ffdd70ace service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:52.473349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-11e1c87a-f6b4-48fa-8b1d-fabc659d2c83 req-2e7dc523-23f5-4527-90b6-606ffdd70ace service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:52.485227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-11e1c87a-f6b4-48fa-8b1d-fabc659d2c83 req-2e7dc523-23f5-4527-90b6-606ffdd70ace service nova] Creating event network-vif-deleted:0d853372-0a5c-486f-98d3-6a3c853acda7 for instance 266d4ced-afe8-4d91-a857-192e9315a28e on hv-cinder-85391 Sep 01 05:49:52.489924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-11e1c87a-f6b4-48fa-8b1d-fabc659d2c83 req-2e7dc523-23f5-4527-90b6-606ffdd70ace service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123762 Sep 01 05:49:52.490510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1373/2665] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:52.811610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:52.812459 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:52.823556 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:52.824365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:52.825014 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:52.826640 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:52.827265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:52.827922 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:52.875736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:52.876216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:52.876643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:52.877110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lazy-loading 'fault' on Instance uuid 266d4ced-afe8-4d91-a857-192e9315a28e {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:49:52.934380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:52.942403 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-44f2784b-9fa1-4911-9bad-2ddb84921d3b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 200 len: 1312 microversion: 2.1 time: 0.135905 Sep 01 05:49:52.942983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1293/2666] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:52 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 1312 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:53.965366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-80d88713-4a9c-4dea-9162-b832af8d404b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:53.966070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-80d88713-4a9c-4dea-9162-b832af8d404b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: 266d4ced-afe8-4d91-a857-192e9315a28e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:53.972221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80d88713-4a9c-4dea-9162-b832af8d404b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:53.972697 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80d88713-4a9c-4dea-9162-b832af8d404b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:53.973152 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80d88713-4a9c-4dea-9162-b832af8d404b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:53.973843 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80d88713-4a9c-4dea-9162-b832af8d404b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:53.974289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80d88713-4a9c-4dea-9162-b832af8d404b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:53.974698 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-80d88713-4a9c-4dea-9162-b832af8d404b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:53.988471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-80d88713-4a9c-4dea-9162-b832af8d404b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] HTTP exception thrown: Instance 266d4ced-afe8-4d91-a857-192e9315a28e could not be found. Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-80d88713-4a9c-4dea-9162-b832af8d404b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Request method failure captured: Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e HTTP/1.1 Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED-3P2h09WzcNHsGu6ok1mj_IMYhqwx77kTgJsKM0gitT6TGjia6EkCndZLHg6xT83N873XLrlpv904xagMSkAmG1Zlxdul2gZ0FhgmaVCEFjcM_TONUvBFrLS_aZBFF8UKoy-4CcOUw9raG-n_hPk892NrcDNscsLrDlZUglZi8whI Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: db6e336d82254a9bafb2443958923d3d Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1376693752 Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:49:53.990131 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:49:53.993018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_db6e336d82254a9bafb2443958923d3d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/db6e336d82254a9bafb2443958923d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/db6e336d82254a9bafb2443958923d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/db6e336d82254a9bafb2443958923d3d"}]}] Sep 01 05:49:53.993018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1376693752 Sep 01 05:49:53.993018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: db6e336d82254a9bafb2443958923d3d Sep 01 05:49:53.993018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1376693752 Sep 01 05:49:53.993018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-ServerRescueNegativeTestJSON-1376693752-project Sep 01 05:49:53.993018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:49:53.993018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:49:53.993018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 3f7ca41b422f45a0a62af9fba781a796 Sep 01 05:49:53.993018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1376693752-project Sep 01 05:49:53.993018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:49:53.993018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance 266d4ced-afe8-4d91-a857-192e9315a28e could not be found. Sep 01 05:49:53.993018 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '266d4ced-afe8-4d91-a857-192e9315a28e'} Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 266d4ced-afe8-4d91-a857-192e9315a28e could not be found. Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:49:53.993959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 266d4ced-afe8-4d91-a857-192e9315a28e could not be found. Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 266d4ced-afe8-4d91-a857-192e9315a28e could not be found. Sep 01 05:49:53.995496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:49:53.997171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-80d88713-4a9c-4dea-9162-b832af8d404b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Returning 404 to user: Instance 266d4ced-afe8-4d91-a857-192e9315a28e could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:49:53.997171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-80d88713-4a9c-4dea-9162-b832af8d404b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e" status: 404 len: 111 microversion: 2.1 time: 0.032275 Sep 01 05:49:53.997171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1374/2667] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:53 2022] GET /compute/v2.1/servers/266d4ced-afe8-4d91-a857-192e9315a28e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:49:54.000615 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ed2f209a-5e61-4bef-a385-e75ef424c7ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:54.001131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ed2f209a-5e61-4bef-a385-e75ef424c7ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:54.008377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed2f209a-5e61-4bef-a385-e75ef424c7ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:54.008915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed2f209a-5e61-4bef-a385-e75ef424c7ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:54.009353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed2f209a-5e61-4bef-a385-e75ef424c7ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:54.010046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed2f209a-5e61-4bef-a385-e75ef424c7ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:54.010491 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed2f209a-5e61-4bef-a385-e75ef424c7ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:54.011002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ed2f209a-5e61-4bef-a385-e75ef424c7ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:54.041948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ed2f209a-5e61-4bef-a385-e75ef424c7ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Going to try to terminate instance {{(pid=120674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:49:54.124352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ed2f209a-5e61-4bef-a385-e75ef424c7ed tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 204 len: 0 microversion: 2.1 time: 0.127088 Sep 01 05:49:54.125223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1294/2668] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:49:53 2022] DELETE /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:49:54.135165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ffcf0298-1245-41d9-8443-637731000446 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:54.135519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ffcf0298-1245-41d9-8443-637731000446 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:54.143343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffcf0298-1245-41d9-8443-637731000446 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:54.144032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffcf0298-1245-41d9-8443-637731000446 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:54.144567 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffcf0298-1245-41d9-8443-637731000446 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:54.145528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffcf0298-1245-41d9-8443-637731000446 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:54.145976 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffcf0298-1245-41d9-8443-637731000446 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:54.146405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ffcf0298-1245-41d9-8443-637731000446 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:54.286118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ffcf0298-1245-41d9-8443-637731000446 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:54.294765 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ffcf0298-1245-41d9-8443-637731000446 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1521 microversion: 2.1 time: 0.165021 Sep 01 05:49:54.295400 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1375/2669] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:54 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:55.165141 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-2207c160-2f86-4163-9f23-8848e36e0e3a req-4eba116a-2130-41ca-b053-649e71616ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9edb178-d264-4269-ae85-e2b524170b64", "name": "network-vif-deleted", "tag": "fe7dc8dd-0874-4433-84e8-a98124ba174e"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:55.178080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-2207c160-2f86-4163-9f23-8848e36e0e3a req-4eba116a-2130-41ca-b053-649e71616ff9 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:55.178503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-2207c160-2f86-4163-9f23-8848e36e0e3a req-4eba116a-2130-41ca-b053-649e71616ff9 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:55.178930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-2207c160-2f86-4163-9f23-8848e36e0e3a req-4eba116a-2130-41ca-b053-649e71616ff9 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:55.191810 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-2207c160-2f86-4163-9f23-8848e36e0e3a req-4eba116a-2130-41ca-b053-649e71616ff9 service nova] Creating event network-vif-deleted:fe7dc8dd-0874-4433-84e8-a98124ba174e for instance f9edb178-d264-4269-ae85-e2b524170b64 on hv-cinder-85391 Sep 01 05:49:55.198869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-2207c160-2f86-4163-9f23-8848e36e0e3a req-4eba116a-2130-41ca-b053-649e71616ff9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038819 Sep 01 05:49:55.199764 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1295/2670] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:55.315415 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:55.316330 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:55.323855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:55.330876 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:55.331327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:55.332065 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:55.332526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:55.332978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:55.370037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:55.370602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:55.371295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:55.371752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lazy-loading 'fault' on Instance uuid f9edb178-d264-4269-ae85-e2b524170b64 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:49:55.425311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7ca41b422f45a0a62af9fba781a796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6e336d82254a9bafb2443958923d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:55.436335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b44779c2-1fa4-4619-92d2-bad694f8666b tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 200 len: 1311 microversion: 2.1 time: 0.124573 Sep 01 05:49:55.436964 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1376/2671] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:55 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 1311 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:56.458794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e8b6cebe-c2fc-444f-8476-8940aa550725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:56.460013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e8b6cebe-c2fc-444f-8476-8940aa550725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] [instance: f9edb178-d264-4269-ae85-e2b524170b64] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:56.466229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8b6cebe-c2fc-444f-8476-8940aa550725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:56.466701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8b6cebe-c2fc-444f-8476-8940aa550725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:56.467128 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8b6cebe-c2fc-444f-8476-8940aa550725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:56.467798 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8b6cebe-c2fc-444f-8476-8940aa550725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:56.468245 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8b6cebe-c2fc-444f-8476-8940aa550725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:56.468662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e8b6cebe-c2fc-444f-8476-8940aa550725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:56.482269 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-e8b6cebe-c2fc-444f-8476-8940aa550725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] HTTP exception thrown: Instance f9edb178-d264-4269-ae85-e2b524170b64 could not be found. Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e8b6cebe-c2fc-444f-8476-8940aa550725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Request method failure captured: Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 HTTP/1.1 Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED-3P2h09WzcNHsGu6ok1mj_IMYhqwx77kTgJsKM0gitT6TGjia6EkCndZLHg6xT83N873XLrlpv904xagMSkAmG1Zlxdul2gZ0FhgmaVCEFjcM_TONUvBFrLS_aZBFF8UKoy-4CcOUw9raG-n_hPk892NrcDNscsLrDlZUglZi8whI Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: db6e336d82254a9bafb2443958923d3d Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1376693752 Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:49:56.483892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:49:56.485772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_db6e336d82254a9bafb2443958923d3d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/db6e336d82254a9bafb2443958923d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/db6e336d82254a9bafb2443958923d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/db6e336d82254a9bafb2443958923d3d"}]}] Sep 01 05:49:56.485772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1376693752 Sep 01 05:49:56.485772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: db6e336d82254a9bafb2443958923d3d Sep 01 05:49:56.485772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1376693752 Sep 01 05:49:56.485772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-ServerRescueNegativeTestJSON-1376693752-project Sep 01 05:49:56.485772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:49:56.485772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:49:56.485772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 3f7ca41b422f45a0a62af9fba781a796 Sep 01 05:49:56.485772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1376693752-project Sep 01 05:49:56.485772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:49:56.485772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance f9edb178-d264-4269-ae85-e2b524170b64 could not be found. Sep 01 05:49:56.485772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': 'f9edb178-d264-4269-ae85-e2b524170b64'} Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9edb178-d264-4269-ae85-e2b524170b64 could not be found. Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:49:56.486865 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9edb178-d264-4269-ae85-e2b524170b64 could not be found. Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9edb178-d264-4269-ae85-e2b524170b64 could not be found. Sep 01 05:49:56.488622 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:49:56.490136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e8b6cebe-c2fc-444f-8476-8940aa550725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] Returning 404 to user: Instance f9edb178-d264-4269-ae85-e2b524170b64 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:49:56.490136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e8b6cebe-c2fc-444f-8476-8940aa550725 tempest-ServerRescueNegativeTestJSON-1376693752 tempest-ServerRescueNegativeTestJSON-1376693752-project] 10.222.0.49 "GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64" status: 404 len: 111 microversion: 2.1 time: 0.031140 Sep 01 05:49:56.490136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1296/2672] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:56 2022] GET /compute/v2.1/servers/f9edb178-d264-4269-ae85-e2b524170b64 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:50:00.908079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fc8909ca-e60d-4e1f-8402-e104513b573c tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Action: 'create', calling method: .version_select at 0x7f9628544c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-605390367"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:01.253102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fc8909ca-e60d-4e1f-8402-e104513b573c tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.480012 Sep 01 05:50:01.261870 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1377/2673] 10.222.0.49 () {60 vars in 1155 bytes} [Thu Sep 1 05:50:00 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 490 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 05:50:01.267463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-acbc2418-90ba-4867-85ed-cdbc2aa7fffa tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9628500ca0>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:01.284743 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-771e2b10-8a4a-47c9-be97-9d532f389ca5 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: .version_select at 0x7f9624daf4c0>, body: {"keypair": {"name": "tempest-keypair-1405084333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoYC8wRJBF480EXeRmuUj1NgVKqGmJPQNgQZsDANwzt7lbksYg1UW9XSewtHuhj8tBDWUFP2B5hY/4syx8qB85v+sQ1a1TaEmLx8oKAIAEt1aA6/u5Qc07wPpxA9IDVEQ=="}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:01.304516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-771e2b10-8a4a-47c9-be97-9d532f389ca5 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for project 206f93c129394a4badf489d8c7c45b16. Resources: {'key_pairs'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:50:01.308764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-771e2b10-8a4a-47c9-be97-9d532f389ca5 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for user 2e8c9e2056464b9299ff765507323869 and project 206f93c129394a4badf489d8c7c45b16. Resources: {'key_pairs'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:50:01.329696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-acbc2418-90ba-4867-85ed-cdbc2aa7fffa tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f" status: 200 len: 344 microversion: 2.1 time: 0.063976 Sep 01 05:50:01.330522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1297/2674] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:50:01 2022] GET /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:01.345045 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-771e2b10-8a4a-47c9-be97-9d532f389ca5 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064177 Sep 01 05:50:01.345815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1378/2675] 10.222.0.49 () {60 vars in 1159 bytes} [Thu Sep 1 05:50:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:50:02.345806 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-39ee4050-d84c-430f-8f01-9f7f6f9cdbe3 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f96284541f0>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:02.409377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-39ee4050-d84c-430f-8f01-9f7f6f9cdbe3 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f" status: 200 len: 345 microversion: 2.1 time: 0.068783 Sep 01 05:50:02.410113 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1298/2676] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:50:02 2022] GET /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:02.482687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-427b37d7-ae5a-4b52-8af5-078fe0380a64 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Action: 'create', calling method: .version_select at 0x7f9624d3ad30>, body: {"snapshot": {"volume_id": "27879f0a-78aa-45b4-88c7-1c8d89b5fa3f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-194303228"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:02.645164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-427b37d7-ae5a-4b52-8af5-078fe0380a64 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.166697 Sep 01 05:50:02.645843 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1379/2677] 10.222.0.49 () {60 vars in 1162 bytes} [Thu Sep 1 05:50:02 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:02.649349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-555152327", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bf7b767-c598-4723-849f-bfb972eb4c62"}], "security_groups": [{"name": "tempest-securitygroup--163740813"}], "key_name": "tempest-keypair-1405084333", "user_data": "}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:02.657335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-44ca9563-33aa-465f-bcbb-0450d85ae24a tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9624eca430>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:02.692600 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-44ca9563-33aa-465f-bcbb-0450d85ae24a tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16" status: 200 len: 286 microversion: 2.1 time: 0.039856 Sep 01 05:50:02.693217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1380/2678] 10.222.0.49 () {58 vars in 1251 bytes} [Thu Sep 1 05:50:02 2022] GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:50:02.704076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a764ac10-6922-4816-b03e-4249ffec93ba tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9624dafc10>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:02.739613 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a764ac10-6922-4816-b03e-4249ffec93ba tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.039015 Sep 01 05:50:02.740177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1381/2679] 10.222.0.49 () {58 vars in 1140 bytes} [Thu Sep 1 05:50:02 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:50:02.750953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-42001c9a-7cc6-4283-b791-f8becff0319f tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9624d57940>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:02.774522 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.network.neutron [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] validate_networks() for [('3bf7b767-c598-4723-849f-bfb972eb4c62', None, None, None, None, None)] {{(pid=120674) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:50:02.782611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-42001c9a-7cc6-4283-b791-f8becff0319f tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16" status: 200 len: 286 microversion: 2.1 time: 0.035347 Sep 01 05:50:02.783217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1382/2680] 10.222.0.49 () {58 vars in 1251 bytes} [Thu Sep 1 05:50:02 2022] GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:50:03.244335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Flavor limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:50:03.244814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Image limits 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:50:03.245289 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Flavor pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:50:03.245694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Image pref 0:0:0 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:50:03.246103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.virt.hardware [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:50:03.255132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:03.255607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:03.256081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:03.256855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:03.257272 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:03.257693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:03.274010 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for project 206f93c129394a4badf489d8c7c45b16. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:50:03.277888 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for user 2e8c9e2056464b9299ff765507323869 and project 206f93c129394a4badf489d8c7c45b16. Resources: {'ram', 'instances', 'cores'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:50:03.289407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Going to run 1 instances... {{(pid=120674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:50:03.291670 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:50:03.338470 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8d174ee8-8b85-4099-bf5e-1e7290658ec6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.694727 Sep 01 05:50:03.339114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1299/2681] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:50:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:50:03.350514 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8cd43fb7-2071-4ca6-9e7b-e368a7408b36 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:03.351120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8cd43fb7-2071-4ca6-9e7b-e368a7408b36 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:03.406217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8cd43fb7-2071-4ca6-9e7b-e368a7408b36 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:03.414141 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8cd43fb7-2071-4ca6-9e7b-e368a7408b36 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1241 microversion: 2.1 time: 0.067543 Sep 01 05:50:03.414316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1383/2682] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:03 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:03.796013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f9a1d67e-2b23-47df-9cd5-aba8f6df81ee tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9624b50280>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:03.828339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f9a1d67e-2b23-47df-9cd5-aba8f6df81ee tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16" status: 200 len: 286 microversion: 2.1 time: 0.036679 Sep 01 05:50:03.829061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1300/2683] 10.222.0.49 () {58 vars in 1251 bytes} [Thu Sep 1 05:50:03 2022] GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:04.434531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-436748b1-067d-4ddf-affd-60cc2ccfd4f6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:04.435157 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-436748b1-067d-4ddf-affd-60cc2ccfd4f6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:04.442127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-436748b1-067d-4ddf-affd-60cc2ccfd4f6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:04.442611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-436748b1-067d-4ddf-affd-60cc2ccfd4f6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:04.443049 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-436748b1-067d-4ddf-affd-60cc2ccfd4f6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:04.443730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-436748b1-067d-4ddf-affd-60cc2ccfd4f6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:04.444860 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-436748b1-067d-4ddf-affd-60cc2ccfd4f6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:04.445319 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-436748b1-067d-4ddf-affd-60cc2ccfd4f6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:04.507563 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-436748b1-067d-4ddf-affd-60cc2ccfd4f6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:04.515165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-436748b1-067d-4ddf-affd-60cc2ccfd4f6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1245 microversion: 2.1 time: 0.084873 Sep 01 05:50:04.515738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1384/2684] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:04 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:04.842613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6b045b8b-fbb7-4f29-9b70-da4e48ccaa53 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9628500940>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:04.872975 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6b045b8b-fbb7-4f29-9b70-da4e48ccaa53 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16" status: 200 len: 286 microversion: 2.1 time: 0.035013 Sep 01 05:50:04.873563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1301/2685] 10.222.0.49 () {58 vars in 1251 bytes} [Thu Sep 1 05:50:04 2022] GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:05.535539 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-41d33beb-a7c2-42b2-8dd1-2ee39f6d3bab tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:05.536221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-41d33beb-a7c2-42b2-8dd1-2ee39f6d3bab tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:05.543332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41d33beb-a7c2-42b2-8dd1-2ee39f6d3bab tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:05.543815 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41d33beb-a7c2-42b2-8dd1-2ee39f6d3bab tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:05.544425 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41d33beb-a7c2-42b2-8dd1-2ee39f6d3bab tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:05.545320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41d33beb-a7c2-42b2-8dd1-2ee39f6d3bab tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:05.545784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41d33beb-a7c2-42b2-8dd1-2ee39f6d3bab tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:05.546641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-41d33beb-a7c2-42b2-8dd1-2ee39f6d3bab tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:05.607496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-41d33beb-a7c2-42b2-8dd1-2ee39f6d3bab tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:05.615275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-41d33beb-a7c2-42b2-8dd1-2ee39f6d3bab tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1237 microversion: 2.1 time: 0.083513 Sep 01 05:50:05.615846 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1385/2686] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:05 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:05.885253 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9506b4df-38fe-46b4-8876-c02e98ae2415 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f96284c1790>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:05.966570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9506b4df-38fe-46b4-8876-c02e98ae2415 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16" status: 200 len: 287 microversion: 2.1 time: 0.085868 Sep 01 05:50:05.967179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1302/2687] 10.222.0.49 () {58 vars in 1251 bytes} [Thu Sep 1 05:50:05 2022] GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:05.979307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cd47ed39-acc0-4a8e-9af7-437c1c372762 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9624daf280>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:06.037295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cd47ed39-acc0-4a8e-9af7-437c1c372762 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16" status: 202 len: 0 microversion: 2.1 time: 0.063007 Sep 01 05:50:06.037859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1386/2688] 10.222.0.49 () {58 vars in 1254 bytes} [Thu Sep 1 05:50:05 2022] DELETE /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:50:06.046660 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d5f57a56-7385-461c-a23d-362495e2d749 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9628454670>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:06.081330 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d5f57a56-7385-461c-a23d-362495e2d749 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16" status: 200 len: 286 microversion: 2.1 time: 0.038308 Sep 01 05:50:06.081899 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1303/2689] 10.222.0.49 () {58 vars in 1251 bytes} [Thu Sep 1 05:50:06 2022] GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:06.638495 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-21f032c4-b12b-424d-b64d-3a51526029c1 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:06.639143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-21f032c4-b12b-424d-b64d-3a51526029c1 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:06.645136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21f032c4-b12b-424d-b64d-3a51526029c1 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:06.645607 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21f032c4-b12b-424d-b64d-3a51526029c1 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:06.646042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21f032c4-b12b-424d-b64d-3a51526029c1 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:06.646727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21f032c4-b12b-424d-b64d-3a51526029c1 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:06.647181 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21f032c4-b12b-424d-b64d-3a51526029c1 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:06.647602 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-21f032c4-b12b-424d-b64d-3a51526029c1 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:06.715254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-21f032c4-b12b-424d-b64d-3a51526029c1 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:06.729701 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-21f032c4-b12b-424d-b64d-3a51526029c1 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1299 microversion: 2.1 time: 0.095291 Sep 01 05:50:06.731520 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1387/2690] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:06 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:07.094915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fb77cb2c-acff-4c9a-b769-c6e2b244899a tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9624bbab80>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:07.128927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-fb77cb2c-acff-4c9a-b769-c6e2b244899a tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] HTTP exception thrown: Snapshot 8eac5be3-35bb-4d02-8343-3c49b8023d16 could not be found. Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fb77cb2c-acff-4c9a-b769-c6e2b244899a tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Request method failure captured: Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16 HTTP/1.1 Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEgIR68o5TkBQ7fdlWScLWFL7xUCz3XLloBrGyYfgEHU30i147E059dIeYTphCvOWu1ns7ETD8zwNeXntp19i-AmTcAuEI_hJLi4fDi5bZIapcdfDs9nKe0H5lTbEoEqiYzcJbAK2SBTxWE88N9G-zzwOMEHlypMzwGuqlYUDtZamEY Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: e6798ac93019499bab61dad51528e010 Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1937084499 Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:50:07.131132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e6798ac93019499bab61dad51528e010", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e6798ac93019499bab61dad51528e010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e6798ac93019499bab61dad51528e010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e6798ac93019499bab61dad51528e010"}]}] Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1937084499 Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: e6798ac93019499bab61dad51528e010 Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1937084499 Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-VolumesSnapshotsTestJSON-1937084499-project Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: e5050442276b436ab9b42077de156f19 Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1937084499-project Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Snapshot 8eac5be3-35bb-4d02-8343-3c49b8023d16 could not be found. Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '8eac5be3-35bb-4d02-8343-3c49b8023d16'} Sep 01 05:50:07.133204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8eac5be3-35bb-4d02-8343-3c49b8023d16 could not be found. (HTTP 404) (Request-ID: req-beb7fd24-c59c-40f9-b067-dfea8e54c5b7) Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:07.134755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:50:07.137326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8eac5be3-35bb-4d02-8343-3c49b8023d16 could not be found. Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 05:50:07.139769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8eac5be3-35bb-4d02-8343-3c49b8023d16 could not be found. Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8eac5be3-35bb-4d02-8343-3c49b8023d16 could not be found. Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fb77cb2c-acff-4c9a-b769-c6e2b244899a tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Returning 404 to user: Snapshot 8eac5be3-35bb-4d02-8343-3c49b8023d16 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:50:07.141665 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fb77cb2c-acff-4c9a-b769-c6e2b244899a tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16" status: 404 len: 111 microversion: 2.1 time: 0.042429 Sep 01 05:50:07.143688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1304/2691] 10.222.0.49 () {58 vars in 1251 bytes} [Thu Sep 1 05:50:07 2022] GET /compute/v2.1/os-snapshots/8eac5be3-35bb-4d02-8343-3c49b8023d16 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:50:07.143849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8dfce9ca-bcf9-4688-88a5-9597af136520 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9624dafb80>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:07.204228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8dfce9ca-bcf9-4688-88a5-9597af136520 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f" status: 202 len: 0 microversion: 2.1 time: 0.066394 Sep 01 05:50:07.205034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1388/2692] 10.222.0.49 () {58 vars in 1248 bytes} [Thu Sep 1 05:50:07 2022] DELETE /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:50:07.215154 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-14e33408-d97b-41c0-b6f6-7e7e28ae7bc8 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9628500310>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:07.270465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-14e33408-d97b-41c0-b6f6-7e7e28ae7bc8 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f" status: 200 len: 344 microversion: 2.1 time: 0.060244 Sep 01 05:50:07.271252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1305/2693] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:50:07 2022] GET /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:07.473074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-38ea9905-b33c-4375-9e60-bb257980fc10 req-b39d103f-b203-426f-9169-ea99a39f9f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f3547e7-63de-4df8-87bf-60a4f05a9e28", "tag": "5f2c28fe-57d2-4a00-ae6d-311abb7517b8"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:07.484195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-38ea9905-b33c-4375-9e60-bb257980fc10 req-b39d103f-b203-426f-9169-ea99a39f9f37 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:07.494966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-38ea9905-b33c-4375-9e60-bb257980fc10 req-b39d103f-b203-426f-9169-ea99a39f9f37 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:07.495423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-38ea9905-b33c-4375-9e60-bb257980fc10 req-b39d103f-b203-426f-9169-ea99a39f9f37 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:07.506941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-38ea9905-b33c-4375-9e60-bb257980fc10 req-b39d103f-b203-426f-9169-ea99a39f9f37 service nova] Creating event network-changed:5f2c28fe-57d2-4a00-ae6d-311abb7517b8 for instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 on hv-cinder-85391 Sep 01 05:50:07.513202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-38ea9905-b33c-4375-9e60-bb257980fc10 req-b39d103f-b203-426f-9169-ea99a39f9f37 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043939 Sep 01 05:50:07.513797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1389/2694] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:07.751708 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ccd26bbc-1ec1-4310-a2e7-70c48fa25841 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:07.752394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ccd26bbc-1ec1-4310-a2e7-70c48fa25841 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:07.759530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ccd26bbc-1ec1-4310-a2e7-70c48fa25841 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:07.760052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ccd26bbc-1ec1-4310-a2e7-70c48fa25841 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:07.760493 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ccd26bbc-1ec1-4310-a2e7-70c48fa25841 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:07.761216 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ccd26bbc-1ec1-4310-a2e7-70c48fa25841 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:07.761671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ccd26bbc-1ec1-4310-a2e7-70c48fa25841 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:07.762183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ccd26bbc-1ec1-4310-a2e7-70c48fa25841 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:07.966233 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ccd26bbc-1ec1-4310-a2e7-70c48fa25841 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:07.974002 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ccd26bbc-1ec1-4310-a2e7-70c48fa25841 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1366 microversion: 2.1 time: 0.226289 Sep 01 05:50:07.974572 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1306/2695] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:07 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:08.286936 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7df29c85-dfe7-45bf-b728-f4422323ab6e tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9624daff70>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:08.315577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-7df29c85-dfe7-45bf-b728-f4422323ab6e tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] HTTP exception thrown: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7df29c85-dfe7-45bf-b728-f4422323ab6e tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Request method failure captured: Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f HTTP/1.1 Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjEEgIR68o5TkBQ7fdlWScLWFL7xUCz3XLloBrGyYfgEHU30i147E059dIeYTphCvOWu1ns7ETD8zwNeXntp19i-AmTcAuEI_hJLi4fDi5bZIapcdfDs9nKe0H5lTbEoEqiYzcJbAK2SBTxWE88N9G-zzwOMEHlypMzwGuqlYUDtZamEY Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: e6798ac93019499bab61dad51528e010 Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1937084499 Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:50:08.317977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e6798ac93019499bab61dad51528e010", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e6798ac93019499bab61dad51528e010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e6798ac93019499bab61dad51528e010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e6798ac93019499bab61dad51528e010"}]}] Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1937084499 Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: e6798ac93019499bab61dad51528e010 Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1937084499 Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-VolumesSnapshotsTestJSON-1937084499-project Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: e5050442276b436ab9b42077de156f19 Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1937084499-project Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '27879f0a-78aa-45b4-88c7-1c8d89b5fa3f'} Sep 01 05:50:08.319780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. (HTTP 404) (Request-ID: req-eae19503-b8c2-47d5-9a43-2650785eb884) Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:08.322188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:50:08.325923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:50:08.327510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7df29c85-dfe7-45bf-b728-f4422323ab6e tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Returning 404 to user: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7df29c85-dfe7-45bf-b728-f4422323ab6e tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f" status: 404 len: 109 microversion: 2.1 time: 0.037136 Sep 01 05:50:08.329254 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1390/2696] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:50:08 2022] GET /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:50:08.334539 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1bb702a7-e361-455c-8b2d-c11285af7a8f tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9628500820>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:08.363338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-1bb702a7-e361-455c-8b2d-c11285af7a8f tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] HTTP exception thrown: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1bb702a7-e361-455c-8b2d-c11285af7a8f tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Request method failure captured: Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f HTTP/1.1 Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEgIR68o5TkBQ7fdlWScLWFL7xUCz3XLloBrGyYfgEHU30i147E059dIeYTphCvOWu1ns7ETD8zwNeXntp19i-AmTcAuEI_hJLi4fDi5bZIapcdfDs9nKe0H5lTbEoEqiYzcJbAK2SBTxWE88N9G-zzwOMEHlypMzwGuqlYUDtZamEY Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: e6798ac93019499bab61dad51528e010 Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1937084499 Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:50:08.365377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e6798ac93019499bab61dad51528e010", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e6798ac93019499bab61dad51528e010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e6798ac93019499bab61dad51528e010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e6798ac93019499bab61dad51528e010"}]}] Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1937084499 Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: e6798ac93019499bab61dad51528e010 Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1937084499 Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-VolumesSnapshotsTestJSON-1937084499-project Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: e5050442276b436ab9b42077de156f19 Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1937084499-project Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '27879f0a-78aa-45b4-88c7-1c8d89b5fa3f'} Sep 01 05:50:08.367200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. (HTTP 404) (Request-ID: req-0c35d27a-c0e3-4a53-81e4-8723f7b3342f) Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:08.368234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:50:08.369953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 05:50:08.371445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1bb702a7-e361-455c-8b2d-c11285af7a8f tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Returning 404 to user: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:50:08.373036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1bb702a7-e361-455c-8b2d-c11285af7a8f tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f" status: 404 len: 109 microversion: 2.1 time: 0.036066 Sep 01 05:50:08.374170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1307/2697] 10.222.0.49 () {58 vars in 1248 bytes} [Thu Sep 1 05:50:08 2022] DELETE /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:50:08.375218 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b314e3fc-4444-42fb-9456-5f984d61bee7 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Calling method '.version_select at 0x7f9628544790>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:08.405656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-b314e3fc-4444-42fb-9456-5f984d61bee7 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] HTTP exception thrown: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b314e3fc-4444-42fb-9456-5f984d61bee7 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Request method failure captured: Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f HTTP/1.1 Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjEEgIR68o5TkBQ7fdlWScLWFL7xUCz3XLloBrGyYfgEHU30i147E059dIeYTphCvOWu1ns7ETD8zwNeXntp19i-AmTcAuEI_hJLi4fDi5bZIapcdfDs9nKe0H5lTbEoEqiYzcJbAK2SBTxWE88N9G-zzwOMEHlypMzwGuqlYUDtZamEY Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: e6798ac93019499bab61dad51528e010 Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1937084499 Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:50:08.407620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e6798ac93019499bab61dad51528e010", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e6798ac93019499bab61dad51528e010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e6798ac93019499bab61dad51528e010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e6798ac93019499bab61dad51528e010"}]}] Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1937084499 Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: e6798ac93019499bab61dad51528e010 Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1937084499 Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-VolumesSnapshotsTestJSON-1937084499-project Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: e5050442276b436ab9b42077de156f19 Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1937084499-project Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '27879f0a-78aa-45b4-88c7-1c8d89b5fa3f'} Sep 01 05:50:08.409414 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. (HTTP 404) (Request-ID: req-a30dd3dd-d5de-496e-aa7f-11241014760b) Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:08.410477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:50:08.412056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:50:08.413824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b314e3fc-4444-42fb-9456-5f984d61bee7 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] Returning 404 to user: Volume 27879f0a-78aa-45b4-88c7-1c8d89b5fa3f could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b314e3fc-4444-42fb-9456-5f984d61bee7 tempest-VolumesSnapshotsTestJSON-1937084499 tempest-VolumesSnapshotsTestJSON-1937084499-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f" status: 404 len: 109 microversion: 2.1 time: 0.037534 Sep 01 05:50:08.416411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1391/2698] 10.222.0.49 () {58 vars in 1245 bytes} [Thu Sep 1 05:50:08 2022] GET /compute/v2.1/os-volumes/27879f0a-78aa-45b4-88c7-1c8d89b5fa3f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:50:08.996540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2e6dd02d-fe7f-451d-a61f-b62c9a5ac532 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:08.997331 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2e6dd02d-fe7f-451d-a61f-b62c9a5ac532 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:09.009861 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e6dd02d-fe7f-451d-a61f-b62c9a5ac532 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:09.010846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e6dd02d-fe7f-451d-a61f-b62c9a5ac532 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:09.011510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e6dd02d-fe7f-451d-a61f-b62c9a5ac532 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:09.012662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e6dd02d-fe7f-451d-a61f-b62c9a5ac532 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:09.013460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e6dd02d-fe7f-451d-a61f-b62c9a5ac532 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:09.014051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2e6dd02d-fe7f-451d-a61f-b62c9a5ac532 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:09.260666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2e6dd02d-fe7f-451d-a61f-b62c9a5ac532 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:09.269809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2e6dd02d-fe7f-451d-a61f-b62c9a5ac532 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1366 microversion: 2.1 time: 0.277636 Sep 01 05:50:09.271069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1308/2699] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:08 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:10.293123 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-eb47c6ad-3f26-4722-9c26-4651bcd4f490 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:10.293874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-eb47c6ad-3f26-4722-9c26-4651bcd4f490 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:10.301321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb47c6ad-3f26-4722-9c26-4651bcd4f490 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:10.301802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb47c6ad-3f26-4722-9c26-4651bcd4f490 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:10.302235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb47c6ad-3f26-4722-9c26-4651bcd4f490 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:10.303135 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb47c6ad-3f26-4722-9c26-4651bcd4f490 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:10.303587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb47c6ad-3f26-4722-9c26-4651bcd4f490 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:10.304011 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-eb47c6ad-3f26-4722-9c26-4651bcd4f490 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:10.448459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-eb47c6ad-3f26-4722-9c26-4651bcd4f490 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:10.463756 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-eb47c6ad-3f26-4722-9c26-4651bcd4f490 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1366 microversion: 2.1 time: 0.175390 Sep 01 05:50:10.464333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1392/2700] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:10 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:11.484620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c03fc39f-0fe3-4eeb-98ec-b22af7f5249d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:11.485255 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c03fc39f-0fe3-4eeb-98ec-b22af7f5249d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:11.491781 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c03fc39f-0fe3-4eeb-98ec-b22af7f5249d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:11.492245 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c03fc39f-0fe3-4eeb-98ec-b22af7f5249d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:11.492708 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c03fc39f-0fe3-4eeb-98ec-b22af7f5249d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:11.493430 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c03fc39f-0fe3-4eeb-98ec-b22af7f5249d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:11.493873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c03fc39f-0fe3-4eeb-98ec-b22af7f5249d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:11.494286 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c03fc39f-0fe3-4eeb-98ec-b22af7f5249d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:11.641434 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c03fc39f-0fe3-4eeb-98ec-b22af7f5249d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:11.651736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c03fc39f-0fe3-4eeb-98ec-b22af7f5249d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1366 microversion: 2.1 time: 0.171132 Sep 01 05:50:11.652509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1309/2701] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:11 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:50:11.859839 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-db4fe8ab-201a-414e-b8fc-1d2c638043e6 req-0d8595dd-f8fb-4ceb-9cdc-73b20e711e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3547e7-63de-4df8-87bf-60a4f05a9e28", "name": "network-vif-plugged", "status": "completed", "tag": "5f2c28fe-57d2-4a00-ae6d-311abb7517b8"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:11.871978 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-db4fe8ab-201a-414e-b8fc-1d2c638043e6 req-0d8595dd-f8fb-4ceb-9cdc-73b20e711e5a service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:11.872739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-db4fe8ab-201a-414e-b8fc-1d2c638043e6 req-0d8595dd-f8fb-4ceb-9cdc-73b20e711e5a service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:11.873385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-db4fe8ab-201a-414e-b8fc-1d2c638043e6 req-0d8595dd-f8fb-4ceb-9cdc-73b20e711e5a service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:11.886050 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-db4fe8ab-201a-414e-b8fc-1d2c638043e6 req-0d8595dd-f8fb-4ceb-9cdc-73b20e711e5a service nova] Creating event network-vif-plugged:5f2c28fe-57d2-4a00-ae6d-311abb7517b8 for instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 on hv-cinder-85391 Sep 01 05:50:11.899919 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-db4fe8ab-201a-414e-b8fc-1d2c638043e6 req-0d8595dd-f8fb-4ceb-9cdc-73b20e711e5a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043581 Sep 01 05:50:11.900916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1393/2702] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:12.672560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-01fcae7f-d7ae-498a-a5ad-a63a7f629dc6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:12.673194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-01fcae7f-d7ae-498a-a5ad-a63a7f629dc6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:12.680052 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01fcae7f-d7ae-498a-a5ad-a63a7f629dc6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:12.680523 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01fcae7f-d7ae-498a-a5ad-a63a7f629dc6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:12.680992 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01fcae7f-d7ae-498a-a5ad-a63a7f629dc6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:12.681671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01fcae7f-d7ae-498a-a5ad-a63a7f629dc6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:12.682121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01fcae7f-d7ae-498a-a5ad-a63a7f629dc6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:12.682571 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01fcae7f-d7ae-498a-a5ad-a63a7f629dc6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:12.818564 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-01fcae7f-d7ae-498a-a5ad-a63a7f629dc6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:12.827282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-01fcae7f-d7ae-498a-a5ad-a63a7f629dc6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1366 microversion: 2.1 time: 0.158509 Sep 01 05:50:12.827844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1310/2703] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:12 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:13.846333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=6 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:13.851762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f81fd278-a767-4a94-afec-7f23edb37f10 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:13.852608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f81fd278-a767-4a94-afec-7f23edb37f10 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:13.859235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f81fd278-a767-4a94-afec-7f23edb37f10 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:13.859733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f81fd278-a767-4a94-afec-7f23edb37f10 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:13.860171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f81fd278-a767-4a94-afec-7f23edb37f10 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:13.860890 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f81fd278-a767-4a94-afec-7f23edb37f10 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:13.861348 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f81fd278-a767-4a94-afec-7f23edb37f10 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:13.861775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f81fd278-a767-4a94-afec-7f23edb37f10 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:14.002984 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f81fd278-a767-4a94-afec-7f23edb37f10 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:14.011221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f81fd278-a767-4a94-afec-7f23edb37f10 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1556 microversion: 2.1 time: 0.166265 Sep 01 05:50:14.011792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1394/2704] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:13 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:14.031776 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a7cac645-96f3-403a-aa33-c776c3a0c3b4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:14.032368 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a7cac645-96f3-403a-aa33-c776c3a0c3b4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:14.035234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:14.035877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=6 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:14.041844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7cac645-96f3-403a-aa33-c776c3a0c3b4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:14.042293 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7cac645-96f3-403a-aa33-c776c3a0c3b4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:14.042763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7cac645-96f3-403a-aa33-c776c3a0c3b4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:14.043494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7cac645-96f3-403a-aa33-c776c3a0c3b4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:14.043946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7cac645-96f3-403a-aa33-c776c3a0c3b4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:14.044366 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7cac645-96f3-403a-aa33-c776c3a0c3b4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:14.126252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a7cac645-96f3-403a-aa33-c776c3a0c3b4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098534 Sep 01 05:50:14.126844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1311/2705] 10.222.0.49 () {58 vars in 1275 bytes} [Thu Sep 1 05:50:14 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:15.333120 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-de738ab5-2e3b-45c6-910f-17dfb723d6fb req-5527623c-7548-4ff8-bd8d-6967cc58685c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f3547e7-63de-4df8-87bf-60a4f05a9e28", "tag": "5f2c28fe-57d2-4a00-ae6d-311abb7517b8"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:15.343209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-de738ab5-2e3b-45c6-910f-17dfb723d6fb req-5527623c-7548-4ff8-bd8d-6967cc58685c service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:15.343682 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-de738ab5-2e3b-45c6-910f-17dfb723d6fb req-5527623c-7548-4ff8-bd8d-6967cc58685c service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:15.344108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-de738ab5-2e3b-45c6-910f-17dfb723d6fb req-5527623c-7548-4ff8-bd8d-6967cc58685c service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:15.355956 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-de738ab5-2e3b-45c6-910f-17dfb723d6fb req-5527623c-7548-4ff8-bd8d-6967cc58685c service nova] Creating event network-changed:5f2c28fe-57d2-4a00-ae6d-311abb7517b8 for instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 on hv-cinder-85391 Sep 01 05:50:15.360924 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-de738ab5-2e3b-45c6-910f-17dfb723d6fb req-5527623c-7548-4ff8-bd8d-6967cc58685c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031521 Sep 01 05:50:15.361510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1395/2706] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:50:51.257183 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:51.258045 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:51.262643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-da76eb13-397c-4b8f-a10d-f6eea880ff2b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:51.263140 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-da76eb13-397c-4b8f-a10d-f6eea880ff2b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:51.271498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-da76eb13-397c-4b8f-a10d-f6eea880ff2b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:51.272175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-da76eb13-397c-4b8f-a10d-f6eea880ff2b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:51.272718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-da76eb13-397c-4b8f-a10d-f6eea880ff2b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:51.273617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-da76eb13-397c-4b8f-a10d-f6eea880ff2b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:51.274175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-da76eb13-397c-4b8f-a10d-f6eea880ff2b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:51.274966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-da76eb13-397c-4b8f-a10d-f6eea880ff2b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:51.303562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-da76eb13-397c-4b8f-a10d-f6eea880ff2b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28/ips" status: 200 len: 149 microversion: 2.1 time: 0.047725 Sep 01 05:50:51.304440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1312/2707] 10.222.0.49 () {58 vars in 1248 bytes} [Thu Sep 1 05:50:51 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:51.314312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:51.315474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:51.320532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6b85bd8f-8bc2-4315-953e-b4e8a6e9ec5c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb1cf25c-f9ed-4408-a9f8-10d7dd03a7ae"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:51.323433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6b85bd8f-8bc2-4315-953e-b4e8a6e9ec5c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:51.332688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b85bd8f-8bc2-4315-953e-b4e8a6e9ec5c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:51.333354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b85bd8f-8bc2-4315-953e-b4e8a6e9ec5c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:51.333791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b85bd8f-8bc2-4315-953e-b4e8a6e9ec5c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:51.334594 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b85bd8f-8bc2-4315-953e-b4e8a6e9ec5c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:51.335053 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b85bd8f-8bc2-4315-953e-b4e8a6e9ec5c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:51.335477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6b85bd8f-8bc2-4315-953e-b4e8a6e9ec5c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:51.419760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-6b85bd8f-8bc2-4315-953e-b4e8a6e9ec5c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Invalid volume: volume eb1cf25c-f9ed-4408-a9f8-10d7dd03a7ae is already attached to instances: 58be5ab6-9a40-44cb-a30a-bbdea2a55083 Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6b85bd8f-8bc2-4315-953e-b4e8a6e9ec5c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: POST /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28/os-volume_attachments HTTP/1.1 Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 74 Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:50:51.421762 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:50:51.424262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:50:51.424262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:50:51.424262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:50:51.424262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:50:51.424262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:50:51.424262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:50:51.424262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:50:51.424262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:50:51.424262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:50:51.424262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Sep 01 05:50:51.424262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {"volumeAttachment": {"volumeId": "eb1cf25c-f9ed-4408-a9f8-10d7dd03a7ae"}} Sep 01 05:50:51.424262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Invalid volume: volume eb1cf25c-f9ed-4408-a9f8-10d7dd03a7ae is already attached to instances: 58be5ab6-9a40-44cb-a30a-bbdea2a55083 Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'server_id': '4f3547e7-63de-4df8-87bf-60a4f05a9e28', 'body': {'volumeAttachment': {'volumeId': 'eb1cf25c-f9ed-4408-a9f8-10d7dd03a7ae'}}} Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eb1cf25c-f9ed-4408-a9f8-10d7dd03a7ae is already attached to instances: 58be5ab6-9a40-44cb-a30a-bbdea2a55083 Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:51.425444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eb1cf25c-f9ed-4408-a9f8-10d7dd03a7ae is already attached to instances: 58be5ab6-9a40-44cb-a30a-bbdea2a55083 Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:51.427450 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:51.429399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:51.429399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:50:51.429399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:50:51.429399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eb1cf25c-f9ed-4408-a9f8-10d7dd03a7ae is already attached to instances: 58be5ab6-9a40-44cb-a30a-bbdea2a55083 Sep 01 05:50:51.429399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:51.429399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6b85bd8f-8bc2-4315-953e-b4e8a6e9ec5c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 400 to user: Invalid volume: volume eb1cf25c-f9ed-4408-a9f8-10d7dd03a7ae is already attached to instances: 58be5ab6-9a40-44cb-a30a-bbdea2a55083 {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:50:51.429399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6b85bd8f-8bc2-4315-953e-b4e8a6e9ec5c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110933 Sep 01 05:50:51.429399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1396/2708] 10.222.0.49 () {60 vars in 1323 bytes} [Thu Sep 1 05:50:51 2022] POST /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:50:51.433062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-bcc74291-25a8-4968-8150-fd33d338f79b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:51.433557 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bcc74291-25a8-4968-8150-fd33d338f79b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:51.439847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bcc74291-25a8-4968-8150-fd33d338f79b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:51.440350 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bcc74291-25a8-4968-8150-fd33d338f79b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:51.440858 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bcc74291-25a8-4968-8150-fd33d338f79b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:51.441537 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bcc74291-25a8-4968-8150-fd33d338f79b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:51.441983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bcc74291-25a8-4968-8150-fd33d338f79b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:51.442451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-bcc74291-25a8-4968-8150-fd33d338f79b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:51.468028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-bcc74291-25a8-4968-8150-fd33d338f79b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Going to try to terminate instance {{(pid=120674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:50:51.545913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-bcc74291-25a8-4968-8150-fd33d338f79b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 204 len: 0 microversion: 2.1 time: 0.117373 Sep 01 05:50:51.546558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1313/2709] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:50:51 2022] DELETE /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:50:51.555182 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7f654a03-57dd-4856-a9e7-1203552a6b3d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:51.555824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7f654a03-57dd-4856-a9e7-1203552a6b3d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:51.562641 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f654a03-57dd-4856-a9e7-1203552a6b3d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:51.563146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f654a03-57dd-4856-a9e7-1203552a6b3d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:51.563583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f654a03-57dd-4856-a9e7-1203552a6b3d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:51.564312 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f654a03-57dd-4856-a9e7-1203552a6b3d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:51.564760 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f654a03-57dd-4856-a9e7-1203552a6b3d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:51.565255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f654a03-57dd-4856-a9e7-1203552a6b3d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:51.699888 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7f654a03-57dd-4856-a9e7-1203552a6b3d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:51.707485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7f654a03-57dd-4856-a9e7-1203552a6b3d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1680 microversion: 2.1 time: 0.156116 Sep 01 05:50:51.708035 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1397/2710] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:51 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:52.729641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-da0e58ee-7e37-4342-a59c-78a2893b0060 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:52.730445 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-da0e58ee-7e37-4342-a59c-78a2893b0060 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:52.737194 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-da0e58ee-7e37-4342-a59c-78a2893b0060 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:52.737678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-da0e58ee-7e37-4342-a59c-78a2893b0060 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:52.738105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-da0e58ee-7e37-4342-a59c-78a2893b0060 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:52.738785 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-da0e58ee-7e37-4342-a59c-78a2893b0060 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:52.739313 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-da0e58ee-7e37-4342-a59c-78a2893b0060 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:52.739735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-da0e58ee-7e37-4342-a59c-78a2893b0060 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:52.878394 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-da0e58ee-7e37-4342-a59c-78a2893b0060 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:52.887244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-da0e58ee-7e37-4342-a59c-78a2893b0060 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1680 microversion: 2.1 time: 0.162416 Sep 01 05:50:52.888033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1314/2711] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:52 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:53.763255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-2aac1b4a-f5fd-4220-a429-7881b7c6bda7 req-9a9a4830-7d06-4ef4-883d-3b9aa8f98f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3547e7-63de-4df8-87bf-60a4f05a9e28", "name": "network-vif-deleted", "tag": "5f2c28fe-57d2-4a00-ae6d-311abb7517b8"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:53.776202 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-2aac1b4a-f5fd-4220-a429-7881b7c6bda7 req-9a9a4830-7d06-4ef4-883d-3b9aa8f98f07 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:53.776959 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-2aac1b4a-f5fd-4220-a429-7881b7c6bda7 req-9a9a4830-7d06-4ef4-883d-3b9aa8f98f07 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:53.777398 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-2aac1b4a-f5fd-4220-a429-7881b7c6bda7 req-9a9a4830-7d06-4ef4-883d-3b9aa8f98f07 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:53.792102 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-2aac1b4a-f5fd-4220-a429-7881b7c6bda7 req-9a9a4830-7d06-4ef4-883d-3b9aa8f98f07 service nova] Creating event network-vif-deleted:5f2c28fe-57d2-4a00-ae6d-311abb7517b8 for instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 on hv-cinder-85391 Sep 01 05:50:53.802447 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-2aac1b4a-f5fd-4220-a429-7881b7c6bda7 req-9a9a4830-7d06-4ef4-883d-3b9aa8f98f07 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043673 Sep 01 05:50:53.803108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1398/2712] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:53.910489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:53.911106 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:53.918631 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:53.919683 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:53.920378 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:53.921282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:53.921930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:53.922527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:53.967540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:53.968377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:53.968802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:53.969262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lazy-loading 'fault' on Instance uuid 4f3547e7-63de-4df8-87bf-60a4f05a9e28 {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:50:54.020177 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:54.029200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c9a81209-19c8-4dbe-9c40-5a7c3c30f4d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 200 len: 1331 microversion: 2.1 time: 0.122445 Sep 01 05:50:54.029768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1315/2713] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:53 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:55.052189 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8acd7706-cb57-4166-955f-80daf592cd20 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:55.052922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8acd7706-cb57-4166-955f-80daf592cd20 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:55.059426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8acd7706-cb57-4166-955f-80daf592cd20 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:55.059906 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8acd7706-cb57-4166-955f-80daf592cd20 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:55.060349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8acd7706-cb57-4166-955f-80daf592cd20 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:55.061056 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8acd7706-cb57-4166-955f-80daf592cd20 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:55.061510 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8acd7706-cb57-4166-955f-80daf592cd20 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:55.061933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8acd7706-cb57-4166-955f-80daf592cd20 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:55.076577 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-8acd7706-cb57-4166-955f-80daf592cd20 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8acd7706-cb57-4166-955f-80daf592cd20 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 HTTP/1.1 Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:50:55.078286 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:50:55.080106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:50:55.080106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:50:55.080106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:50:55.080106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:50:55.080106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:50:55.080106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:50:55.080106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:50:55.080106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:50:55.080106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:50:55.080106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:50:55.080106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:50:55.080106 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '4f3547e7-63de-4df8-87bf-60a4f05a9e28'} Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:50:55.081382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:50:55.083115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:50:55.084830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8acd7706-cb57-4166-955f-80daf592cd20 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 404 to user: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:50:55.084830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8acd7706-cb57-4166-955f-80daf592cd20 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 404 len: 111 microversion: 2.1 time: 0.032331 Sep 01 05:50:55.084830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1399/2714] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:55 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:50:55.089245 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f959b92b-ae96-49ef-83c6-92ef66977d57 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '.version_select at 0x7f9624b76b80>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:55.111901 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f959b92b-ae96-49ef-83c6-92ef66977d57 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405084333" status: 202 len: 0 microversion: 2.1 time: 0.027128 Sep 01 05:50:55.112454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1316/2715] 10.222.0.49 () {58 vars in 1221 bytes} [Thu Sep 1 05:50:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405084333 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:50:55.778130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6dd59e09-eba5-4653-b446-ed0bede6c4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:55.778544 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6dd59e09-eba5-4653-b446-ed0bede6c4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:55.784689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6dd59e09-eba5-4653-b446-ed0bede6c4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:55.785407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6dd59e09-eba5-4653-b446-ed0bede6c4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:55.785861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6dd59e09-eba5-4653-b446-ed0bede6c4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:55.786535 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6dd59e09-eba5-4653-b446-ed0bede6c4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:55.786977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6dd59e09-eba5-4653-b446-ed0bede6c4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:55.787585 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6dd59e09-eba5-4653-b446-ed0bede6c4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:55.868814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-6dd59e09-eba5-4653-b446-ed0bede6c4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lazy-loading 'services' on Instance uuid 58be5ab6-9a40-44cb-a30a-bbdea2a55083 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:50:55.940205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6dd59e09-eba5-4653-b446-ed0bede6c4d4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-volume_attachments/eb1cf25c-f9ed-4408-a9f8-10d7dd03a7ae" status: 202 len: 0 microversion: 2.1 time: 0.166213 Sep 01 05:50:55.941215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1400/2716] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 05:50:55 2022] DELETE /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-volume_attachments/eb1cf25c-f9ed-4408-a9f8-10d7dd03a7ae => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:50:55.950424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a51a1217-a6cc-4aeb-bcae-6301d7d6c413 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:55.952662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a51a1217-a6cc-4aeb-bcae-6301d7d6c413 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:55.959261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a51a1217-a6cc-4aeb-bcae-6301d7d6c413 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:55.959737 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a51a1217-a6cc-4aeb-bcae-6301d7d6c413 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:55.960192 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a51a1217-a6cc-4aeb-bcae-6301d7d6c413 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:55.961005 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a51a1217-a6cc-4aeb-bcae-6301d7d6c413 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:55.961467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a51a1217-a6cc-4aeb-bcae-6301d7d6c413 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:55.961892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a51a1217-a6cc-4aeb-bcae-6301d7d6c413 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:55.992310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a51a1217-a6cc-4aeb-bcae-6301d7d6c413 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046725 Sep 01 05:50:55.993617 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1317/2717] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:50:55 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:57.006296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a5b7503d-8d84-416c-9a81-a38e7e2fae09 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:57.008687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a5b7503d-8d84-416c-9a81-a38e7e2fae09 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:57.015446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5b7503d-8d84-416c-9a81-a38e7e2fae09 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:57.015917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5b7503d-8d84-416c-9a81-a38e7e2fae09 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:57.016344 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5b7503d-8d84-416c-9a81-a38e7e2fae09 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:57.017112 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5b7503d-8d84-416c-9a81-a38e7e2fae09 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:57.017558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5b7503d-8d84-416c-9a81-a38e7e2fae09 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:57.017972 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5b7503d-8d84-416c-9a81-a38e7e2fae09 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:57.047309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a5b7503d-8d84-416c-9a81-a38e7e2fae09 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045322 Sep 01 05:50:57.047848 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1401/2718] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:50:57 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:50:57.107561 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7df941b9-9f33-48b4-94a0-12885b7865c6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:57.108057 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7df941b9-9f33-48b4-94a0-12885b7865c6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:57.114266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7df941b9-9f33-48b4-94a0-12885b7865c6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:57.114739 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7df941b9-9f33-48b4-94a0-12885b7865c6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:57.115170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7df941b9-9f33-48b4-94a0-12885b7865c6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:57.115840 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7df941b9-9f33-48b4-94a0-12885b7865c6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:57.116282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7df941b9-9f33-48b4-94a0-12885b7865c6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:57.116693 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7df941b9-9f33-48b4-94a0-12885b7865c6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:57.141487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7df941b9-9f33-48b4-94a0-12885b7865c6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Going to try to terminate instance {{(pid=120674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:50:57.215914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7df941b9-9f33-48b4-94a0-12885b7865c6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 204 len: 0 microversion: 2.1 time: 0.112535 Sep 01 05:50:57.216489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1318/2719] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:50:57 2022] DELETE /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:50:57.225148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bdd877aa-0b8e-446a-9d91-9903c26ea110 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:57.225757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bdd877aa-0b8e-446a-9d91-9903c26ea110 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:57.231926 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdd877aa-0b8e-446a-9d91-9903c26ea110 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:57.232516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdd877aa-0b8e-446a-9d91-9903c26ea110 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:57.232994 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdd877aa-0b8e-446a-9d91-9903c26ea110 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:57.233683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdd877aa-0b8e-446a-9d91-9903c26ea110 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:57.234137 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdd877aa-0b8e-446a-9d91-9903c26ea110 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:57.234562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bdd877aa-0b8e-446a-9d91-9903c26ea110 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:57.362397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bdd877aa-0b8e-446a-9d91-9903c26ea110 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:57.370389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bdd877aa-0b8e-446a-9d91-9903c26ea110 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 200 len: 1682 microversion: 2.1 time: 0.149549 Sep 01 05:50:57.370957 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1402/2720] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:57 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:58.392008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-564f5e9d-c866-4e52-927c-10dc345408a6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:58.392757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-564f5e9d-c866-4e52-927c-10dc345408a6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:58.399085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-564f5e9d-c866-4e52-927c-10dc345408a6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:58.399560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-564f5e9d-c866-4e52-927c-10dc345408a6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:58.400505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-564f5e9d-c866-4e52-927c-10dc345408a6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:58.401235 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-564f5e9d-c866-4e52-927c-10dc345408a6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:58.401939 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-564f5e9d-c866-4e52-927c-10dc345408a6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:58.402352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-564f5e9d-c866-4e52-927c-10dc345408a6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:58.620151 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-564f5e9d-c866-4e52-927c-10dc345408a6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:58.627987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-564f5e9d-c866-4e52-927c-10dc345408a6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 200 len: 1682 microversion: 2.1 time: 0.240220 Sep 01 05:50:58.628613 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1319/2721] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:58 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 1682 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:58.964618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-69dbdea3-fde0-45a4-b003-751d4996a35e req-4b0293c4-74b7-425d-90ae-a1791fde1071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58be5ab6-9a40-44cb-a30a-bbdea2a55083", "name": "network-vif-deleted", "tag": "1579edf6-11e1-424c-aec8-43c8085da5cb"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:58.987004 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-69dbdea3-fde0-45a4-b003-751d4996a35e req-4b0293c4-74b7-425d-90ae-a1791fde1071 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:58.987499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-69dbdea3-fde0-45a4-b003-751d4996a35e req-4b0293c4-74b7-425d-90ae-a1791fde1071 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:58.987932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-69dbdea3-fde0-45a4-b003-751d4996a35e req-4b0293c4-74b7-425d-90ae-a1791fde1071 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:59.020572 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-69dbdea3-fde0-45a4-b003-751d4996a35e req-4b0293c4-74b7-425d-90ae-a1791fde1071 service nova] Creating event network-vif-deleted:1579edf6-11e1-424c-aec8-43c8085da5cb for instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 on hv-cinder-85391 Sep 01 05:50:59.030622 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-69dbdea3-fde0-45a4-b003-751d4996a35e req-4b0293c4-74b7-425d-90ae-a1791fde1071 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076997 Sep 01 05:50:59.031847 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1403/2722] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:59.649786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-aea2c443-c95c-4ecf-9edd-06798aea1c0c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:59.650800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-aea2c443-c95c-4ecf-9edd-06798aea1c0c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:59.657494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aea2c443-c95c-4ecf-9edd-06798aea1c0c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:59.657971 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aea2c443-c95c-4ecf-9edd-06798aea1c0c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:59.658398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aea2c443-c95c-4ecf-9edd-06798aea1c0c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:59.659073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aea2c443-c95c-4ecf-9edd-06798aea1c0c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:59.659516 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aea2c443-c95c-4ecf-9edd-06798aea1c0c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:59.659930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aea2c443-c95c-4ecf-9edd-06798aea1c0c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:59.676371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-aea2c443-c95c-4ecf-9edd-06798aea1c0c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-aea2c443-c95c-4ecf-9edd-06798aea1c0c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 HTTP/1.1 Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:50:59.678037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:50:59.679921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:50:59.679921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:50:59.679921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:50:59.679921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:50:59.679921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:50:59.679921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:50:59.679921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:50:59.679921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:50:59.679921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:50:59.679921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:50:59.679921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:50:59.679921 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '58be5ab6-9a40-44cb-a30a-bbdea2a55083'} Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:50:59.681031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:50:59.683875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:50:59.686061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-aea2c443-c95c-4ecf-9edd-06798aea1c0c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 404 to user: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:50:59.686061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-aea2c443-c95c-4ecf-9edd-06798aea1c0c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 404 len: 111 microversion: 2.1 time: 0.033552 Sep 01 05:50:59.686061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1320/2723] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:59 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:50:59.689738 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5c996c21-9aec-4138-ab5f-0fbd7c1fa1df tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '.version_select at 0x7f9624dafe50>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:59.709445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5c996c21-9aec-4138-ab5f-0fbd7c1fa1df tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119308910" status: 202 len: 0 microversion: 2.1 time: 0.023602 Sep 01 05:50:59.709918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1404/2724] 10.222.0.49 () {58 vars in 1221 bytes} [Thu Sep 1 05:50:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119308910 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:51:00.345255 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-abd4dafa-db9a-423b-98ed-5b0a8000e8e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: .version_select at 0x7f9624cb84c0>, body: {"keypair": {"name": "tempest-keypair-1741022889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjia5VXd+mW9UuHXA7z0uvGx12Gb1TxAJwPNqw8HVbVmPxBv/bxFapzv21e7jjwlJslBP0y9EVHpIaqXF+X1x9WyPKbYo+wIhM+gvVPOjOoy3t1IKXHkU8j0PAnJDjsXw=="}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:00.360356 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-abd4dafa-db9a-423b-98ed-5b0a8000e8e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for project 206f93c129394a4badf489d8c7c45b16. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:51:00.364127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-abd4dafa-db9a-423b-98ed-5b0a8000e8e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for user 2e8c9e2056464b9299ff765507323869 and project 206f93c129394a4badf489d8c7c45b16. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:51:00.386730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-abd4dafa-db9a-423b-98ed-5b0a8000e8e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045480 Sep 01 05:51:00.387511 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1321/2725] 10.222.0.49 () {60 vars in 1159 bytes} [Thu Sep 1 05:51:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:01.662206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1642107150", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bf7b767-c598-4723-849f-bfb972eb4c62"}], "security_groups": [{"name": "tempest-securitygroup--1102328940"}], "key_name": "tempest-keypair-1741022889", "user_data": "}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:01.765424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.network.neutron [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] validate_networks() for [('3bf7b767-c598-4723-849f-bfb972eb4c62', None, None, None, None, None)] {{(pid=120673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:51:02.201080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Flavor limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:51:02.201706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Image limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:51:02.202258 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Flavor pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:51:02.202915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Image pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:51:02.203329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:51:02.212792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:02.213284 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:02.213718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:02.214443 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:02.214895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:02.215321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:02.232475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for project 206f93c129394a4badf489d8c7c45b16. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:51:02.236536 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for user 2e8c9e2056464b9299ff765507323869 and project 206f93c129394a4badf489d8c7c45b16. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:51:02.247845 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Going to run 1 instances... {{(pid=120673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:51:02.250282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:51:02.298903 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8b9798b4-40d6-4256-8324-4149364ae06f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.641616 Sep 01 05:51:02.299547 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1405/2726] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:51:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:51:02.311204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8d35f9c3-0552-44e9-aeb8-aff0e4b09a98 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:02.311818 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8d35f9c3-0552-44e9-aeb8-aff0e4b09a98 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:02.364238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-8d35f9c3-0552-44e9-aeb8-aff0e4b09a98 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:02.371950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8d35f9c3-0552-44e9-aeb8-aff0e4b09a98 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1242 microversion: 2.1 time: 0.065477 Sep 01 05:51:02.372494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1322/2727] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:02 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:03.393827 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9d8a90c9-6b38-47ea-a679-41f80300f16d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:03.394441 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9d8a90c9-6b38-47ea-a679-41f80300f16d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:03.449203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9d8a90c9-6b38-47ea-a679-41f80300f16d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:03.455971 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9d8a90c9-6b38-47ea-a679-41f80300f16d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1242 microversion: 2.1 time: 0.066618 Sep 01 05:51:03.456529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1406/2728] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:03 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:04.476938 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f02bc482-1f78-4ae0-bb75-506997c2e317 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:04.477632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f02bc482-1f78-4ae0-bb75-506997c2e317 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:04.533347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f02bc482-1f78-4ae0-bb75-506997c2e317 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:04.541091 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f02bc482-1f78-4ae0-bb75-506997c2e317 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1242 microversion: 2.1 time: 0.067343 Sep 01 05:51:04.542086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1323/2729] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:04 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:05.563082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-02834b73-a9d3-4907-aebb-a886847972c5 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:05.564150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-02834b73-a9d3-4907-aebb-a886847972c5 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:05.618591 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-02834b73-a9d3-4907-aebb-a886847972c5 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:05.626448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-02834b73-a9d3-4907-aebb-a886847972c5 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1242 microversion: 2.1 time: 0.067286 Sep 01 05:51:05.627201 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1407/2730] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:05 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:06.647412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-70bd944a-1892-4124-8597-6560291fdf9e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:06.647957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-70bd944a-1892-4124-8597-6560291fdf9e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:06.655999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70bd944a-1892-4124-8597-6560291fdf9e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:06.656479 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70bd944a-1892-4124-8597-6560291fdf9e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:06.656953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70bd944a-1892-4124-8597-6560291fdf9e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:06.657632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70bd944a-1892-4124-8597-6560291fdf9e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:06.658103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70bd944a-1892-4124-8597-6560291fdf9e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:06.658527 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-70bd944a-1892-4124-8597-6560291fdf9e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:06.718190 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-70bd944a-1892-4124-8597-6560291fdf9e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:06.725819 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-70bd944a-1892-4124-8597-6560291fdf9e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1246 microversion: 2.1 time: 0.082285 Sep 01 05:51:06.726380 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1324/2731] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:06 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:07.748161 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f84e3c6e-22fe-4950-a834-b0decd15934c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:07.748755 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f84e3c6e-22fe-4950-a834-b0decd15934c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:07.756139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f84e3c6e-22fe-4950-a834-b0decd15934c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:07.756627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f84e3c6e-22fe-4950-a834-b0decd15934c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:07.757108 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f84e3c6e-22fe-4950-a834-b0decd15934c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:07.757801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f84e3c6e-22fe-4950-a834-b0decd15934c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:07.758251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f84e3c6e-22fe-4950-a834-b0decd15934c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:07.758790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f84e3c6e-22fe-4950-a834-b0decd15934c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:07.823407 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f84e3c6e-22fe-4950-a834-b0decd15934c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:07.831042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f84e3c6e-22fe-4950-a834-b0decd15934c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1300 microversion: 2.1 time: 0.086874 Sep 01 05:51:07.831609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1408/2732] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:07 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:08.648509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-db61bcc2-73ea-4f60-bc8a-1f7b078f904e req-5e915c0d-0f4f-4e3f-a543-dfcd59b1ca0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8c72a0-5954-458b-a788-dffd785ca110", "tag": "8a6044c8-6cf4-417a-97a9-e7bc7ae6e8a4"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:08.660107 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-db61bcc2-73ea-4f60-bc8a-1f7b078f904e req-5e915c0d-0f4f-4e3f-a543-dfcd59b1ca0c service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:08.660671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-db61bcc2-73ea-4f60-bc8a-1f7b078f904e req-5e915c0d-0f4f-4e3f-a543-dfcd59b1ca0c service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:08.661404 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-db61bcc2-73ea-4f60-bc8a-1f7b078f904e req-5e915c0d-0f4f-4e3f-a543-dfcd59b1ca0c service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:08.673221 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-db61bcc2-73ea-4f60-bc8a-1f7b078f904e req-5e915c0d-0f4f-4e3f-a543-dfcd59b1ca0c service nova] Creating event network-changed:8a6044c8-6cf4-417a-97a9-e7bc7ae6e8a4 for instance 3b8c72a0-5954-458b-a788-dffd785ca110 on hv-cinder-85391 Sep 01 05:51:08.678428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-db61bcc2-73ea-4f60-bc8a-1f7b078f904e req-5e915c0d-0f4f-4e3f-a543-dfcd59b1ca0c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034082 Sep 01 05:51:08.679024 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1325/2733] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:08.851562 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-209db623-8e3f-44dd-9e80-7e84946da006 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:08.852335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-209db623-8e3f-44dd-9e80-7e84946da006 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:08.859586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-209db623-8e3f-44dd-9e80-7e84946da006 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:08.860070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-209db623-8e3f-44dd-9e80-7e84946da006 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:08.860531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-209db623-8e3f-44dd-9e80-7e84946da006 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:08.861243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-209db623-8e3f-44dd-9e80-7e84946da006 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:08.861699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-209db623-8e3f-44dd-9e80-7e84946da006 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:08.862121 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-209db623-8e3f-44dd-9e80-7e84946da006 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:08.996367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-209db623-8e3f-44dd-9e80-7e84946da006 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:09.004471 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-209db623-8e3f-44dd-9e80-7e84946da006 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1368 microversion: 2.1 time: 0.156846 Sep 01 05:51:09.005185 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1409/2734] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:08 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:10.026248 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-726f0e60-5bac-4980-8b1c-4841843ce5e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:10.026942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-726f0e60-5bac-4980-8b1c-4841843ce5e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:10.033046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-726f0e60-5bac-4980-8b1c-4841843ce5e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:10.033524 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-726f0e60-5bac-4980-8b1c-4841843ce5e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:10.033954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-726f0e60-5bac-4980-8b1c-4841843ce5e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:10.034629 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-726f0e60-5bac-4980-8b1c-4841843ce5e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:10.035080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-726f0e60-5bac-4980-8b1c-4841843ce5e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:10.035488 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-726f0e60-5bac-4980-8b1c-4841843ce5e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:10.247486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-726f0e60-5bac-4980-8b1c-4841843ce5e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:10.255092 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-726f0e60-5bac-4980-8b1c-4841843ce5e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1368 microversion: 2.1 time: 0.233788 Sep 01 05:51:10.255664 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1326/2735] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:10 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:11.275658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-ca7d71e8-6c0f-4cfc-9d9b-3e776cd60e04 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:11.276449 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-ca7d71e8-6c0f-4cfc-9d9b-3e776cd60e04 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:11.282780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ca7d71e8-6c0f-4cfc-9d9b-3e776cd60e04 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:11.283252 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ca7d71e8-6c0f-4cfc-9d9b-3e776cd60e04 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:11.283685 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ca7d71e8-6c0f-4cfc-9d9b-3e776cd60e04 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:11.284353 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ca7d71e8-6c0f-4cfc-9d9b-3e776cd60e04 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:11.284814 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ca7d71e8-6c0f-4cfc-9d9b-3e776cd60e04 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:11.285230 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-ca7d71e8-6c0f-4cfc-9d9b-3e776cd60e04 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:11.412987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-ca7d71e8-6c0f-4cfc-9d9b-3e776cd60e04 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:11.421895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-ca7d71e8-6c0f-4cfc-9d9b-3e776cd60e04 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1368 microversion: 2.1 time: 0.150191 Sep 01 05:51:11.422821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1410/2736] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:11 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:12.443472 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-843d17c2-9fb9-4ada-83e2-59c7c3269580 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:12.444081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-843d17c2-9fb9-4ada-83e2-59c7c3269580 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:12.450944 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-843d17c2-9fb9-4ada-83e2-59c7c3269580 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:12.451429 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-843d17c2-9fb9-4ada-83e2-59c7c3269580 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:12.451859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-843d17c2-9fb9-4ada-83e2-59c7c3269580 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:12.452567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-843d17c2-9fb9-4ada-83e2-59c7c3269580 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:12.453041 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-843d17c2-9fb9-4ada-83e2-59c7c3269580 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:12.453460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-843d17c2-9fb9-4ada-83e2-59c7c3269580 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:12.584681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-843d17c2-9fb9-4ada-83e2-59c7c3269580 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:12.593133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-843d17c2-9fb9-4ada-83e2-59c7c3269580 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1368 microversion: 2.1 time: 0.153553 Sep 01 05:51:12.593704 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1327/2737] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:12 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:13.615296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b7ba719d-986f-4aef-a030-76441c0fee56 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:13.615894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b7ba719d-986f-4aef-a030-76441c0fee56 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:13.617866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:13.624580 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b7ba719d-986f-4aef-a030-76441c0fee56 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:13.625163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b7ba719d-986f-4aef-a030-76441c0fee56 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:13.625598 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b7ba719d-986f-4aef-a030-76441c0fee56 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:13.626277 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b7ba719d-986f-4aef-a030-76441c0fee56 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:13.626730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b7ba719d-986f-4aef-a030-76441c0fee56 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:13.627148 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b7ba719d-986f-4aef-a030-76441c0fee56 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:13.757336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b7ba719d-986f-4aef-a030-76441c0fee56 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:13.765164 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b7ba719d-986f-4aef-a030-76441c0fee56 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1368 microversion: 2.1 time: 0.153708 Sep 01 05:51:13.765717 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1411/2738] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:13 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:14.179843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-b1d8568b-925f-4c4c-b2bf-63d65445601a req-1048e970-e1dc-4ef4-b4c4-de92bcb66b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8c72a0-5954-458b-a788-dffd785ca110", "name": "network-vif-plugged", "status": "completed", "tag": "8a6044c8-6cf4-417a-97a9-e7bc7ae6e8a4"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:14.190136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-b1d8568b-925f-4c4c-b2bf-63d65445601a req-1048e970-e1dc-4ef4-b4c4-de92bcb66b73 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:14.190645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-b1d8568b-925f-4c4c-b2bf-63d65445601a req-1048e970-e1dc-4ef4-b4c4-de92bcb66b73 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:14.191060 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-b1d8568b-925f-4c4c-b2bf-63d65445601a req-1048e970-e1dc-4ef4-b4c4-de92bcb66b73 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:14.202352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-b1d8568b-925f-4c4c-b2bf-63d65445601a req-1048e970-e1dc-4ef4-b4c4-de92bcb66b73 service nova] Creating event network-vif-plugged:8a6044c8-6cf4-417a-97a9-e7bc7ae6e8a4 for instance 3b8c72a0-5954-458b-a788-dffd785ca110 on hv-cinder-85391 Sep 01 05:51:14.207217 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-b1d8568b-925f-4c4c-b2bf-63d65445601a req-1048e970-e1dc-4ef4-b4c4-de92bcb66b73 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031054 Sep 01 05:51:14.207802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1328/2739] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:51:14.786429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8beef055-29ca-472b-b4bd-2679a4fcf7e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:14.786974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8beef055-29ca-472b-b4bd-2679a4fcf7e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:14.793710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8beef055-29ca-472b-b4bd-2679a4fcf7e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:14.794188 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8beef055-29ca-472b-b4bd-2679a4fcf7e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:14.794649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8beef055-29ca-472b-b4bd-2679a4fcf7e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:14.795332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8beef055-29ca-472b-b4bd-2679a4fcf7e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:14.795780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8beef055-29ca-472b-b4bd-2679a4fcf7e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:14.796193 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8beef055-29ca-472b-b4bd-2679a4fcf7e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:14.926316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8beef055-29ca-472b-b4bd-2679a4fcf7e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:14.934575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8beef055-29ca-472b-b4bd-2679a4fcf7e0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1368 microversion: 2.1 time: 0.152111 Sep 01 05:51:14.935139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1412/2740] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:14 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:15.952710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=8 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:15.957565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-aac607b5-3801-46bb-a3cc-b0966d4dd1d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:15.958268 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-aac607b5-3801-46bb-a3cc-b0966d4dd1d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:15.965347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aac607b5-3801-46bb-a3cc-b0966d4dd1d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:15.965832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aac607b5-3801-46bb-a3cc-b0966d4dd1d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:15.966267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aac607b5-3801-46bb-a3cc-b0966d4dd1d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:15.966949 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aac607b5-3801-46bb-a3cc-b0966d4dd1d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:15.967400 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aac607b5-3801-46bb-a3cc-b0966d4dd1d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:15.967825 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-aac607b5-3801-46bb-a3cc-b0966d4dd1d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:16.099008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-aac607b5-3801-46bb-a3cc-b0966d4dd1d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:16.107136 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-aac607b5-3801-46bb-a3cc-b0966d4dd1d7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1559 microversion: 2.1 time: 0.155449 Sep 01 05:51:16.107702 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1329/2741] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:15 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:16.127920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a4a5593c-3fbe-4c01-8098-ba9f07982fda tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:16.128481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a4a5593c-3fbe-4c01-8098-ba9f07982fda tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:16.130262 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=10 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:16.136368 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4a5593c-3fbe-4c01-8098-ba9f07982fda tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:16.136866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4a5593c-3fbe-4c01-8098-ba9f07982fda tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:16.137298 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4a5593c-3fbe-4c01-8098-ba9f07982fda tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:16.137966 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4a5593c-3fbe-4c01-8098-ba9f07982fda tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:16.138409 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4a5593c-3fbe-4c01-8098-ba9f07982fda tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:16.138823 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a4a5593c-3fbe-4c01-8098-ba9f07982fda tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:16.214537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a4a5593c-3fbe-4c01-8098-ba9f07982fda tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090384 Sep 01 05:51:16.215133 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1413/2742] 10.222.0.49 () {58 vars in 1275 bytes} [Thu Sep 1 05:51:16 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:17.388942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-6f461dbf-696e-4604-8c74-83d899afb1cc req-5b8fc4a9-cd8b-4be3-be6c-f7603fb503fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8c72a0-5954-458b-a788-dffd785ca110", "tag": "8a6044c8-6cf4-417a-97a9-e7bc7ae6e8a4"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:17.398809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-6f461dbf-696e-4604-8c74-83d899afb1cc req-5b8fc4a9-cd8b-4be3-be6c-f7603fb503fe service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:17.400112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-6f461dbf-696e-4604-8c74-83d899afb1cc req-5b8fc4a9-cd8b-4be3-be6c-f7603fb503fe service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:17.400630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-6f461dbf-696e-4604-8c74-83d899afb1cc req-5b8fc4a9-cd8b-4be3-be6c-f7603fb503fe service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:17.413846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-6f461dbf-696e-4604-8c74-83d899afb1cc req-5b8fc4a9-cd8b-4be3-be6c-f7603fb503fe service nova] Creating event network-changed:8a6044c8-6cf4-417a-97a9-e7bc7ae6e8a4 for instance 3b8c72a0-5954-458b-a788-dffd785ca110 on hv-cinder-85391 Sep 01 05:51:17.419093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-6f461dbf-696e-4604-8c74-83d899afb1cc req-5b8fc4a9-cd8b-4be3-be6c-f7603fb503fe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036850 Sep 01 05:51:17.419767 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1330/2743] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:46.925722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:46.926521 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:46.932098 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8bb71e24-6faf-4cbc-9707-e0a24e08bbcd tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:46.932586 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8bb71e24-6faf-4cbc-9707-e0a24e08bbcd tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:46.940340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8bb71e24-6faf-4cbc-9707-e0a24e08bbcd tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:46.940859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8bb71e24-6faf-4cbc-9707-e0a24e08bbcd tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:46.941295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8bb71e24-6faf-4cbc-9707-e0a24e08bbcd tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:46.941974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8bb71e24-6faf-4cbc-9707-e0a24e08bbcd tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:46.942424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8bb71e24-6faf-4cbc-9707-e0a24e08bbcd tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:46.942873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8bb71e24-6faf-4cbc-9707-e0a24e08bbcd tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:46.968465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8bb71e24-6faf-4cbc-9707-e0a24e08bbcd tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/ips" status: 200 len: 151 microversion: 2.1 time: 0.044096 Sep 01 05:51:46.969075 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1414/2744] 10.222.0.49 () {58 vars in 1248 bytes} [Thu Sep 1 05:51:46 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:48.293589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:48.294452 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:48.299700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c9bb3dea-192c-4938-8abf-8e915cb452fc tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edc7077d-010a-41ef-aa26-37978f3e5d8c"}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:48.302191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c9bb3dea-192c-4938-8abf-8e915cb452fc tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:48.310963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9bb3dea-192c-4938-8abf-8e915cb452fc tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:48.311486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9bb3dea-192c-4938-8abf-8e915cb452fc tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:48.311963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9bb3dea-192c-4938-8abf-8e915cb452fc tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:48.312649 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9bb3dea-192c-4938-8abf-8e915cb452fc tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:48.313129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9bb3dea-192c-4938-8abf-8e915cb452fc tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:48.313554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9bb3dea-192c-4938-8abf-8e915cb452fc tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:48.559348 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c9bb3dea-192c-4938-8abf-8e915cb452fc tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267093 Sep 01 05:51:48.559980 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1331/2745] 10.222.0.49 () {60 vars in 1323 bytes} [Thu Sep 1 05:51:48 2022] POST /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:49.566808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9d0c141f-75f7-4d5f-b27f-425ca91ff683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:49.567318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9d0c141f-75f7-4d5f-b27f-425ca91ff683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:49.574029 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d0c141f-75f7-4d5f-b27f-425ca91ff683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:49.574509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d0c141f-75f7-4d5f-b27f-425ca91ff683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:49.574937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d0c141f-75f7-4d5f-b27f-425ca91ff683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:49.575605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d0c141f-75f7-4d5f-b27f-425ca91ff683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:49.576044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d0c141f-75f7-4d5f-b27f-425ca91ff683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:49.576454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9d0c141f-75f7-4d5f-b27f-425ca91ff683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:49.590177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-9d0c141f-75f7-4d5f-b27f-425ca91ff683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] HTTP exception thrown: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9d0c141f-75f7-4d5f-b27f-425ca91ff683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Request method failure captured: Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: DELETE /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad HTTP/1.1 Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED-uT9bLu0AO2jZsoJR1id1NQ1Cb0kzJLLeVtKLIS_65rzdZws9Ovv2RmV7sTZOUg72U27n7c9XPjrR8Zi9BwVGJxr-gaiXu9H1X2rJ0rA3yIrcdwaDRk-9iHtkrfj-aiewxzKJNri45-Tw0_AFgfe1gAQ6OBbakIhlLRIHiEzuVkrc Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 3a33ba1fe1ff4325b80a02053b1db739 Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:51:49.591849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:51:49.593900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3a33ba1fe1ff4325b80a02053b1db739", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a33ba1fe1ff4325b80a02053b1db739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a33ba1fe1ff4325b80a02053b1db739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3a33ba1fe1ff4325b80a02053b1db739"}]}] Sep 01 05:51:49.593900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:51:49.593900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 3a33ba1fe1ff4325b80a02053b1db739 Sep 01 05:51:49.593900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:51:49.593900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeShelveTestJSON-2072305825-project Sep 01 05:51:49.593900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:51:49.593900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:51:49.593900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: d0b6981c4d53405fbe0395ccbcb9f015 Sep 01 05:51:49.593900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2072305825-project Sep 01 05:51:49.593900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:51:49.593900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:51:49.593900 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': 'c63e3cab-2de7-4da7-a5ba-432a2b389fad'} Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:51:49.595078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:51:49.597052 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:51:49.598820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9d0c141f-75f7-4d5f-b27f-425ca91ff683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Returning 404 to user: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:51:49.598820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9d0c141f-75f7-4d5f-b27f-425ca91ff683 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 404 len: 111 microversion: 2.20 time: 0.030483 Sep 01 05:51:49.598820 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1415/2746] 10.222.0.49 () {60 vars in 1280 bytes} [Thu Sep 1 05:51:49 2022] DELETE /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:51:49.602770 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3c329f4a-edc4-4861-a8f4-f1955ceb5fee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:49.603467 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3c329f4a-edc4-4861-a8f4-f1955ceb5fee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: c63e3cab-2de7-4da7-a5ba-432a2b389fad] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:49.609620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c329f4a-edc4-4861-a8f4-f1955ceb5fee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:49.610097 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c329f4a-edc4-4861-a8f4-f1955ceb5fee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:49.610526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c329f4a-edc4-4861-a8f4-f1955ceb5fee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:49.611192 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c329f4a-edc4-4861-a8f4-f1955ceb5fee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:49.611631 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c329f4a-edc4-4861-a8f4-f1955ceb5fee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:49.612044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c329f4a-edc4-4861-a8f4-f1955ceb5fee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:49.625083 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-3c329f4a-edc4-4861-a8f4-f1955ceb5fee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] HTTP exception thrown: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3c329f4a-edc4-4861-a8f4-f1955ceb5fee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Request method failure captured: Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad HTTP/1.1 Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED-uT9bLu0AO2jZsoJR1id1NQ1Cb0kzJLLeVtKLIS_65rzdZws9Ovv2RmV7sTZOUg72U27n7c9XPjrR8Zi9BwVGJxr-gaiXu9H1X2rJ0rA3yIrcdwaDRk-9iHtkrfj-aiewxzKJNri45-Tw0_AFgfe1gAQ6OBbakIhlLRIHiEzuVkrc Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 3a33ba1fe1ff4325b80a02053b1db739 Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:51:49.626697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:51:49.628634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3a33ba1fe1ff4325b80a02053b1db739", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a33ba1fe1ff4325b80a02053b1db739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a33ba1fe1ff4325b80a02053b1db739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3a33ba1fe1ff4325b80a02053b1db739"}]}] Sep 01 05:51:49.628634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:51:49.628634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 3a33ba1fe1ff4325b80a02053b1db739 Sep 01 05:51:49.628634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:51:49.628634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-AttachVolumeShelveTestJSON-2072305825-project Sep 01 05:51:49.628634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:51:49.628634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:51:49.628634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: d0b6981c4d53405fbe0395ccbcb9f015 Sep 01 05:51:49.628634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2072305825-project Sep 01 05:51:49.628634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:51:49.628634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:51:49.628634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': 'c63e3cab-2de7-4da7-a5ba-432a2b389fad'} Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:51:49.629751 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. Sep 01 05:51:49.631688 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:51:49.633903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3c329f4a-edc4-4861-a8f4-f1955ceb5fee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Returning 404 to user: Instance c63e3cab-2de7-4da7-a5ba-432a2b389fad could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:51:49.633903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3c329f4a-edc4-4861-a8f4-f1955ceb5fee tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad" status: 404 len: 111 microversion: 2.20 time: 0.029895 Sep 01 05:51:49.633903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1332/2747] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:51:49 2022] GET /compute/v2.1/servers/c63e3cab-2de7-4da7-a5ba-432a2b389fad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 05:51:55.027392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-acda9c45-3ab6-4ed6-89cf-bc23792e56f0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edc7077d-010a-41ef-aa26-37978f3e5d8c"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:55.029832 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-acda9c45-3ab6-4ed6-89cf-bc23792e56f0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:55.036315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acda9c45-3ab6-4ed6-89cf-bc23792e56f0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:55.036802 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acda9c45-3ab6-4ed6-89cf-bc23792e56f0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:55.037250 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acda9c45-3ab6-4ed6-89cf-bc23792e56f0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:55.037922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acda9c45-3ab6-4ed6-89cf-bc23792e56f0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:55.038367 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acda9c45-3ab6-4ed6-89cf-bc23792e56f0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:55.038791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acda9c45-3ab6-4ed6-89cf-bc23792e56f0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:55.125711 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-acda9c45-3ab6-4ed6-89cf-bc23792e56f0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Invalid volume: volume edc7077d-010a-41ef-aa26-37978f3e5d8c is already attached to instances: 3b8c72a0-5954-458b-a788-dffd785ca110 Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-acda9c45-3ab6-4ed6-89cf-bc23792e56f0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: POST /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-volume_attachments HTTP/1.1 Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 74 Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:51:55.127359 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:51:55.129228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:51:55.129228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:51:55.129228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:51:55.129228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:51:55.129228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:51:55.129228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:51:55.129228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:51:55.129228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:51:55.129228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:51:55.129228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Sep 01 05:51:55.129228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {"volumeAttachment": {"volumeId": "edc7077d-010a-41ef-aa26-37978f3e5d8c"}} Sep 01 05:51:55.129228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Invalid volume: volume edc7077d-010a-41ef-aa26-37978f3e5d8c is already attached to instances: 3b8c72a0-5954-458b-a788-dffd785ca110 Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'server_id': '3b8c72a0-5954-458b-a788-dffd785ca110', 'body': {'volumeAttachment': {'volumeId': 'edc7077d-010a-41ef-aa26-37978f3e5d8c'}}} Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume edc7077d-010a-41ef-aa26-37978f3e5d8c is already attached to instances: 3b8c72a0-5954-458b-a788-dffd785ca110 Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:51:55.130294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume edc7077d-010a-41ef-aa26-37978f3e5d8c is already attached to instances: 3b8c72a0-5954-458b-a788-dffd785ca110 Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:51:55.131734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:51:55.134236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:51:55.134236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:51:55.134236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:51:55.134236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume edc7077d-010a-41ef-aa26-37978f3e5d8c is already attached to instances: 3b8c72a0-5954-458b-a788-dffd785ca110 Sep 01 05:51:55.134236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:51:55.134236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-acda9c45-3ab6-4ed6-89cf-bc23792e56f0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 400 to user: Invalid volume: volume edc7077d-010a-41ef-aa26-37978f3e5d8c is already attached to instances: 3b8c72a0-5954-458b-a788-dffd785ca110 {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:51:55.134236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-acda9c45-3ab6-4ed6-89cf-bc23792e56f0 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105972 Sep 01 05:51:55.134236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1416/2748] 10.222.0.49 () {60 vars in 1323 bytes} [Thu Sep 1 05:51:55 2022] POST /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:51:55.193275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6e5240f3-eb3d-4f92-b31a-48c80e43af91 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:55.193765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6e5240f3-eb3d-4f92-b31a-48c80e43af91 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:55.200986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e5240f3-eb3d-4f92-b31a-48c80e43af91 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:55.201464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e5240f3-eb3d-4f92-b31a-48c80e43af91 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:55.201898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e5240f3-eb3d-4f92-b31a-48c80e43af91 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:55.202574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e5240f3-eb3d-4f92-b31a-48c80e43af91 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:55.203020 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e5240f3-eb3d-4f92-b31a-48c80e43af91 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:55.203439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6e5240f3-eb3d-4f92-b31a-48c80e43af91 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:55.285328 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-6e5240f3-eb3d-4f92-b31a-48c80e43af91 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lazy-loading 'services' on Instance uuid 3b8c72a0-5954-458b-a788-dffd785ca110 {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:51:55.357857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6e5240f3-eb3d-4f92-b31a-48c80e43af91 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-volume_attachments/edc7077d-010a-41ef-aa26-37978f3e5d8c" status: 202 len: 0 microversion: 2.1 time: 0.168245 Sep 01 05:51:55.358426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1333/2749] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 05:51:55 2022] DELETE /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-volume_attachments/edc7077d-010a-41ef-aa26-37978f3e5d8c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:51:55.366737 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-985b0cbc-733d-47a4-8d65-58fb3c4c1a94 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:55.368891 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-985b0cbc-733d-47a4-8d65-58fb3c4c1a94 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:55.374931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-985b0cbc-733d-47a4-8d65-58fb3c4c1a94 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:55.375461 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-985b0cbc-733d-47a4-8d65-58fb3c4c1a94 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:55.375887 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-985b0cbc-733d-47a4-8d65-58fb3c4c1a94 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:55.376558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-985b0cbc-733d-47a4-8d65-58fb3c4c1a94 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:55.377034 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-985b0cbc-733d-47a4-8d65-58fb3c4c1a94 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:55.377451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-985b0cbc-733d-47a4-8d65-58fb3c4c1a94 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:55.407247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-985b0cbc-733d-47a4-8d65-58fb3c4c1a94 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Sep 01 05:51:55.407788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1417/2750] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:51:55 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:56.419765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-3c9208bd-a642-46c2-82aa-77da098587ea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:56.422121 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-3c9208bd-a642-46c2-82aa-77da098587ea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:56.429171 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c9208bd-a642-46c2-82aa-77da098587ea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:56.429646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c9208bd-a642-46c2-82aa-77da098587ea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:56.430078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c9208bd-a642-46c2-82aa-77da098587ea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:56.430756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c9208bd-a642-46c2-82aa-77da098587ea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:56.431201 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c9208bd-a642-46c2-82aa-77da098587ea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:56.432218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-3c9208bd-a642-46c2-82aa-77da098587ea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:56.460831 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-3c9208bd-a642-46c2-82aa-77da098587ea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045623 Sep 01 05:51:56.461377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1334/2751] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:51:56 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:51:56.521735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5720a758-4c68-42fc-9778-e8ec0f5f5cea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:56.522244 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5720a758-4c68-42fc-9778-e8ec0f5f5cea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:56.529445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5720a758-4c68-42fc-9778-e8ec0f5f5cea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:56.529916 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5720a758-4c68-42fc-9778-e8ec0f5f5cea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:56.530342 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5720a758-4c68-42fc-9778-e8ec0f5f5cea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:56.531006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5720a758-4c68-42fc-9778-e8ec0f5f5cea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:56.531445 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5720a758-4c68-42fc-9778-e8ec0f5f5cea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:56.531857 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5720a758-4c68-42fc-9778-e8ec0f5f5cea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:56.556627 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5720a758-4c68-42fc-9778-e8ec0f5f5cea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:51:56.631003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5720a758-4c68-42fc-9778-e8ec0f5f5cea tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 204 len: 0 microversion: 2.1 time: 0.112728 Sep 01 05:51:56.631578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1418/2752] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:51:56 2022] DELETE /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:51:56.640847 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-144e8b35-e36c-439f-b4a0-d54c539e703c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:56.641472 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-144e8b35-e36c-439f-b4a0-d54c539e703c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:56.647407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-144e8b35-e36c-439f-b4a0-d54c539e703c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:56.647892 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-144e8b35-e36c-439f-b4a0-d54c539e703c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:56.648349 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-144e8b35-e36c-439f-b4a0-d54c539e703c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:56.649086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-144e8b35-e36c-439f-b4a0-d54c539e703c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:56.649540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-144e8b35-e36c-439f-b4a0-d54c539e703c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:56.650859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-144e8b35-e36c-439f-b4a0-d54c539e703c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:56.778391 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-144e8b35-e36c-439f-b4a0-d54c539e703c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:56.786164 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-144e8b35-e36c-439f-b4a0-d54c539e703c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1684 microversion: 2.1 time: 0.149387 Sep 01 05:51:56.786727 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1335/2753] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:56 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:51:57.808197 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-54fc79e4-da21-4671-adc4-30b4d9a5efcf tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:57.808918 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-54fc79e4-da21-4671-adc4-30b4d9a5efcf tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:57.815744 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54fc79e4-da21-4671-adc4-30b4d9a5efcf tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:57.816308 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54fc79e4-da21-4671-adc4-30b4d9a5efcf tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:57.816746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54fc79e4-da21-4671-adc4-30b4d9a5efcf tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:57.817448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54fc79e4-da21-4671-adc4-30b4d9a5efcf tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:57.817892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54fc79e4-da21-4671-adc4-30b4d9a5efcf tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:57.818309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-54fc79e4-da21-4671-adc4-30b4d9a5efcf tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:57.950917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-54fc79e4-da21-4671-adc4-30b4d9a5efcf tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:57.958861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-54fc79e4-da21-4671-adc4-30b4d9a5efcf tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1684 microversion: 2.1 time: 0.155427 Sep 01 05:51:57.959432 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1419/2754] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:57 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:58.913820 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-2a14c268-a125-448e-a425-d5d8c06a7cbe req-12d53124-3e54-4b6b-86d6-2fd6513ec71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8c72a0-5954-458b-a788-dffd785ca110", "name": "network-vif-deleted", "tag": "8a6044c8-6cf4-417a-97a9-e7bc7ae6e8a4"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:58.926028 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-2a14c268-a125-448e-a425-d5d8c06a7cbe req-12d53124-3e54-4b6b-86d6-2fd6513ec71f service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:58.926530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-2a14c268-a125-448e-a425-d5d8c06a7cbe req-12d53124-3e54-4b6b-86d6-2fd6513ec71f service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:58.926954 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-2a14c268-a125-448e-a425-d5d8c06a7cbe req-12d53124-3e54-4b6b-86d6-2fd6513ec71f service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:58.939426 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-2a14c268-a125-448e-a425-d5d8c06a7cbe req-12d53124-3e54-4b6b-86d6-2fd6513ec71f service nova] Creating event network-vif-deleted:8a6044c8-6cf4-417a-97a9-e7bc7ae6e8a4 for instance 3b8c72a0-5954-458b-a788-dffd785ca110 on hv-cinder-85391 Sep 01 05:51:58.944812 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-2a14c268-a125-448e-a425-d5d8c06a7cbe req-12d53124-3e54-4b6b-86d6-2fd6513ec71f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035536 Sep 01 05:51:58.949114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1336/2755] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:58.979866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:58.982130 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:58.990965 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:58.992263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:58.992683 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:58.993619 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:58.994066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:58.994481 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:59.036307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:59.037088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:59.037732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:59.038184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lazy-loading 'fault' on Instance uuid 3b8c72a0-5954-458b-a788-dffd785ca110 {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:51:59.088647 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:59.098341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-039c6fd7-63af-466b-872d-19f009bd1b07 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 200 len: 1332 microversion: 2.1 time: 0.122225 Sep 01 05:51:59.113225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1420/2756] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:58 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 1332 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:00.122658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9a465ad5-baa8-4e9c-94e7-c648d9217c78 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:00.123359 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9a465ad5-baa8-4e9c-94e7-c648d9217c78 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:00.129473 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a465ad5-baa8-4e9c-94e7-c648d9217c78 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:00.129947 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a465ad5-baa8-4e9c-94e7-c648d9217c78 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:00.130375 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a465ad5-baa8-4e9c-94e7-c648d9217c78 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:00.131042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a465ad5-baa8-4e9c-94e7-c648d9217c78 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:00.131484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a465ad5-baa8-4e9c-94e7-c648d9217c78 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:00.131898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9a465ad5-baa8-4e9c-94e7-c648d9217c78 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:00.145400 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-9a465ad5-baa8-4e9c-94e7-c648d9217c78 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9a465ad5-baa8-4e9c-94e7-c648d9217c78 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 HTTP/1.1 Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:52:00.146953 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:52:00.148808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:52:00.148808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:52:00.148808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:52:00.148808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:52:00.148808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:52:00.148808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:52:00.148808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:52:00.148808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:52:00.148808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:52:00.148808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:52:00.148808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:52:00.148808 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '3b8c72a0-5954-458b-a788-dffd785ca110'} Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:52:00.150152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:52:00.152451 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:52:00.154195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9a465ad5-baa8-4e9c-94e7-c648d9217c78 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 404 to user: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:52:00.154195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9a465ad5-baa8-4e9c-94e7-c648d9217c78 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 404 len: 111 microversion: 2.1 time: 0.031142 Sep 01 05:52:00.154195 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1337/2757] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:00 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:52:00.158142 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2625ff4a-c05e-40a8-803d-0145e1ebef19 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '.version_select at 0x7f96285113a0>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:00.175970 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2625ff4a-c05e-40a8-803d-0145e1ebef19 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741022889" status: 202 len: 0 microversion: 2.1 time: 0.021561 Sep 01 05:52:00.176532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1421/2758] 10.222.0.49 () {58 vars in 1221 bytes} [Thu Sep 1 05:52:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741022889 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:52:00.785632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5a5dc76e-a976-441d-ba08-eadd8c01703f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: .version_select at 0x7f9624bba4c0>, body: {"keypair": {"name": "tempest-keypair-1630586182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrH42vxHia2vRgulHzdmi8x9SnmYhUjRty+/+LaE5mSor7PWOWdPqTgNNb/dwFgAXBPVUQI1kboJXITfEpjMQ9RntWaF4r4JSduamSB5nqd9xKmRVOrfl6bFRRrLt24bg=="}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:00.801382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-5a5dc76e-a976-441d-ba08-eadd8c01703f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for project 206f93c129394a4badf489d8c7c45b16. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:52:00.805129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-5a5dc76e-a976-441d-ba08-eadd8c01703f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for user 2e8c9e2056464b9299ff765507323869 and project 206f93c129394a4badf489d8c7c45b16. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:52:00.827533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5a5dc76e-a976-441d-ba08-eadd8c01703f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045747 Sep 01 05:52:00.828108 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1338/2759] 10.222.0.49 () {60 vars in 1159 bytes} [Thu Sep 1 05:52:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:02.080392 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1407287512", "imageRef": "44354a78-5fa5-4f26-9593-350a6588d268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bf7b767-c598-4723-849f-bfb972eb4c62"}], "security_groups": [{"name": "tempest-securitygroup--1980377429"}], "key_name": "tempest-keypair-1630586182", "user_data": "}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:02.185383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.network.neutron [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] validate_networks() for [('3bf7b767-c598-4723-849f-bfb972eb4c62', None, None, None, None, None)] {{(pid=120673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:52:02.554629 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Flavor limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:52:02.555057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Image limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:52:02.555531 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Flavor pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:52:02.555942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Image pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:52:02.556356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:52:02.565699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:02.566178 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:02.566617 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:02.567339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:02.567792 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:02.568215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:02.584816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for project 206f93c129394a4badf489d8c7c45b16. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:52:02.588817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Getting quotas for user 2e8c9e2056464b9299ff765507323869 and project 206f93c129394a4badf489d8c7c45b16. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:52:02.600526 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Going to run 1 instances... {{(pid=120673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:52:02.602858 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44354a78-5fa5-4f26-9593-350a6588d268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:52:02.652003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0c2843b5-397c-46d4-aa03-2ba05a195b27 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.575646 Sep 01 05:52:02.652707 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1422/2760] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:52:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:52:02.663645 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9cb08a2a-3480-42b5-a7b1-0f309773882a tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:02.664374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9cb08a2a-3480-42b5-a7b1-0f309773882a tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:02.723763 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9cb08a2a-3480-42b5-a7b1-0f309773882a tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:02.731197 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9cb08a2a-3480-42b5-a7b1-0f309773882a tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 200 len: 1242 microversion: 2.1 time: 0.071494 Sep 01 05:52:02.731766 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1339/2761] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:02 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:03.753228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-acc072d7-543a-4492-bae1-a45f7ed2fefa tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:03.753854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-acc072d7-543a-4492-bae1-a45f7ed2fefa tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:03.761420 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acc072d7-543a-4492-bae1-a45f7ed2fefa tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:03.762085 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acc072d7-543a-4492-bae1-a45f7ed2fefa tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:03.762413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acc072d7-543a-4492-bae1-a45f7ed2fefa tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:03.763104 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acc072d7-543a-4492-bae1-a45f7ed2fefa tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:03.763557 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acc072d7-543a-4492-bae1-a45f7ed2fefa tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:03.763981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-acc072d7-543a-4492-bae1-a45f7ed2fefa tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:03.825439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-acc072d7-543a-4492-bae1-a45f7ed2fefa tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:03.833069 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-acc072d7-543a-4492-bae1-a45f7ed2fefa tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 200 len: 1300 microversion: 2.1 time: 0.085361 Sep 01 05:52:03.833632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1423/2762] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:03 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:04.854086 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-48abbcde-956b-4d2f-aacc-094dedb58fc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:04.854857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-48abbcde-956b-4d2f-aacc-094dedb58fc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:04.861096 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-48abbcde-956b-4d2f-aacc-094dedb58fc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:04.861577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-48abbcde-956b-4d2f-aacc-094dedb58fc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:04.862037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-48abbcde-956b-4d2f-aacc-094dedb58fc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:04.862722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-48abbcde-956b-4d2f-aacc-094dedb58fc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:04.863170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-48abbcde-956b-4d2f-aacc-094dedb58fc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:04.863590 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-48abbcde-956b-4d2f-aacc-094dedb58fc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:04.991679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-faf81d82-1717-4f3f-bdfa-a9637903de3c req-b9d7aa43-e188-4fca-990e-e28a908504f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e", "tag": "8ef3b8d6-3279-4102-bc1a-54c8e738ef09"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:05.006156 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-faf81d82-1717-4f3f-bdfa-a9637903de3c req-b9d7aa43-e188-4fca-990e-e28a908504f7 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:05.006631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-faf81d82-1717-4f3f-bdfa-a9637903de3c req-b9d7aa43-e188-4fca-990e-e28a908504f7 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:05.007274 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-faf81d82-1717-4f3f-bdfa-a9637903de3c req-b9d7aa43-e188-4fca-990e-e28a908504f7 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:05.021224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-faf81d82-1717-4f3f-bdfa-a9637903de3c req-b9d7aa43-e188-4fca-990e-e28a908504f7 service nova] Creating event network-changed:8ef3b8d6-3279-4102-bc1a-54c8e738ef09 for instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e on hv-cinder-85391 Sep 01 05:52:05.026644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-faf81d82-1717-4f3f-bdfa-a9637903de3c req-b9d7aa43-e188-4fca-990e-e28a908504f7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039665 Sep 01 05:52:05.027332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1424/2763] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:05.105923 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-48abbcde-956b-4d2f-aacc-094dedb58fc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:05.113639 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-48abbcde-956b-4d2f-aacc-094dedb58fc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 200 len: 1368 microversion: 2.1 time: 0.263508 Sep 01 05:52:05.114204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1340/2764] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:04 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:06.249356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-adfd791e-2acd-4918-8c17-fab9c1d3dc8d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:06.250055 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-adfd791e-2acd-4918-8c17-fab9c1d3dc8d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:06.256127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-adfd791e-2acd-4918-8c17-fab9c1d3dc8d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:06.256605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-adfd791e-2acd-4918-8c17-fab9c1d3dc8d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:06.257067 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-adfd791e-2acd-4918-8c17-fab9c1d3dc8d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:06.257746 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-adfd791e-2acd-4918-8c17-fab9c1d3dc8d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:06.258195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-adfd791e-2acd-4918-8c17-fab9c1d3dc8d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:06.258618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-adfd791e-2acd-4918-8c17-fab9c1d3dc8d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:06.389062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-adfd791e-2acd-4918-8c17-fab9c1d3dc8d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:06.396798 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-adfd791e-2acd-4918-8c17-fab9c1d3dc8d tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 200 len: 1368 microversion: 2.1 time: 0.265648 Sep 01 05:52:06.397380 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1425/2765] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:06 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:07.417717 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6da9c6bb-7e82-483c-98f4-9fc202df1f95 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:07.418337 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6da9c6bb-7e82-483c-98f4-9fc202df1f95 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:07.425483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6da9c6bb-7e82-483c-98f4-9fc202df1f95 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:07.426176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6da9c6bb-7e82-483c-98f4-9fc202df1f95 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:07.426692 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6da9c6bb-7e82-483c-98f4-9fc202df1f95 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:07.427729 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6da9c6bb-7e82-483c-98f4-9fc202df1f95 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:07.428181 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6da9c6bb-7e82-483c-98f4-9fc202df1f95 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:07.428604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6da9c6bb-7e82-483c-98f4-9fc202df1f95 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:07.557155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6da9c6bb-7e82-483c-98f4-9fc202df1f95 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:07.565079 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6da9c6bb-7e82-483c-98f4-9fc202df1f95 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 200 len: 1368 microversion: 2.1 time: 0.151844 Sep 01 05:52:07.565641 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1341/2766] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:07 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:08.586451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bd4d79b7-ccc3-44c5-a78e-06cc7803ae58 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:08.587061 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bd4d79b7-ccc3-44c5-a78e-06cc7803ae58 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:08.594249 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bd4d79b7-ccc3-44c5-a78e-06cc7803ae58 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:08.594775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bd4d79b7-ccc3-44c5-a78e-06cc7803ae58 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:08.595151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bd4d79b7-ccc3-44c5-a78e-06cc7803ae58 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:08.595823 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bd4d79b7-ccc3-44c5-a78e-06cc7803ae58 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:08.596263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bd4d79b7-ccc3-44c5-a78e-06cc7803ae58 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:08.596675 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bd4d79b7-ccc3-44c5-a78e-06cc7803ae58 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:08.730800 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bd4d79b7-ccc3-44c5-a78e-06cc7803ae58 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:08.738772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bd4d79b7-ccc3-44c5-a78e-06cc7803ae58 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 200 len: 1368 microversion: 2.1 time: 0.156137 Sep 01 05:52:08.739631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1426/2767] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:08 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:09.759996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dafe4362-0eda-48cb-9244-924758caba1f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:09.761161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dafe4362-0eda-48cb-9244-924758caba1f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:09.767720 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dafe4362-0eda-48cb-9244-924758caba1f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:09.768236 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dafe4362-0eda-48cb-9244-924758caba1f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:09.768674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dafe4362-0eda-48cb-9244-924758caba1f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:09.769390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dafe4362-0eda-48cb-9244-924758caba1f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:09.769843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dafe4362-0eda-48cb-9244-924758caba1f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:09.770269 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dafe4362-0eda-48cb-9244-924758caba1f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:09.904285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dafe4362-0eda-48cb-9244-924758caba1f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:09.911848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dafe4362-0eda-48cb-9244-924758caba1f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 200 len: 1368 microversion: 2.1 time: 0.155719 Sep 01 05:52:09.912405 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1342/2768] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:09 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:10.519293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-9fee31bc-329f-4495-86ad-47bc99841c53 req-fe459db3-0c09-44cc-ac5d-b509804d37a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e", "name": "network-vif-plugged", "status": "completed", "tag": "8ef3b8d6-3279-4102-bc1a-54c8e738ef09"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:10.531276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-9fee31bc-329f-4495-86ad-47bc99841c53 req-fe459db3-0c09-44cc-ac5d-b509804d37a4 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:10.531750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-9fee31bc-329f-4495-86ad-47bc99841c53 req-fe459db3-0c09-44cc-ac5d-b509804d37a4 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:10.532180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-9fee31bc-329f-4495-86ad-47bc99841c53 req-fe459db3-0c09-44cc-ac5d-b509804d37a4 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:10.544228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-9fee31bc-329f-4495-86ad-47bc99841c53 req-fe459db3-0c09-44cc-ac5d-b509804d37a4 service nova] Creating event network-vif-plugged:8ef3b8d6-3279-4102-bc1a-54c8e738ef09 for instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e on hv-cinder-85391 Sep 01 05:52:10.549446 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-9fee31bc-329f-4495-86ad-47bc99841c53 req-fe459db3-0c09-44cc-ac5d-b509804d37a4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033958 Sep 01 05:52:10.550030 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1427/2769] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:10.932948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-140f41af-d392-4ec8-b267-eeef98b5019c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:10.933792 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-140f41af-d392-4ec8-b267-eeef98b5019c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:10.940406 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-140f41af-d392-4ec8-b267-eeef98b5019c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:10.940928 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-140f41af-d392-4ec8-b267-eeef98b5019c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:10.941370 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-140f41af-d392-4ec8-b267-eeef98b5019c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:10.942054 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-140f41af-d392-4ec8-b267-eeef98b5019c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:10.942501 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-140f41af-d392-4ec8-b267-eeef98b5019c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:10.942915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-140f41af-d392-4ec8-b267-eeef98b5019c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:11.074305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-140f41af-d392-4ec8-b267-eeef98b5019c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:11.082074 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-140f41af-d392-4ec8-b267-eeef98b5019c tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 200 len: 1368 microversion: 2.1 time: 0.153643 Sep 01 05:52:11.082632 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1343/2770] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:10 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:12.102977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9bba96f4-db7d-494b-878d-a81bc189636f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:12.103724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9bba96f4-db7d-494b-878d-a81bc189636f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:12.110855 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9bba96f4-db7d-494b-878d-a81bc189636f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:12.111325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9bba96f4-db7d-494b-878d-a81bc189636f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:12.111780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9bba96f4-db7d-494b-878d-a81bc189636f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:12.112447 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9bba96f4-db7d-494b-878d-a81bc189636f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:12.112921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9bba96f4-db7d-494b-878d-a81bc189636f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:12.113338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9bba96f4-db7d-494b-878d-a81bc189636f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:12.246307 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9bba96f4-db7d-494b-878d-a81bc189636f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:12.254150 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9bba96f4-db7d-494b-878d-a81bc189636f tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 200 len: 1558 microversion: 2.1 time: 0.155393 Sep 01 05:52:12.254713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1428/2771] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:12 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:12.274291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4c495f55-f2f0-4188-b762-0e1c2422dd11 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:12.275073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4c495f55-f2f0-4188-b762-0e1c2422dd11 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:12.281721 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c495f55-f2f0-4188-b762-0e1c2422dd11 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:12.282199 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c495f55-f2f0-4188-b762-0e1c2422dd11 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:12.282636 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c495f55-f2f0-4188-b762-0e1c2422dd11 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:12.283318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c495f55-f2f0-4188-b762-0e1c2422dd11 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:12.283771 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c495f55-f2f0-4188-b762-0e1c2422dd11 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:12.284198 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4c495f55-f2f0-4188-b762-0e1c2422dd11 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:12.360167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4c495f55-f2f0-4188-b762-0e1c2422dd11 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089772 Sep 01 05:52:12.360755 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1344/2772] 10.222.0.49 () {58 vars in 1275 bytes} [Thu Sep 1 05:52:12 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:13.529504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-6a59cef2-4710-4b0b-8730-fcffc6a4a4fd req-3cfb87ec-10e5-4dd4-9945-3598a123981a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e", "tag": "8ef3b8d6-3279-4102-bc1a-54c8e738ef09"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:13.534853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:13.535687 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=6 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:13.543009 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-6a59cef2-4710-4b0b-8730-fcffc6a4a4fd req-3cfb87ec-10e5-4dd4-9945-3598a123981a service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:13.543491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-6a59cef2-4710-4b0b-8730-fcffc6a4a4fd req-3cfb87ec-10e5-4dd4-9945-3598a123981a service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:13.543921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-6a59cef2-4710-4b0b-8730-fcffc6a4a4fd req-3cfb87ec-10e5-4dd4-9945-3598a123981a service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:13.557459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-6a59cef2-4710-4b0b-8730-fcffc6a4a4fd req-3cfb87ec-10e5-4dd4-9945-3598a123981a service nova] Creating event network-changed:8ef3b8d6-3279-4102-bc1a-54c8e738ef09 for instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e on hv-cinder-85391 Sep 01 05:52:13.562566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-6a59cef2-4710-4b0b-8730-fcffc6a4a4fd req-3cfb87ec-10e5-4dd4-9945-3598a123981a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037704 Sep 01 05:52:13.563428 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1429/2773] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:47.376336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=6 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:47.378071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:47.378841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:47.383904 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cb8f32f7-2e54-4242-825e-5abbf7f1e2f4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:47.384400 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cb8f32f7-2e54-4242-825e-5abbf7f1e2f4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:47.393040 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb8f32f7-2e54-4242-825e-5abbf7f1e2f4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:47.393713 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb8f32f7-2e54-4242-825e-5abbf7f1e2f4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:47.394192 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb8f32f7-2e54-4242-825e-5abbf7f1e2f4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:47.394936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb8f32f7-2e54-4242-825e-5abbf7f1e2f4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:47.395388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb8f32f7-2e54-4242-825e-5abbf7f1e2f4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:47.395812 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cb8f32f7-2e54-4242-825e-5abbf7f1e2f4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:47.420436 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cb8f32f7-2e54-4242-825e-5abbf7f1e2f4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e/ips" status: 200 len: 150 microversion: 2.1 time: 0.044925 Sep 01 05:52:47.421029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1345/2774] 10.222.0.49 () {58 vars in 1248 bytes} [Thu Sep 1 05:52:47 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:48.746859 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c026d772-8046-450e-bbe7-61e1d8d0725e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "405cf786-a11f-472e-8e66-c857fad75d91"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:48.749180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c026d772-8046-450e-bbe7-61e1d8d0725e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:48.751327 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:48.752064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:48.758363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c026d772-8046-450e-bbe7-61e1d8d0725e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:48.758833 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c026d772-8046-450e-bbe7-61e1d8d0725e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:48.759256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c026d772-8046-450e-bbe7-61e1d8d0725e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:48.760465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c026d772-8046-450e-bbe7-61e1d8d0725e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:48.761082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c026d772-8046-450e-bbe7-61e1d8d0725e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:48.761578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c026d772-8046-450e-bbe7-61e1d8d0725e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:49.008026 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c026d772-8046-450e-bbe7-61e1d8d0725e tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "POST /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265615 Sep 01 05:52:49.008587 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1430/2775] 10.222.0.49 () {60 vars in 1323 bytes} [Thu Sep 1 05:52:48 2022] POST /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:55.578019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a2740560-8920-48b4-bcce-d6c7035b5dc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:55.579149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a2740560-8920-48b4-bcce-d6c7035b5dc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:55.585508 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a2740560-8920-48b4-bcce-d6c7035b5dc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:55.585979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a2740560-8920-48b4-bcce-d6c7035b5dc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:55.586431 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a2740560-8920-48b4-bcce-d6c7035b5dc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:55.587105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a2740560-8920-48b4-bcce-d6c7035b5dc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:55.587672 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a2740560-8920-48b4-bcce-d6c7035b5dc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:55.588324 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a2740560-8920-48b4-bcce-d6c7035b5dc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:55.671786 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-a2740560-8920-48b4-bcce-d6c7035b5dc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lazy-loading 'services' on Instance uuid 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:52:55.750023 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a2740560-8920-48b4-bcce-d6c7035b5dc4 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e/os-volume_attachments/405cf786-a11f-472e-8e66-c857fad75d91" status: 202 len: 0 microversion: 2.1 time: 0.175589 Sep 01 05:52:55.750793 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1346/2776] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 05:52:55 2022] DELETE /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e/os-volume_attachments/405cf786-a11f-472e-8e66-c857fad75d91 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:52:55.759424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d9766478-ae97-42a1-b561-e41fd471463b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:55.763228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d9766478-ae97-42a1-b561-e41fd471463b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:55.770174 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9766478-ae97-42a1-b561-e41fd471463b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:55.770658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9766478-ae97-42a1-b561-e41fd471463b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:55.771320 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9766478-ae97-42a1-b561-e41fd471463b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:55.772059 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9766478-ae97-42a1-b561-e41fd471463b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:55.772519 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9766478-ae97-42a1-b561-e41fd471463b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:55.772990 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d9766478-ae97-42a1-b561-e41fd471463b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:55.817767 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d9766478-ae97-42a1-b561-e41fd471463b tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062513 Sep 01 05:52:55.818318 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1431/2777] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:52:55 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:56.832290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-21cf63ef-3b41-4f99-a9d3-afcf426c25a7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:56.834735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-21cf63ef-3b41-4f99-a9d3-afcf426c25a7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:56.841419 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21cf63ef-3b41-4f99-a9d3-afcf426c25a7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:56.841893 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21cf63ef-3b41-4f99-a9d3-afcf426c25a7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:56.842318 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21cf63ef-3b41-4f99-a9d3-afcf426c25a7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:56.843018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21cf63ef-3b41-4f99-a9d3-afcf426c25a7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:56.843462 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21cf63ef-3b41-4f99-a9d3-afcf426c25a7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:56.843880 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-21cf63ef-3b41-4f99-a9d3-afcf426c25a7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:56.874324 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-21cf63ef-3b41-4f99-a9d3-afcf426c25a7 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046827 Sep 01 05:52:56.874870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1347/2778] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 05:52:56 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:52:56.936192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4a5ab625-973a-429a-9c01-57324dacb451 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:56.936728 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4a5ab625-973a-429a-9c01-57324dacb451 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:56.943078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a5ab625-973a-429a-9c01-57324dacb451 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:56.943558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a5ab625-973a-429a-9c01-57324dacb451 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:56.943989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a5ab625-973a-429a-9c01-57324dacb451 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:56.944664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a5ab625-973a-429a-9c01-57324dacb451 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:56.945136 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a5ab625-973a-429a-9c01-57324dacb451 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:56.945555 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4a5ab625-973a-429a-9c01-57324dacb451 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:56.970851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4a5ab625-973a-429a-9c01-57324dacb451 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:52:57.046474 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4a5ab625-973a-429a-9c01-57324dacb451 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 204 len: 0 microversion: 2.1 time: 0.113942 Sep 01 05:52:57.047068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1432/2779] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:52:56 2022] DELETE /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:52:57.057624 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4e9ebe67-ce44-404b-b741-80be8632d336 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:57.058230 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4e9ebe67-ce44-404b-b741-80be8632d336 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:57.064008 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e9ebe67-ce44-404b-b741-80be8632d336 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:57.064484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e9ebe67-ce44-404b-b741-80be8632d336 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:57.064960 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e9ebe67-ce44-404b-b741-80be8632d336 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:57.065630 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e9ebe67-ce44-404b-b741-80be8632d336 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:57.066073 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e9ebe67-ce44-404b-b741-80be8632d336 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:57.066487 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4e9ebe67-ce44-404b-b741-80be8632d336 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:57.197674 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-4e9ebe67-ce44-404b-b741-80be8632d336 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:57.205758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4e9ebe67-ce44-404b-b741-80be8632d336 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 200 len: 1683 microversion: 2.1 time: 0.152201 Sep 01 05:52:57.206325 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1348/2780] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:57 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:58.227904 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-a5bd9db2-013d-433c-825d-f4c46db4ea29 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:58.228750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-a5bd9db2-013d-433c-825d-f4c46db4ea29 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:58.235396 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5bd9db2-013d-433c-825d-f4c46db4ea29 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:58.235873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5bd9db2-013d-433c-825d-f4c46db4ea29 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:58.236303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5bd9db2-013d-433c-825d-f4c46db4ea29 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:58.237021 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5bd9db2-013d-433c-825d-f4c46db4ea29 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:58.237464 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5bd9db2-013d-433c-825d-f4c46db4ea29 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:58.237883 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-a5bd9db2-013d-433c-825d-f4c46db4ea29 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:58.374397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-a5bd9db2-013d-433c-825d-f4c46db4ea29 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:58.382014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-a5bd9db2-013d-433c-825d-f4c46db4ea29 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 200 len: 1683 microversion: 2.1 time: 0.158535 Sep 01 05:52:58.382574 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1433/2781] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:58 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:59.332337 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-5da70e6e-f1d0-45e5-ad8b-2a44126a84e0 req-8d1b0279-1c56-4715-ace0-68b7aea4e194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e", "name": "network-vif-deleted", "tag": "8ef3b8d6-3279-4102-bc1a-54c8e738ef09"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:59.343305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5da70e6e-f1d0-45e5-ad8b-2a44126a84e0 req-8d1b0279-1c56-4715-ace0-68b7aea4e194 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:59.343773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5da70e6e-f1d0-45e5-ad8b-2a44126a84e0 req-8d1b0279-1c56-4715-ace0-68b7aea4e194 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:59.344203 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5da70e6e-f1d0-45e5-ad8b-2a44126a84e0 req-8d1b0279-1c56-4715-ace0-68b7aea4e194 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:59.356351 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-5da70e6e-f1d0-45e5-ad8b-2a44126a84e0 req-8d1b0279-1c56-4715-ace0-68b7aea4e194 service nova] Creating event network-vif-deleted:8ef3b8d6-3279-4102-bc1a-54c8e738ef09 for instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e on hv-cinder-85391 Sep 01 05:52:59.361315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-5da70e6e-f1d0-45e5-ad8b-2a44126a84e0 req-8d1b0279-1c56-4715-ace0-68b7aea4e194 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032611 Sep 01 05:52:59.361917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1349/2782] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:59.405456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:59.406097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:59.414705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:59.415662 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:59.416515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:59.417999 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:59.418704 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:59.419360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:59.457889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:59.458909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:59.459618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:59.460608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lazy-loading 'fault' on Instance uuid 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:52:59.516323 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8c9e2056464b9299ff765507323869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206f93c129394a4badf489d8c7c45b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:59.527651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bf25bfb0-9d00-4fdc-b29c-06c6c007bc44 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 200 len: 1332 microversion: 2.1 time: 0.124417 Sep 01 05:52:59.528457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1434/2783] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:59 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:00.553308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1b8cbd4e-00b2-46ac-bbda-1cf56fac6157 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:00.553938 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1b8cbd4e-00b2-46ac-bbda-1cf56fac6157 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:00.560614 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b8cbd4e-00b2-46ac-bbda-1cf56fac6157 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:00.561129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b8cbd4e-00b2-46ac-bbda-1cf56fac6157 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:00.561558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b8cbd4e-00b2-46ac-bbda-1cf56fac6157 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:00.562225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b8cbd4e-00b2-46ac-bbda-1cf56fac6157 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:00.562668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b8cbd4e-00b2-46ac-bbda-1cf56fac6157 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:00.563080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1b8cbd4e-00b2-46ac-bbda-1cf56fac6157 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:00.576972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-1b8cbd4e-00b2-46ac-bbda-1cf56fac6157 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1b8cbd4e-00b2-46ac-bbda-1cf56fac6157 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e HTTP/1.1 Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:53:00.578574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:53:00.580437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:53:00.580437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:00.580437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:00.580437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:00.580437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:00.580437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:53:00.580437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:53:00.580437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:53:00.580437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:00.580437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:53:00.580437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:00.580437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e'} Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:53:00.581791 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:00.583668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:00.585218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1b8cbd4e-00b2-46ac-bbda-1cf56fac6157 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 404 to user: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:53:00.585218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1b8cbd4e-00b2-46ac-bbda-1cf56fac6157 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 404 len: 111 microversion: 2.1 time: 0.031474 Sep 01 05:53:00.585218 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1350/2784] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:00 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:53:00.588838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-560c4b0e-519e-4aee-aa79-16641503c199 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '.version_select at 0x7f962844faf0>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:00.607362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-560c4b0e-519e-4aee-aa79-16641503c199 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630586182" status: 202 len: 0 microversion: 2.1 time: 0.022358 Sep 01 05:53:00.608274 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1435/2785] 10.222.0.49 () {58 vars in 1221 bytes} [Thu Sep 1 05:53:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630586182 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:53:02.359817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-463e5d58-a28a-4654-af38-31968f2f6152 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:02.360305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-463e5d58-a28a-4654-af38-31968f2f6152 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:02.366607 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-463e5d58-a28a-4654-af38-31968f2f6152 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:02.367087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-463e5d58-a28a-4654-af38-31968f2f6152 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:02.367519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-463e5d58-a28a-4654-af38-31968f2f6152 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:02.368191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-463e5d58-a28a-4654-af38-31968f2f6152 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:02.368642 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-463e5d58-a28a-4654-af38-31968f2f6152 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:02.369126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-463e5d58-a28a-4654-af38-31968f2f6152 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:02.382299 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-463e5d58-a28a-4654-af38-31968f2f6152 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-463e5d58-a28a-4654-af38-31968f2f6152 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e HTTP/1.1 Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:53:02.383875 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:53:02.386200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:53:02.386200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:02.386200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:02.386200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:02.386200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:02.386200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:53:02.386200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:53:02.386200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:53:02.386200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:02.386200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:53:02.386200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:02.386200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e'} Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:53:02.387367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:02.389065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:02.390885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-463e5d58-a28a-4654-af38-31968f2f6152 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 404 to user: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:53:02.390885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-463e5d58-a28a-4654-af38-31968f2f6152 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 404 len: 111 microversion: 2.1 time: 0.029922 Sep 01 05:53:02.390885 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1351/2786] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:53:02 2022] DELETE /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:53:02.394850 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-62670d7c-fb0d-41e3-8ee4-d47d6e6e0757 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:02.395626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-62670d7c-fb0d-41e3-8ee4-d47d6e6e0757 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:02.405583 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62670d7c-fb0d-41e3-8ee4-d47d6e6e0757 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:02.406062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62670d7c-fb0d-41e3-8ee4-d47d6e6e0757 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:02.406496 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62670d7c-fb0d-41e3-8ee4-d47d6e6e0757 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:02.407179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62670d7c-fb0d-41e3-8ee4-d47d6e6e0757 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:02.407628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62670d7c-fb0d-41e3-8ee4-d47d6e6e0757 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:02.408046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-62670d7c-fb0d-41e3-8ee4-d47d6e6e0757 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:02.421233 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-62670d7c-fb0d-41e3-8ee4-d47d6e6e0757 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-62670d7c-fb0d-41e3-8ee4-d47d6e6e0757 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e HTTP/1.1 Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:53:02.422854 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:53:02.424651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:53:02.424651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:02.424651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:02.424651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:02.424651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:02.424651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:53:02.424651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:53:02.424651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:53:02.424651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:02.424651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:53:02.424651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:02.424651 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e'} Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:53:02.425886 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. Sep 01 05:53:02.427637 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:02.429238 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-62670d7c-fb0d-41e3-8ee4-d47d6e6e0757 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 404 to user: Instance 208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:53:02.429238 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-62670d7c-fb0d-41e3-8ee4-d47d6e6e0757 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e" status: 404 len: 111 microversion: 2.1 time: 0.033716 Sep 01 05:53:02.429238 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1436/2787] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:02 2022] GET /compute/v2.1/servers/208c6e83-7bd6-4c36-9ba2-7c31c4af0a1e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:53:03.566957 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b25c9aaf-083c-4728-9961-585078eb1ba6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:03.567513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b25c9aaf-083c-4728-9961-585078eb1ba6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:03.573948 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b25c9aaf-083c-4728-9961-585078eb1ba6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:03.574425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b25c9aaf-083c-4728-9961-585078eb1ba6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:03.574857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b25c9aaf-083c-4728-9961-585078eb1ba6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:03.575530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b25c9aaf-083c-4728-9961-585078eb1ba6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:03.575988 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b25c9aaf-083c-4728-9961-585078eb1ba6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:03.576407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b25c9aaf-083c-4728-9961-585078eb1ba6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:03.590046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-b25c9aaf-083c-4728-9961-585078eb1ba6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b25c9aaf-083c-4728-9961-585078eb1ba6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 HTTP/1.1 Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:53:03.591554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:53:03.593456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:53:03.593456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:03.593456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:03.593456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:03.593456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:03.593456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:53:03.593456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:53:03.593456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:53:03.593456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:03.593456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:53:03.593456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:53:03.593456 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '3b8c72a0-5954-458b-a788-dffd785ca110'} Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:53:03.594514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:53:03.596321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.598049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b25c9aaf-083c-4728-9961-585078eb1ba6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 404 to user: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:53:03.598049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b25c9aaf-083c-4728-9961-585078eb1ba6 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 404 len: 111 microversion: 2.1 time: 0.029766 Sep 01 05:53:03.598049 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1352/2788] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:53:03 2022] DELETE /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:53:03.601331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6823499f-b689-4cba-a9a1-97dbdf383795 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:03.601974 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6823499f-b689-4cba-a9a1-97dbdf383795 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 3b8c72a0-5954-458b-a788-dffd785ca110] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:03.609528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6823499f-b689-4cba-a9a1-97dbdf383795 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:03.610007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6823499f-b689-4cba-a9a1-97dbdf383795 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:03.610440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6823499f-b689-4cba-a9a1-97dbdf383795 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:03.611122 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6823499f-b689-4cba-a9a1-97dbdf383795 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:03.611570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6823499f-b689-4cba-a9a1-97dbdf383795 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:03.611992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6823499f-b689-4cba-a9a1-97dbdf383795 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:03.625688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-6823499f-b689-4cba-a9a1-97dbdf383795 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6823499f-b689-4cba-a9a1-97dbdf383795 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 HTTP/1.1 Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:53:03.627192 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:53:03.629007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:53:03.629007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:03.629007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:03.629007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:03.629007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:03.629007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:53:03.629007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:53:03.629007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:53:03.629007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:03.629007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:53:03.629007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:53:03.629007 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '3b8c72a0-5954-458b-a788-dffd785ca110'} Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:53:03.630080 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. Sep 01 05:53:03.631781 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.633472 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6823499f-b689-4cba-a9a1-97dbdf383795 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 404 to user: Instance 3b8c72a0-5954-458b-a788-dffd785ca110 could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:53:03.633472 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6823499f-b689-4cba-a9a1-97dbdf383795 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110" status: 404 len: 111 microversion: 2.1 time: 0.031074 Sep 01 05:53:03.633472 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1437/2789] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:03 2022] GET /compute/v2.1/servers/3b8c72a0-5954-458b-a788-dffd785ca110 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:53:03.637424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-63c6940f-c129-4b23-b665-308b4ebf69ae tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:03.637923 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-63c6940f-c129-4b23-b665-308b4ebf69ae tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:03.644011 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-63c6940f-c129-4b23-b665-308b4ebf69ae tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:03.644497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-63c6940f-c129-4b23-b665-308b4ebf69ae tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:03.644969 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-63c6940f-c129-4b23-b665-308b4ebf69ae tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:03.645669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-63c6940f-c129-4b23-b665-308b4ebf69ae tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:03.646110 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-63c6940f-c129-4b23-b665-308b4ebf69ae tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:03.646540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-63c6940f-c129-4b23-b665-308b4ebf69ae tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:03.660824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-63c6940f-c129-4b23-b665-308b4ebf69ae tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-63c6940f-c129-4b23-b665-308b4ebf69ae tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 HTTP/1.1 Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:53:03.662355 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:53:03.664160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:53:03.664160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:03.664160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:03.664160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:03.664160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:03.664160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:53:03.664160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:53:03.664160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:53:03.664160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:03.664160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:53:03.664160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:53:03.664160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '4f3547e7-63de-4df8-87bf-60a4f05a9e28'} Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:53:03.665226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:53:03.667731 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.669577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-63c6940f-c129-4b23-b665-308b4ebf69ae tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 404 to user: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:53:03.669577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-63c6940f-c129-4b23-b665-308b4ebf69ae tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 404 len: 111 microversion: 2.1 time: 0.030644 Sep 01 05:53:03.669577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1353/2790] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:53:03 2022] DELETE /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:53:03.673063 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-87fb8b08-789c-4f58-864c-3f573f570964 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:03.673678 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-87fb8b08-789c-4f58-864c-3f573f570964 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 4f3547e7-63de-4df8-87bf-60a4f05a9e28] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:03.679610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87fb8b08-789c-4f58-864c-3f573f570964 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:03.680096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87fb8b08-789c-4f58-864c-3f573f570964 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:03.680528 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87fb8b08-789c-4f58-864c-3f573f570964 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:03.681764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87fb8b08-789c-4f58-864c-3f573f570964 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:03.682212 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87fb8b08-789c-4f58-864c-3f573f570964 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:03.682632 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-87fb8b08-789c-4f58-864c-3f573f570964 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:03.695623 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-87fb8b08-789c-4f58-864c-3f573f570964 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-87fb8b08-789c-4f58-864c-3f573f570964 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 HTTP/1.1 Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:53:03.697742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:53:03.699681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:53:03.699681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:03.699681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:03.699681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:03.699681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:03.699681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:53:03.699681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:53:03.699681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:53:03.699681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:03.699681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:53:03.699681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:53:03.699681 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '4f3547e7-63de-4df8-87bf-60a4f05a9e28'} Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:53:03.700693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. Sep 01 05:53:03.702386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:03.703871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-87fb8b08-789c-4f58-864c-3f573f570964 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 404 to user: Instance 4f3547e7-63de-4df8-87bf-60a4f05a9e28 could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:53:03.703871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-87fb8b08-789c-4f58-864c-3f573f570964 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28" status: 404 len: 111 microversion: 2.1 time: 0.029790 Sep 01 05:53:03.703871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1438/2791] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:03 2022] GET /compute/v2.1/servers/4f3547e7-63de-4df8-87bf-60a4f05a9e28 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:53:04.848237 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b8b37fe4-b1bc-416a-a9b5-d3e551612305 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:04.848718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b8b37fe4-b1bc-416a-a9b5-d3e551612305 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:04.855417 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8b37fe4-b1bc-416a-a9b5-d3e551612305 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:04.855903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8b37fe4-b1bc-416a-a9b5-d3e551612305 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:04.856335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8b37fe4-b1bc-416a-a9b5-d3e551612305 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:04.857042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8b37fe4-b1bc-416a-a9b5-d3e551612305 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:04.857616 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8b37fe4-b1bc-416a-a9b5-d3e551612305 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:04.858035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b8b37fe4-b1bc-416a-a9b5-d3e551612305 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:04.872548 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-b8b37fe4-b1bc-416a-a9b5-d3e551612305 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b8b37fe4-b1bc-416a-a9b5-d3e551612305 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 HTTP/1.1 Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:53:04.874138 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:53:04.875987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:53:04.875987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:04.875987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:04.875987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:04.875987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:04.875987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:53:04.875987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:53:04.875987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:53:04.875987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:04.875987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:53:04.875987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:53:04.875987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '58be5ab6-9a40-44cb-a30a-bbdea2a55083'} Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:53:04.877143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:53:04.879238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:53:04.880956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b8b37fe4-b1bc-416a-a9b5-d3e551612305 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 404 to user: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:53:04.880956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b8b37fe4-b1bc-416a-a9b5-d3e551612305 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "DELETE /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 404 len: 111 microversion: 2.1 time: 0.031174 Sep 01 05:53:04.880956 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1354/2792] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:53:04 2022] DELETE /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:53:04.883787 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-64306405-7a68-4818-9085-c84270984301 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:04.885050 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-64306405-7a68-4818-9085-c84270984301 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] [instance: 58be5ab6-9a40-44cb-a30a-bbdea2a55083] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:04.891387 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-64306405-7a68-4818-9085-c84270984301 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:04.891842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-64306405-7a68-4818-9085-c84270984301 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:04.892273 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-64306405-7a68-4818-9085-c84270984301 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:04.893003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-64306405-7a68-4818-9085-c84270984301 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:04.893452 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-64306405-7a68-4818-9085-c84270984301 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:04.893874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-64306405-7a68-4818-9085-c84270984301 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:04.908231 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-64306405-7a68-4818-9085-c84270984301 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] HTTP exception thrown: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-64306405-7a68-4818-9085-c84270984301 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Request method failure captured: Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 HTTP/1.1 Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjEEYmvulvJGE5eP0ui0AEMDzaQ7pIPhKv5eEANgtcDJNDOanJfAXjFUIaG4OKKCDtdsV1pHDRgO_v7MPXJlbs9sKjUezPhlfX38Xo3ccPmw8GTql7DPDzQUK9LmYIHPLfHFiUvwyr1GXqBXEM39MS-c-czcNwujAqGLF9bfxpc7SrcgI Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:53:04.909773 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:53:04.911635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_206f93c129394a4badf489d8c7c45b16", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/206f93c129394a4badf489d8c7c45b16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/206f93c129394a4badf489d8c7c45b16"}]}] Sep 01 05:53:04.911635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:04.911635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 206f93c129394a4badf489d8c7c45b16 Sep 01 05:53:04.911635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-711482259 Sep 01 05:53:04.911635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:04.911635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:53:04.911635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:53:04.911635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: 2e8c9e2056464b9299ff765507323869 Sep 01 05:53:04.911635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeNegativeTest-711482259-project Sep 01 05:53:04.911635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:53:04.911635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:53:04.911635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '58be5ab6-9a40-44cb-a30a-bbdea2a55083'} Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:53:04.912716 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. Sep 01 05:53:04.914465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:53:04.916012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-64306405-7a68-4818-9085-c84270984301 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] Returning 404 to user: Instance 58be5ab6-9a40-44cb-a30a-bbdea2a55083 could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:53:04.916012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-64306405-7a68-4818-9085-c84270984301 tempest-AttachVolumeNegativeTest-711482259 tempest-AttachVolumeNegativeTest-711482259-project] 10.222.0.49 "GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083" status: 404 len: 111 microversion: 2.1 time: 0.031143 Sep 01 05:53:04.916012 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1439/2793] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:04 2022] GET /compute/v2.1/servers/58be5ab6-9a40-44cb-a30a-bbdea2a55083 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:53:35.348837 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=20 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:35.349637 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:35.350761 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:53:35.350909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:53:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.49) !!! Sep 01 05:53:35.556945 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a291c73c-c8f5-4604-bb9e-b4337d157eb7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Action: 'create', calling method: .version_select at 0x7f9624cb8310>, body: {"keypair": {"name": "tempest-TestShelveInstance-161312406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImTUpLslwWfZ6YIxflvdMqQIV/sjYQSqQgHnGzhCIln4clT5ix2J/F92bf1Ma98sNAxWU6uzjjcGhLoHIQLgdjjyIclBiv8b5+jdSllq5OIn0ZP5fEccRXMmr2Xf0NwGw=="}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:53:35.573025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-a291c73c-c8f5-4604-bb9e-b4337d157eb7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Getting quotas for project b74da291ec0049c3aeb42c0a93568a1c. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:53:35.576936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-a291c73c-c8f5-4604-bb9e-b4337d157eb7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Getting quotas for user 7999781239dc41e4b8fb9ac9e317eff4 and project b74da291ec0049c3aeb42c0a93568a1c. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:53:35.601280 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a291c73c-c8f5-4604-bb9e-b4337d157eb7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.257761 Sep 01 05:53:35.602977 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1355/2794] 10.222.0.49 () {60 vars in 1159 bytes} [Thu Sep 1 05:53:35 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:53:51.817723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-815184414", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-161312406", "security_groups": [{"name": "tempest-secgroup-smoke-224843472"}], "networks": [{"uuid": "097e19cd-049f-42f4-a6d3-2e14afdadd64"}], "block_device_mapping_v2": [{"uuid": "77ad7365-b573-4b6c-a0e7-a05e50853dab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:53:51.828605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:51.829216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:51.937673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.network.neutron [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] validate_networks() for [('097e19cd-049f-42f4-a6d3-2e14afdadd64', None, None, None, None, None)] {{(pid=120673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:53:52.302157 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Flavor limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:53:52.302578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Image limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:53:52.303047 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Flavor pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:53:52.303448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Image pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:53:52.303849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:53:52.312593 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:52.313092 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:52.313516 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:52.314221 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:52.314664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:52.315076 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:52.331609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Getting quotas for project b74da291ec0049c3aeb42c0a93568a1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:53:52.335491 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Getting quotas for user 7999781239dc41e4b8fb9ac9e317eff4 and project b74da291ec0049c3aeb42c0a93568a1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:53:52.391752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Going to run 1 instances... {{(pid=120673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:53:52.393951 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77ad7365-b573-4b6c-a0e7-a05e50853dab',volume_size=None,volume_type=None)] {{(pid=120673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:53:52.525661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-6d0be488-8933-486d-a181-4eb94202106b tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.711730 Sep 01 05:53:52.526480 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1440/2795] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:53:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:53:52.537579 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0d9d0d9e-b550-41cf-a2f2-e1ae03b76f29 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:52.538191 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0d9d0d9e-b550-41cf-a2f2-e1ae03b76f29 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:52.540125 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=4 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:52.540965 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:52.597378 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0d9d0d9e-b550-41cf-a2f2-e1ae03b76f29 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:52.604346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0d9d0d9e-b550-41cf-a2f2-e1ae03b76f29 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1087 microversion: 2.1 time: 0.070721 Sep 01 05:53:52.604937 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1356/2796] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:52 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:53.626509 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4e602dc5-7539-404f-a7d9-b133805a4809 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:53.627246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4e602dc5-7539-404f-a7d9-b133805a4809 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:53.634068 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4e602dc5-7539-404f-a7d9-b133805a4809 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:53.634549 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4e602dc5-7539-404f-a7d9-b133805a4809 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:53.634975 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4e602dc5-7539-404f-a7d9-b133805a4809 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:53.635764 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4e602dc5-7539-404f-a7d9-b133805a4809 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:53.636740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4e602dc5-7539-404f-a7d9-b133805a4809 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:53.636740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4e602dc5-7539-404f-a7d9-b133805a4809 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:53.703931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4e602dc5-7539-404f-a7d9-b133805a4809 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:53.715548 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4e602dc5-7539-404f-a7d9-b133805a4809 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1203 microversion: 2.1 time: 0.094360 Sep 01 05:53:53.716114 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1441/2797] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:53 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1203 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:54.737856 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9704b623-ad18-443e-9268-00c2fe9788ba tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:54.738472 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9704b623-ad18-443e-9268-00c2fe9788ba tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:54.745129 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9704b623-ad18-443e-9268-00c2fe9788ba tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:54.745646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9704b623-ad18-443e-9268-00c2fe9788ba tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:54.746081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9704b623-ad18-443e-9268-00c2fe9788ba tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:54.746773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9704b623-ad18-443e-9268-00c2fe9788ba tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:54.747226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9704b623-ad18-443e-9268-00c2fe9788ba tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:54.747656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9704b623-ad18-443e-9268-00c2fe9788ba tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:54.870566 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-5001ab9a-c841-4ef6-8aa2-e641efdf17bf req-d114d060-fd81-452b-8d4e-6fd45aa32633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1cc4b4-8166-429a-ad7d-b554723f7fae", "tag": "4142f652-8a3d-4782-91c3-8dd9e2166b2c"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:53:54.883977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-5001ab9a-c841-4ef6-8aa2-e641efdf17bf req-d114d060-fd81-452b-8d4e-6fd45aa32633 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:54.884552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-5001ab9a-c841-4ef6-8aa2-e641efdf17bf req-d114d060-fd81-452b-8d4e-6fd45aa32633 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:54.885060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-5001ab9a-c841-4ef6-8aa2-e641efdf17bf req-d114d060-fd81-452b-8d4e-6fd45aa32633 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:54.900494 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-5001ab9a-c841-4ef6-8aa2-e641efdf17bf req-d114d060-fd81-452b-8d4e-6fd45aa32633 service nova] Creating event network-changed:4142f652-8a3d-4782-91c3-8dd9e2166b2c for instance ca1cc4b4-8166-429a-ad7d-b554723f7fae on hv-cinder-85391 Sep 01 05:53:54.905894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-5001ab9a-c841-4ef6-8aa2-e641efdf17bf req-d114d060-fd81-452b-8d4e-6fd45aa32633 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039348 Sep 01 05:53:54.906504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1442/2798] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:53:54.992724 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9704b623-ad18-443e-9268-00c2fe9788ba tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:55.001031 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9704b623-ad18-443e-9268-00c2fe9788ba tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1258 microversion: 2.1 time: 0.266954 Sep 01 05:53:55.001610 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1357/2799] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:54 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1258 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:56.022664 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-2d120907-d22f-4c01-94b6-8e6952cc12cf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:56.023393 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-2d120907-d22f-4c01-94b6-8e6952cc12cf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:56.030079 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d120907-d22f-4c01-94b6-8e6952cc12cf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:56.030885 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d120907-d22f-4c01-94b6-8e6952cc12cf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:56.031331 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d120907-d22f-4c01-94b6-8e6952cc12cf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:56.032015 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d120907-d22f-4c01-94b6-8e6952cc12cf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:56.032462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d120907-d22f-4c01-94b6-8e6952cc12cf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:56.032915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-2d120907-d22f-4c01-94b6-8e6952cc12cf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:56.168525 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-2d120907-d22f-4c01-94b6-8e6952cc12cf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:56.176691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-2d120907-d22f-4c01-94b6-8e6952cc12cf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1258 microversion: 2.1 time: 0.158497 Sep 01 05:53:56.177281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1443/2800] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:56 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:53:57.198025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c7d6340a-1431-4d1c-87d8-6ff0cfc8a7b7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:57.198646 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c7d6340a-1431-4d1c-87d8-6ff0cfc8a7b7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:57.205979 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c7d6340a-1431-4d1c-87d8-6ff0cfc8a7b7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:57.206465 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c7d6340a-1431-4d1c-87d8-6ff0cfc8a7b7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:57.206902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c7d6340a-1431-4d1c-87d8-6ff0cfc8a7b7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:57.207619 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c7d6340a-1431-4d1c-87d8-6ff0cfc8a7b7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:57.208081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c7d6340a-1431-4d1c-87d8-6ff0cfc8a7b7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:57.208514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c7d6340a-1431-4d1c-87d8-6ff0cfc8a7b7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:57.587669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c7d6340a-1431-4d1c-87d8-6ff0cfc8a7b7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:57.596085 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c7d6340a-1431-4d1c-87d8-6ff0cfc8a7b7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1258 microversion: 2.1 time: 0.401910 Sep 01 05:53:57.596669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1358/2801] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:57 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1258 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:58.617625 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-97ecc70d-c6cc-49df-af98-a7b85e5cf7a8 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:58.618239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-97ecc70d-c6cc-49df-af98-a7b85e5cf7a8 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:58.625333 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97ecc70d-c6cc-49df-af98-a7b85e5cf7a8 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:58.625817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97ecc70d-c6cc-49df-af98-a7b85e5cf7a8 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:58.626250 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97ecc70d-c6cc-49df-af98-a7b85e5cf7a8 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:58.626931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97ecc70d-c6cc-49df-af98-a7b85e5cf7a8 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:58.627382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97ecc70d-c6cc-49df-af98-a7b85e5cf7a8 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:58.627803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97ecc70d-c6cc-49df-af98-a7b85e5cf7a8 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:58.757801 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-97ecc70d-c6cc-49df-af98-a7b85e5cf7a8 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:58.765590 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-97ecc70d-c6cc-49df-af98-a7b85e5cf7a8 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1258 microversion: 2.1 time: 0.151880 Sep 01 05:53:58.766166 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1444/2802] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:58 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:59.786935 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-ff3a3372-ebce-4f47-8401-3eafc034b512 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:59.787547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-ff3a3372-ebce-4f47-8401-3eafc034b512 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:59.794382 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff3a3372-ebce-4f47-8401-3eafc034b512 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:59.794864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff3a3372-ebce-4f47-8401-3eafc034b512 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:59.795301 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff3a3372-ebce-4f47-8401-3eafc034b512 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:59.796878 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff3a3372-ebce-4f47-8401-3eafc034b512 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:59.797336 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff3a3372-ebce-4f47-8401-3eafc034b512 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:59.797759 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-ff3a3372-ebce-4f47-8401-3eafc034b512 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:59.926950 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-ff3a3372-ebce-4f47-8401-3eafc034b512 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:59.934870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-ff3a3372-ebce-4f47-8401-3eafc034b512 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1258 microversion: 2.1 time: 0.151814 Sep 01 05:53:59.935432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1359/2803] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:59 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:00.957281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-65590905-06bb-45cc-9e3b-d777dbe561fa tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:00.957889 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-65590905-06bb-45cc-9e3b-d777dbe561fa tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:00.964209 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65590905-06bb-45cc-9e3b-d777dbe561fa tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:00.964688 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65590905-06bb-45cc-9e3b-d777dbe561fa tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:00.965153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65590905-06bb-45cc-9e3b-d777dbe561fa tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:00.965821 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65590905-06bb-45cc-9e3b-d777dbe561fa tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:00.966263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65590905-06bb-45cc-9e3b-d777dbe561fa tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:00.966672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-65590905-06bb-45cc-9e3b-d777dbe561fa tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:01.100093 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-65590905-06bb-45cc-9e3b-d777dbe561fa tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:01.107775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-65590905-06bb-45cc-9e3b-d777dbe561fa tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1258 microversion: 2.1 time: 0.154342 Sep 01 05:54:01.108423 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1445/2804] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:00 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:02.127912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d0f4ee61-954b-427f-88b7-11eccc0abf6a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:02.128547 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d0f4ee61-954b-427f-88b7-11eccc0abf6a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:02.134877 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0f4ee61-954b-427f-88b7-11eccc0abf6a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:02.135346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0f4ee61-954b-427f-88b7-11eccc0abf6a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:02.135772 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0f4ee61-954b-427f-88b7-11eccc0abf6a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:02.136437 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0f4ee61-954b-427f-88b7-11eccc0abf6a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:02.136923 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0f4ee61-954b-427f-88b7-11eccc0abf6a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:02.137338 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d0f4ee61-954b-427f-88b7-11eccc0abf6a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:02.270007 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d0f4ee61-954b-427f-88b7-11eccc0abf6a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:02.278485 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d0f4ee61-954b-427f-88b7-11eccc0abf6a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1258 microversion: 2.1 time: 0.154482 Sep 01 05:54:02.279044 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1360/2805] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:02 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:03.299732 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1522e936-ea41-493f-8aae-7752e1448231 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:03.300349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1522e936-ea41-493f-8aae-7752e1448231 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:03.302804 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:03.303605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=6 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:03.309499 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1522e936-ea41-493f-8aae-7752e1448231 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:03.309975 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1522e936-ea41-493f-8aae-7752e1448231 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:03.310401 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1522e936-ea41-493f-8aae-7752e1448231 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:03.311608 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1522e936-ea41-493f-8aae-7752e1448231 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:03.312054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1522e936-ea41-493f-8aae-7752e1448231 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:03.312540 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1522e936-ea41-493f-8aae-7752e1448231 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:03.442180 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1522e936-ea41-493f-8aae-7752e1448231 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:03.449873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1522e936-ea41-493f-8aae-7752e1448231 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1258 microversion: 2.1 time: 0.154260 Sep 01 05:54:03.450442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1446/2806] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:03 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:54:04.471414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7979058e-2726-4614-9d09-2d7c85c7ab16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:04.472051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7979058e-2726-4614-9d09-2d7c85c7ab16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:04.473989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:04.480126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7979058e-2726-4614-9d09-2d7c85c7ab16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:04.480608 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7979058e-2726-4614-9d09-2d7c85c7ab16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:04.481069 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7979058e-2726-4614-9d09-2d7c85c7ab16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:04.481748 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7979058e-2726-4614-9d09-2d7c85c7ab16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:04.482200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7979058e-2726-4614-9d09-2d7c85c7ab16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:04.482621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7979058e-2726-4614-9d09-2d7c85c7ab16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:04.612412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7979058e-2726-4614-9d09-2d7c85c7ab16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:04.620046 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7979058e-2726-4614-9d09-2d7c85c7ab16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1258 microversion: 2.1 time: 0.152771 Sep 01 05:54:04.620609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1361/2807] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:04 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:05.109851 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-b1f3f258-6200-49e1-851a-7af7c4ea9be0 req-ba88d758-064c-4aaa-b01c-ea17d271d848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1cc4b4-8166-429a-ad7d-b554723f7fae", "name": "network-vif-plugged", "status": "completed", "tag": "4142f652-8a3d-4782-91c3-8dd9e2166b2c"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:54:05.120898 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-b1f3f258-6200-49e1-851a-7af7c4ea9be0 req-ba88d758-064c-4aaa-b01c-ea17d271d848 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:05.121301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-b1f3f258-6200-49e1-851a-7af7c4ea9be0 req-ba88d758-064c-4aaa-b01c-ea17d271d848 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:05.121722 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-b1f3f258-6200-49e1-851a-7af7c4ea9be0 req-ba88d758-064c-4aaa-b01c-ea17d271d848 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:05.133140 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-b1f3f258-6200-49e1-851a-7af7c4ea9be0 req-ba88d758-064c-4aaa-b01c-ea17d271d848 service nova] Creating event network-vif-plugged:4142f652-8a3d-4782-91c3-8dd9e2166b2c for instance ca1cc4b4-8166-429a-ad7d-b554723f7fae on hv-cinder-85391 Sep 01 05:54:05.138216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-b1f3f258-6200-49e1-851a-7af7c4ea9be0 req-ba88d758-064c-4aaa-b01c-ea17d271d848 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032108 Sep 01 05:54:05.139672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1447/2808] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:54:05.642012 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e4bdadbf-11c4-48f0-bcde-a53f1a2d18d9 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:05.642618 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e4bdadbf-11c4-48f0-bcde-a53f1a2d18d9 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:05.649256 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4bdadbf-11c4-48f0-bcde-a53f1a2d18d9 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:05.649730 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4bdadbf-11c4-48f0-bcde-a53f1a2d18d9 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:05.650155 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4bdadbf-11c4-48f0-bcde-a53f1a2d18d9 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:05.650824 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4bdadbf-11c4-48f0-bcde-a53f1a2d18d9 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:05.651266 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4bdadbf-11c4-48f0-bcde-a53f1a2d18d9 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:05.651681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e4bdadbf-11c4-48f0-bcde-a53f1a2d18d9 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:05.779211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-e4bdadbf-11c4-48f0-bcde-a53f1a2d18d9 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:05.787210 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e4bdadbf-11c4-48f0-bcde-a53f1a2d18d9 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1258 microversion: 2.1 time: 0.149642 Sep 01 05:54:05.787797 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1362/2809] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:05 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:06.809113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-4f13c0d5-ba29-43fa-b4b2-776c4c5c0dbf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:06.809723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-4f13c0d5-ba29-43fa-b4b2-776c4c5c0dbf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:06.816551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f13c0d5-ba29-43fa-b4b2-776c4c5c0dbf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:06.817064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f13c0d5-ba29-43fa-b4b2-776c4c5c0dbf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:06.817492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f13c0d5-ba29-43fa-b4b2-776c4c5c0dbf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:06.818187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f13c0d5-ba29-43fa-b4b2-776c4c5c0dbf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:06.818628 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f13c0d5-ba29-43fa-b4b2-776c4c5c0dbf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:06.819044 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-4f13c0d5-ba29-43fa-b4b2-776c4c5c0dbf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:06.949654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-4f13c0d5-ba29-43fa-b4b2-776c4c5c0dbf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:06.958382 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-4f13c0d5-ba29-43fa-b4b2-776c4c5c0dbf tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1443 microversion: 2.1 time: 0.153566 Sep 01 05:54:06.958940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1448/2810] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:06 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:06.978754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-0bc879ac-d52e-4d1c-adb6-b43553c7f872 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:06.979372 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-0bc879ac-d52e-4d1c-adb6-b43553c7f872 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:06.985883 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0bc879ac-d52e-4d1c-adb6-b43553c7f872 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:06.986367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0bc879ac-d52e-4d1c-adb6-b43553c7f872 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:06.986805 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0bc879ac-d52e-4d1c-adb6-b43553c7f872 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:06.987489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0bc879ac-d52e-4d1c-adb6-b43553c7f872 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:06.987951 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0bc879ac-d52e-4d1c-adb6-b43553c7f872 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:06.988374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-0bc879ac-d52e-4d1c-adb6-b43553c7f872 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:07.116112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-0bc879ac-d52e-4d1c-adb6-b43553c7f872 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:07.124414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-0bc879ac-d52e-4d1c-adb6-b43553c7f872 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1443 microversion: 2.1 time: 0.149451 Sep 01 05:54:07.125015 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1363/2811] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:06 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:08.810206 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [req-6a15ef45-4fe8-4a6f-9205-157634bd073a req-f74421bb-8654-4e57-875e-1dd5ec9d65e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1cc4b4-8166-429a-ad7d-b554723f7fae", "tag": "4142f652-8a3d-4782-91c3-8dd9e2166b2c"}]} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:54:08.820071 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-6a15ef45-4fe8-4a6f-9205-157634bd073a req-f74421bb-8654-4e57-875e-1dd5ec9d65e8 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:08.820877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-6a15ef45-4fe8-4a6f-9205-157634bd073a req-f74421bb-8654-4e57-875e-1dd5ec9d65e8 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:08.821309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [req-6a15ef45-4fe8-4a6f-9205-157634bd073a req-f74421bb-8654-4e57-875e-1dd5ec9d65e8 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:08.832739 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.compute.server_external_events [req-6a15ef45-4fe8-4a6f-9205-157634bd073a req-f74421bb-8654-4e57-875e-1dd5ec9d65e8 service nova] Creating event network-changed:4142f652-8a3d-4782-91c3-8dd9e2166b2c for instance ca1cc4b4-8166-429a-ad7d-b554723f7fae on hv-cinder-85391 Sep 01 05:54:08.837635 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [req-6a15ef45-4fe8-4a6f-9205-157634bd073a req-f74421bb-8654-4e57-875e-1dd5ec9d65e8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031168 Sep 01 05:54:08.838288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1449/2812] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:03.904498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=18 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:03.905282 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=42 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:03.906589 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:56:03.906736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae/action (ip 10.222.0.49) !!! Sep 01 05:56:03.908343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:56:03.908343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae/action (ip 10.222.0.49) !!! Sep 01 05:56:03.914229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-4d91a7fa-a2df-4146-9a30-756c16774336 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:03.914519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-4d91a7fa-a2df-4146-9a30-756c16774336 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:03.923268 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d91a7fa-a2df-4146-9a30-756c16774336 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:03.923759 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d91a7fa-a2df-4146-9a30-756c16774336 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:03.924193 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d91a7fa-a2df-4146-9a30-756c16774336 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:03.924909 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d91a7fa-a2df-4146-9a30-756c16774336 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:03.925360 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d91a7fa-a2df-4146-9a30-756c16774336 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:03.925784 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-4d91a7fa-a2df-4146-9a30-756c16774336 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:03.949598 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.objects.instance [None req-4d91a7fa-a2df-4146-9a30-756c16774336 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lazy-loading 'flavor' on Instance uuid ca1cc4b4-8166-429a-ad7d-b554723f7fae {{(pid=120674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:56:04.023907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-4d91a7fa-a2df-4146-9a30-756c16774336 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "POST /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae/action" status: 202 len: 0 microversion: 2.1 time: 0.120872 Sep 01 05:56:04.024490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1364/2813] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:56:03 2022] POST /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:56:04.034289 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed62eb87-dc53-466a-a89e-de9ffa3084ff] AMQP server on 10.222.0.49:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 01 05:56:04.034884 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:04.035719 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=44 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:04.036620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:56:04.036808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Thu Sep 1 05:56:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae (ip 10.222.0.49) !!! Sep 01 05:56:04.051113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1bc387f4-fc00-4064-bec5-2f57b3639ef0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:04.052527 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1bc387f4-fc00-4064-bec5-2f57b3639ef0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:04.060338 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1bc387f4-fc00-4064-bec5-2f57b3639ef0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:04.060880 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1bc387f4-fc00-4064-bec5-2f57b3639ef0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:04.061310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1bc387f4-fc00-4064-bec5-2f57b3639ef0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:04.062046 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1bc387f4-fc00-4064-bec5-2f57b3639ef0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:04.063251 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1bc387f4-fc00-4064-bec5-2f57b3639ef0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:04.063670 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1bc387f4-fc00-4064-bec5-2f57b3639ef0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:04.267501 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-1bc387f4-fc00-4064-bec5-2f57b3639ef0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:04.275498 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1bc387f4-fc00-4064-bec5-2f57b3639ef0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1567 microversion: 2.1 time: 0.245571 Sep 01 05:56:04.276066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1450/2814] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:04 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:05.298592 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c04843da-5e85-4cd7-9fd1-ea50dec1bf6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:05.299307 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c04843da-5e85-4cd7-9fd1-ea50dec1bf6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:05.305621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c04843da-5e85-4cd7-9fd1-ea50dec1bf6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:05.306105 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c04843da-5e85-4cd7-9fd1-ea50dec1bf6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:05.306560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c04843da-5e85-4cd7-9fd1-ea50dec1bf6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:05.307262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c04843da-5e85-4cd7-9fd1-ea50dec1bf6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:05.307701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c04843da-5e85-4cd7-9fd1-ea50dec1bf6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:05.308120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c04843da-5e85-4cd7-9fd1-ea50dec1bf6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:05.491749 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c04843da-5e85-4cd7-9fd1-ea50dec1bf6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:05.499454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c04843da-5e85-4cd7-9fd1-ea50dec1bf6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1567 microversion: 2.1 time: 0.205629 Sep 01 05:56:05.500668 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1365/2815] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:05 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:06.522127 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-97046110-9228-4a82-bb3c-d67c838a88f5 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:06.522723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-97046110-9228-4a82-bb3c-d67c838a88f5 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:06.530288 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97046110-9228-4a82-bb3c-d67c838a88f5 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:06.531433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97046110-9228-4a82-bb3c-d67c838a88f5 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:06.531872 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97046110-9228-4a82-bb3c-d67c838a88f5 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:06.532559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97046110-9228-4a82-bb3c-d67c838a88f5 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:06.533037 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97046110-9228-4a82-bb3c-d67c838a88f5 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:06.533459 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-97046110-9228-4a82-bb3c-d67c838a88f5 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:06.538611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed62eb87-dc53-466a-a89e-de9ffa3084ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38568. Sep 01 05:56:06.665163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-97046110-9228-4a82-bb3c-d67c838a88f5 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:06.673222 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-97046110-9228-4a82-bb3c-d67c838a88f5 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1567 microversion: 2.1 time: 0.155227 Sep 01 05:56:06.673790 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1451/2816] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:06 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:07.694126 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-dce43106-4685-41e6-a20a-0926db9a8a64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:07.694758 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-dce43106-4685-41e6-a20a-0926db9a8a64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:07.701080 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dce43106-4685-41e6-a20a-0926db9a8a64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:07.701558 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dce43106-4685-41e6-a20a-0926db9a8a64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:07.701983 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dce43106-4685-41e6-a20a-0926db9a8a64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:07.702781 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dce43106-4685-41e6-a20a-0926db9a8a64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:07.703339 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dce43106-4685-41e6-a20a-0926db9a8a64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:07.703757 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-dce43106-4685-41e6-a20a-0926db9a8a64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:07.833879 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-dce43106-4685-41e6-a20a-0926db9a8a64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:07.841494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-dce43106-4685-41e6-a20a-0926db9a8a64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1567 microversion: 2.1 time: 0.151350 Sep 01 05:56:07.842051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1366/2817] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:07 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:08.862784 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-035ae47e-302a-48f7-956d-a4c527b8a6f0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:08.863339 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-035ae47e-302a-48f7-956d-a4c527b8a6f0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:08.869603 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-035ae47e-302a-48f7-956d-a4c527b8a6f0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:08.870070 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-035ae47e-302a-48f7-956d-a4c527b8a6f0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:08.870492 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-035ae47e-302a-48f7-956d-a4c527b8a6f0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:08.871153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-035ae47e-302a-48f7-956d-a4c527b8a6f0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:08.871595 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-035ae47e-302a-48f7-956d-a4c527b8a6f0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:08.872010 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-035ae47e-302a-48f7-956d-a4c527b8a6f0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:09.005117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-035ae47e-302a-48f7-956d-a4c527b8a6f0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:09.012786 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-035ae47e-302a-48f7-956d-a4c527b8a6f0 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1567 microversion: 2.1 time: 0.154447 Sep 01 05:56:09.013358 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1452/2818] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:08 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:10.033144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-7f7545de-2a49-4c86-a703-aecaa3bc5f06 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:10.033747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-7f7545de-2a49-4c86-a703-aecaa3bc5f06 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:10.040029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7f7545de-2a49-4c86-a703-aecaa3bc5f06 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:10.040498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7f7545de-2a49-4c86-a703-aecaa3bc5f06 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:10.040963 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7f7545de-2a49-4c86-a703-aecaa3bc5f06 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:10.041634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7f7545de-2a49-4c86-a703-aecaa3bc5f06 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:10.042082 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7f7545de-2a49-4c86-a703-aecaa3bc5f06 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:10.042494 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-7f7545de-2a49-4c86-a703-aecaa3bc5f06 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:10.173265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-7f7545de-2a49-4c86-a703-aecaa3bc5f06 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:10.180964 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-7f7545de-2a49-4c86-a703-aecaa3bc5f06 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1567 microversion: 2.1 time: 0.151819 Sep 01 05:56:10.181538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1367/2819] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:10 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:11.203824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-049b3209-735d-406f-930b-d2dc3e950e4d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:11.204389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-049b3209-735d-406f-930b-d2dc3e950e4d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:11.210708 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-049b3209-735d-406f-930b-d2dc3e950e4d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:11.211185 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-049b3209-735d-406f-930b-d2dc3e950e4d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:11.211644 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-049b3209-735d-406f-930b-d2dc3e950e4d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:11.212325 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-049b3209-735d-406f-930b-d2dc3e950e4d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:11.212793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-049b3209-735d-406f-930b-d2dc3e950e4d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:11.213220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-049b3209-735d-406f-930b-d2dc3e950e4d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:11.344996 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-049b3209-735d-406f-930b-d2dc3e950e4d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:11.352659 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-049b3209-735d-406f-930b-d2dc3e950e4d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1567 microversion: 2.1 time: 0.153610 Sep 01 05:56:11.353255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1453/2820] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:11 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:12.372490 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2990c870-f04d-43d3-a7ad-5c68b779af64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:12.373133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2990c870-f04d-43d3-a7ad-5c68b779af64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:12.379503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2990c870-f04d-43d3-a7ad-5c68b779af64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:12.379982 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2990c870-f04d-43d3-a7ad-5c68b779af64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:12.380409 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2990c870-f04d-43d3-a7ad-5c68b779af64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:12.381114 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2990c870-f04d-43d3-a7ad-5c68b779af64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:12.381560 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2990c870-f04d-43d3-a7ad-5c68b779af64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:12.381972 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2990c870-f04d-43d3-a7ad-5c68b779af64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:12.511003 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2990c870-f04d-43d3-a7ad-5c68b779af64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:12.519285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2990c870-f04d-43d3-a7ad-5c68b779af64 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1567 microversion: 2.1 time: 0.150573 Sep 01 05:56:12.519857 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1368/2821] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:12 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:13.541204 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-33868a0a-5599-400b-b263-55f2b31fc3dc tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:13.541835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-33868a0a-5599-400b-b263-55f2b31fc3dc tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:13.548958 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33868a0a-5599-400b-b263-55f2b31fc3dc tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:13.549485 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33868a0a-5599-400b-b263-55f2b31fc3dc tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:13.549912 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33868a0a-5599-400b-b263-55f2b31fc3dc tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:13.550579 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33868a0a-5599-400b-b263-55f2b31fc3dc tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:13.551020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33868a0a-5599-400b-b263-55f2b31fc3dc tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:13.551435 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-33868a0a-5599-400b-b263-55f2b31fc3dc tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:13.682757 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-33868a0a-5599-400b-b263-55f2b31fc3dc tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:13.690626 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-33868a0a-5599-400b-b263-55f2b31fc3dc tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1567 microversion: 2.1 time: 0.153249 Sep 01 05:56:13.691183 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1454/2822] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:13 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:14.711440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c6a1f932-0a22-4210-a9a5-803d3eb5c438 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:14.712043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c6a1f932-0a22-4210-a9a5-803d3eb5c438 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:14.719222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6a1f932-0a22-4210-a9a5-803d3eb5c438 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:14.719697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6a1f932-0a22-4210-a9a5-803d3eb5c438 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:14.720127 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6a1f932-0a22-4210-a9a5-803d3eb5c438 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:14.720816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6a1f932-0a22-4210-a9a5-803d3eb5c438 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:14.721263 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6a1f932-0a22-4210-a9a5-803d3eb5c438 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:14.721678 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6a1f932-0a22-4210-a9a5-803d3eb5c438 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:14.855019 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c6a1f932-0a22-4210-a9a5-803d3eb5c438 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:14.863546 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c6a1f932-0a22-4210-a9a5-803d3eb5c438 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1567 microversion: 2.1 time: 0.155989 Sep 01 05:56:14.864120 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1369/2823] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:14 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:15.885105 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-27690a9d-9801-468e-841e-a6d4b978488f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:15.885723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-27690a9d-9801-468e-841e-a6d4b978488f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:15.892838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-27690a9d-9801-468e-841e-a6d4b978488f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:15.893322 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-27690a9d-9801-468e-841e-a6d4b978488f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:15.893748 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-27690a9d-9801-468e-841e-a6d4b978488f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:15.894426 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-27690a9d-9801-468e-841e-a6d4b978488f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:15.894871 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-27690a9d-9801-468e-841e-a6d4b978488f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:15.895285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-27690a9d-9801-468e-841e-a6d4b978488f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:16.025770 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-27690a9d-9801-468e-841e-a6d4b978488f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:16.033558 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-27690a9d-9801-468e-841e-a6d4b978488f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1567 microversion: 2.1 time: 0.152349 Sep 01 05:56:16.034118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1455/2824] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:15 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:17.054814 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fbc6bcf1-aed2-4208-9c46-6027be91cbf7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:17.055369 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fbc6bcf1-aed2-4208-9c46-6027be91cbf7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:17.061765 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fbc6bcf1-aed2-4208-9c46-6027be91cbf7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:17.062539 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fbc6bcf1-aed2-4208-9c46-6027be91cbf7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:17.063016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fbc6bcf1-aed2-4208-9c46-6027be91cbf7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:17.063694 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fbc6bcf1-aed2-4208-9c46-6027be91cbf7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:17.064149 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fbc6bcf1-aed2-4208-9c46-6027be91cbf7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:17.064570 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fbc6bcf1-aed2-4208-9c46-6027be91cbf7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:17.193773 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-fbc6bcf1-aed2-4208-9c46-6027be91cbf7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:17.201464 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fbc6bcf1-aed2-4208-9c46-6027be91cbf7 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1508 microversion: 2.1 time: 0.150649 Sep 01 05:56:17.202025 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1370/2825] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:17 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:17.222621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7a592e11-d34e-4a46-9c02-4bff28e10f38 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:17.223215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7a592e11-d34e-4a46-9c02-4bff28e10f38 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:17.229487 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7a592e11-d34e-4a46-9c02-4bff28e10f38 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:17.229962 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7a592e11-d34e-4a46-9c02-4bff28e10f38 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:17.230390 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7a592e11-d34e-4a46-9c02-4bff28e10f38 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:17.231060 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7a592e11-d34e-4a46-9c02-4bff28e10f38 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:17.231506 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7a592e11-d34e-4a46-9c02-4bff28e10f38 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:17.231923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7a592e11-d34e-4a46-9c02-4bff28e10f38 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:17.315835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7a592e11-d34e-4a46-9c02-4bff28e10f38 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120673) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:56:17.381960 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7a592e11-d34e-4a46-9c02-4bff28e10f38 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "POST /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae/action" status: 202 len: 0 microversion: 2.1 time: 0.163815 Sep 01 05:56:17.382724 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1456/2826] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:56:17 2022] POST /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:56:17.391870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5128c980-59bf-4604-87af-5f7002449aed tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:17.392631 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5128c980-59bf-4604-87af-5f7002449aed tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:17.399173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5128c980-59bf-4604-87af-5f7002449aed tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:17.399650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5128c980-59bf-4604-87af-5f7002449aed tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:17.400076 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5128c980-59bf-4604-87af-5f7002449aed tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:17.400756 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5128c980-59bf-4604-87af-5f7002449aed tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:17.401297 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5128c980-59bf-4604-87af-5f7002449aed tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:17.401741 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5128c980-59bf-4604-87af-5f7002449aed tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:17.575502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5128c980-59bf-4604-87af-5f7002449aed tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:17.584071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5128c980-59bf-4604-87af-5f7002449aed tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1516 microversion: 2.1 time: 0.197031 Sep 01 05:56:17.584605 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1371/2827] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:17 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:56:18.605940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-c7ba85f5-6206-43a9-9143-be5301e6b7a1 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:18.606674 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-c7ba85f5-6206-43a9-9143-be5301e6b7a1 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:18.613294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7ba85f5-6206-43a9-9143-be5301e6b7a1 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:18.613768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7ba85f5-6206-43a9-9143-be5301e6b7a1 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:18.614195 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7ba85f5-6206-43a9-9143-be5301e6b7a1 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:18.614892 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7ba85f5-6206-43a9-9143-be5301e6b7a1 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:18.615315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7ba85f5-6206-43a9-9143-be5301e6b7a1 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:18.615727 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-c7ba85f5-6206-43a9-9143-be5301e6b7a1 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:18.760458 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-c7ba85f5-6206-43a9-9143-be5301e6b7a1 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:18.769062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-c7ba85f5-6206-43a9-9143-be5301e6b7a1 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1518 microversion: 2.1 time: 0.167131 Sep 01 05:56:18.769610 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1457/2828] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:18 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:19.710071 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-0622c794-7bbf-4400-8876-507764ebaa9c req-76832edf-61f3-4449-ac68-918e16357e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1cc4b4-8166-429a-ad7d-b554723f7fae", "name": "network-vif-unplugged", "status": "completed", "tag": "4142f652-8a3d-4782-91c3-8dd9e2166b2c"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:19.720604 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-0622c794-7bbf-4400-8876-507764ebaa9c req-76832edf-61f3-4449-ac68-918e16357e00 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:19.721026 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-0622c794-7bbf-4400-8876-507764ebaa9c req-76832edf-61f3-4449-ac68-918e16357e00 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:19.721976 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-0622c794-7bbf-4400-8876-507764ebaa9c req-76832edf-61f3-4449-ac68-918e16357e00 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:19.737392 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-0622c794-7bbf-4400-8876-507764ebaa9c req-76832edf-61f3-4449-ac68-918e16357e00 service nova] Creating event network-vif-unplugged:4142f652-8a3d-4782-91c3-8dd9e2166b2c for instance ca1cc4b4-8166-429a-ad7d-b554723f7fae on hv-cinder-85391 Sep 01 05:56:19.742627 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-0622c794-7bbf-4400-8876-507764ebaa9c req-76832edf-61f3-4449-ac68-918e16357e00 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098009 Sep 01 05:56:19.743412 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1372/2829] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:56:19.792386 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-af2148da-34b0-4b81-b5a2-5f1419d3dc6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:19.793043 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-af2148da-34b0-4b81-b5a2-5f1419d3dc6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:19.799515 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2148da-34b0-4b81-b5a2-5f1419d3dc6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:19.800937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2148da-34b0-4b81-b5a2-5f1419d3dc6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:19.802097 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2148da-34b0-4b81-b5a2-5f1419d3dc6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:19.802835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2148da-34b0-4b81-b5a2-5f1419d3dc6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:19.803293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2148da-34b0-4b81-b5a2-5f1419d3dc6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:19.803720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-af2148da-34b0-4b81-b5a2-5f1419d3dc6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:19.936418 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-af2148da-34b0-4b81-b5a2-5f1419d3dc6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:19.945184 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-af2148da-34b0-4b81-b5a2-5f1419d3dc6f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1574 microversion: 2.1 time: 0.156587 Sep 01 05:56:19.945761 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1458/2830] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:19 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:20.969790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-badd49ff-8da9-400b-b998-2f4bb03b729f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:20.970517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-badd49ff-8da9-400b-b998-2f4bb03b729f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:20.976809 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-badd49ff-8da9-400b-b998-2f4bb03b729f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:20.977300 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-badd49ff-8da9-400b-b998-2f4bb03b729f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:20.977732 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-badd49ff-8da9-400b-b998-2f4bb03b729f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:20.978422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-badd49ff-8da9-400b-b998-2f4bb03b729f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:20.978869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-badd49ff-8da9-400b-b998-2f4bb03b729f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:20.979288 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-badd49ff-8da9-400b-b998-2f4bb03b729f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:21.115631 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-badd49ff-8da9-400b-b998-2f4bb03b729f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:21.123229 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-badd49ff-8da9-400b-b998-2f4bb03b729f tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1574 microversion: 2.1 time: 0.159797 Sep 01 05:56:21.123800 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1373/2831] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:20 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:22.144294 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-7f791b86-255a-4c3a-aa58-1ae6359e07ab tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:22.144945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-7f791b86-255a-4c3a-aa58-1ae6359e07ab tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:22.151691 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f791b86-255a-4c3a-aa58-1ae6359e07ab tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:22.152118 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f791b86-255a-4c3a-aa58-1ae6359e07ab tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:22.152553 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f791b86-255a-4c3a-aa58-1ae6359e07ab tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:22.153265 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f791b86-255a-4c3a-aa58-1ae6359e07ab tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:22.153720 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f791b86-255a-4c3a-aa58-1ae6359e07ab tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:22.154143 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-7f791b86-255a-4c3a-aa58-1ae6359e07ab tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:22.285648 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-7f791b86-255a-4c3a-aa58-1ae6359e07ab tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:22.293256 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-7f791b86-255a-4c3a-aa58-1ae6359e07ab tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1574 microversion: 2.1 time: 0.153643 Sep 01 05:56:22.293816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1459/2832] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:22 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:23.314621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c9ac069e-70ce-4498-9efb-f854896ee967 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:23.315161 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c9ac069e-70ce-4498-9efb-f854896ee967 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:23.321418 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9ac069e-70ce-4498-9efb-f854896ee967 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:23.321896 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9ac069e-70ce-4498-9efb-f854896ee967 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:23.322326 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9ac069e-70ce-4498-9efb-f854896ee967 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:23.322997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9ac069e-70ce-4498-9efb-f854896ee967 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:23.323441 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9ac069e-70ce-4498-9efb-f854896ee967 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:23.323870 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c9ac069e-70ce-4498-9efb-f854896ee967 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:23.453681 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-c9ac069e-70ce-4498-9efb-f854896ee967 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:23.461419 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c9ac069e-70ce-4498-9efb-f854896ee967 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1574 microversion: 2.1 time: 0.151296 Sep 01 05:56:23.461986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1374/2833] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:23 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:24.481672 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0a742c61-d05e-421f-a79e-446031b2ba2d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:24.482276 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0a742c61-d05e-421f-a79e-446031b2ba2d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:24.488741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a742c61-d05e-421f-a79e-446031b2ba2d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:24.489246 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a742c61-d05e-421f-a79e-446031b2ba2d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:24.489679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a742c61-d05e-421f-a79e-446031b2ba2d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:24.490349 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a742c61-d05e-421f-a79e-446031b2ba2d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:24.490808 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a742c61-d05e-421f-a79e-446031b2ba2d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:24.491205 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0a742c61-d05e-421f-a79e-446031b2ba2d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:24.620031 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0a742c61-d05e-421f-a79e-446031b2ba2d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:24.627679 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0a742c61-d05e-421f-a79e-446031b2ba2d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1574 microversion: 2.1 time: 0.149887 Sep 01 05:56:24.628234 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1460/2834] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:24 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:25.649656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-87184464-6c6c-4439-89a3-e6bf3e8cda16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:25.650267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-87184464-6c6c-4439-89a3-e6bf3e8cda16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:25.657855 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-87184464-6c6c-4439-89a3-e6bf3e8cda16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:25.658335 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-87184464-6c6c-4439-89a3-e6bf3e8cda16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:25.658769 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-87184464-6c6c-4439-89a3-e6bf3e8cda16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:25.659449 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-87184464-6c6c-4439-89a3-e6bf3e8cda16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:25.659897 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-87184464-6c6c-4439-89a3-e6bf3e8cda16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:25.660315 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-87184464-6c6c-4439-89a3-e6bf3e8cda16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:25.826436 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-87184464-6c6c-4439-89a3-e6bf3e8cda16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:25.834626 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-87184464-6c6c-4439-89a3-e6bf3e8cda16 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1574 microversion: 2.1 time: 0.189099 Sep 01 05:56:25.835196 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1375/2835] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:25 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:26.855317 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5db5d0d1-58c0-406a-8ecf-8def2459c393 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:26.855826 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5db5d0d1-58c0-406a-8ecf-8def2459c393 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:26.862861 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5db5d0d1-58c0-406a-8ecf-8def2459c393 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:26.863329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5db5d0d1-58c0-406a-8ecf-8def2459c393 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:26.863750 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5db5d0d1-58c0-406a-8ecf-8def2459c393 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:26.864448 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5db5d0d1-58c0-406a-8ecf-8def2459c393 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:26.864920 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5db5d0d1-58c0-406a-8ecf-8def2459c393 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:26.865334 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5db5d0d1-58c0-406a-8ecf-8def2459c393 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:26.999774 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5db5d0d1-58c0-406a-8ecf-8def2459c393 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:27.007670 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5db5d0d1-58c0-406a-8ecf-8def2459c393 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1561 microversion: 2.1 time: 0.156259 Sep 01 05:56:27.008236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1461/2836] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:26 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:29.744744 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-5a1c94de-8b3d-41fb-846e-cdc2bf3bc156 req-98a5aa64-6b98-47b2-9ee1-47407cde8859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1cc4b4-8166-429a-ad7d-b554723f7fae", "name": "network-vif-plugged", "status": "completed", "tag": "4142f652-8a3d-4782-91c3-8dd9e2166b2c"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:29.756099 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5a1c94de-8b3d-41fb-846e-cdc2bf3bc156 req-98a5aa64-6b98-47b2-9ee1-47407cde8859 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:29.756574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5a1c94de-8b3d-41fb-846e-cdc2bf3bc156 req-98a5aa64-6b98-47b2-9ee1-47407cde8859 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:29.757022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-5a1c94de-8b3d-41fb-846e-cdc2bf3bc156 req-98a5aa64-6b98-47b2-9ee1-47407cde8859 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:29.768843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-5a1c94de-8b3d-41fb-846e-cdc2bf3bc156 req-98a5aa64-6b98-47b2-9ee1-47407cde8859 service nova] Creating event network-vif-plugged:4142f652-8a3d-4782-91c3-8dd9e2166b2c for instance ca1cc4b4-8166-429a-ad7d-b554723f7fae on hv-cinder-85391 Sep 01 05:56:29.774234 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-5a1c94de-8b3d-41fb-846e-cdc2bf3bc156 req-98a5aa64-6b98-47b2-9ee1-47407cde8859 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033171 Sep 01 05:56:29.775291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1376/2837] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:38.028723 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:38.030715 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:38.031513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=26 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:38.033353 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:38.035220 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-bc5ac0af-e3f0-41a3-ac9c-8830fa8aeb82 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:38.035995 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bc5ac0af-e3f0-41a3-ac9c-8830fa8aeb82 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:38.051689 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc5ac0af-e3f0-41a3-ac9c-8830fa8aeb82 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:38.052210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc5ac0af-e3f0-41a3-ac9c-8830fa8aeb82 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:38.052986 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc5ac0af-e3f0-41a3-ac9c-8830fa8aeb82 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:38.053694 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc5ac0af-e3f0-41a3-ac9c-8830fa8aeb82 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:38.054171 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc5ac0af-e3f0-41a3-ac9c-8830fa8aeb82 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:38.054749 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-bc5ac0af-e3f0-41a3-ac9c-8830fa8aeb82 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:38.084341 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-bc5ac0af-e3f0-41a3-ac9c-8830fa8aeb82 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:57:38.095768 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-4f675376-f651-4e9d-af35-5437db4748e0 req-4b4b2350-54ec-49d5-a77b-4016f7a447d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1cc4b4-8166-429a-ad7d-b554723f7fae", "tag": "4142f652-8a3d-4782-91c3-8dd9e2166b2c"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:38.107093 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4f675376-f651-4e9d-af35-5437db4748e0 req-4b4b2350-54ec-49d5-a77b-4016f7a447d2 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:38.108088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4f675376-f651-4e9d-af35-5437db4748e0 req-4b4b2350-54ec-49d5-a77b-4016f7a447d2 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:38.108582 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4f675376-f651-4e9d-af35-5437db4748e0 req-4b4b2350-54ec-49d5-a77b-4016f7a447d2 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:38.120812 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-4f675376-f651-4e9d-af35-5437db4748e0 req-4b4b2350-54ec-49d5-a77b-4016f7a447d2 service nova] Creating event network-changed:4142f652-8a3d-4782-91c3-8dd9e2166b2c for instance ca1cc4b4-8166-429a-ad7d-b554723f7fae on hv-cinder-85391 Sep 01 05:57:38.126390 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-4f675376-f651-4e9d-af35-5437db4748e0 req-4b4b2350-54ec-49d5-a77b-4016f7a447d2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096766 Sep 01 05:57:38.127567 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1377/2838] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:57:38.155385 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bc5ac0af-e3f0-41a3-ac9c-8830fa8aeb82 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [5faab12b-a48f-41d4-8b61-b36139cc13bb] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:57:39.163621 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [None req-bc5ac0af-e3f0-41a3-ac9c-8830fa8aeb82 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [5faab12b-a48f-41d4-8b61-b36139cc13bb] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38840. Sep 01 05:57:39.183389 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-bc5ac0af-e3f0-41a3-ac9c-8830fa8aeb82 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 204 len: 0 microversion: 2.1 time: 1.157130 Sep 01 05:57:39.184111 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1462/2839] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 05:57:38 2022] DELETE /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 0 bytes in 1159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:57:39.193087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a48eb6d8-e37e-4cc0-98bd-bebc16dabad2 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:39.194376 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a48eb6d8-e37e-4cc0-98bd-bebc16dabad2 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:39.201823 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a48eb6d8-e37e-4cc0-98bd-bebc16dabad2 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:39.202305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a48eb6d8-e37e-4cc0-98bd-bebc16dabad2 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:39.202900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a48eb6d8-e37e-4cc0-98bd-bebc16dabad2 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:39.204144 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a48eb6d8-e37e-4cc0-98bd-bebc16dabad2 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:39.204584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a48eb6d8-e37e-4cc0-98bd-bebc16dabad2 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:39.205037 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a48eb6d8-e37e-4cc0-98bd-bebc16dabad2 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:39.349557 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a48eb6d8-e37e-4cc0-98bd-bebc16dabad2 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:39.357088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a48eb6d8-e37e-4cc0-98bd-bebc16dabad2 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1449 microversion: 2.1 time: 0.168188 Sep 01 05:57:39.357655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1378/2840] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:39 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:57:40.378642 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-9ba283b8-5012-4671-951a-6efda1536b17 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:40.379343 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-9ba283b8-5012-4671-951a-6efda1536b17 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:40.386293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ba283b8-5012-4671-951a-6efda1536b17 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:40.386766 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ba283b8-5012-4671-951a-6efda1536b17 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:40.387228 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ba283b8-5012-4671-951a-6efda1536b17 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:40.387943 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ba283b8-5012-4671-951a-6efda1536b17 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:40.388412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ba283b8-5012-4671-951a-6efda1536b17 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:40.388869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-9ba283b8-5012-4671-951a-6efda1536b17 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:40.524187 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-9ba283b8-5012-4671-951a-6efda1536b17 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:40.532139 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-9ba283b8-5012-4671-951a-6efda1536b17 tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1449 microversion: 2.1 time: 0.158571 Sep 01 05:57:40.532620 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1463/2841] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:40 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:41.202827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-9d8968c3-8845-49bb-8038-2b63a7f3ae87 req-4a23f0e1-7a00-4341-a19d-b4e594f277e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1cc4b4-8166-429a-ad7d-b554723f7fae", "name": "network-vif-deleted", "tag": "4142f652-8a3d-4782-91c3-8dd9e2166b2c"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:41.212513 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9d8968c3-8845-49bb-8038-2b63a7f3ae87 req-4a23f0e1-7a00-4341-a19d-b4e594f277e4 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:41.213042 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9d8968c3-8845-49bb-8038-2b63a7f3ae87 req-4a23f0e1-7a00-4341-a19d-b4e594f277e4 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:41.213473 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9d8968c3-8845-49bb-8038-2b63a7f3ae87 req-4a23f0e1-7a00-4341-a19d-b4e594f277e4 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:41.226403 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-9d8968c3-8845-49bb-8038-2b63a7f3ae87 req-4a23f0e1-7a00-4341-a19d-b4e594f277e4 service nova] Creating event network-vif-deleted:4142f652-8a3d-4782-91c3-8dd9e2166b2c for instance ca1cc4b4-8166-429a-ad7d-b554723f7fae on hv-cinder-85391 Sep 01 05:57:41.231323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-9d8968c3-8845-49bb-8038-2b63a7f3ae87 req-4a23f0e1-7a00-4341-a19d-b4e594f277e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094240 Sep 01 05:57:41.231905 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1379/2842] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:41.553013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:41.553630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:41.562654 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:41.563225 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:41.563666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:41.564360 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:41.564835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:41.565263 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:41.597462 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:41.597940 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:41.598383 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:41.598844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lazy-loading 'fault' on Instance uuid ca1cc4b4-8166-429a-ad7d-b554723f7fae {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:57:41.643410 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7999781239dc41e4b8fb9ac9e317eff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74da291ec0049c3aeb42c0a93568a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:41.651361 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-de998165-a3eb-45bb-af49-2a91e793a91a tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 200 len: 1223 microversion: 2.1 time: 0.102345 Sep 01 05:57:41.651933 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1464/2843] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:41 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:42.674997 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8a1e1c50-501c-42ff-ac75-8b5832eb610d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:42.675700 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8a1e1c50-501c-42ff-ac75-8b5832eb610d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] [instance: ca1cc4b4-8166-429a-ad7d-b554723f7fae] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:42.682261 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8a1e1c50-501c-42ff-ac75-8b5832eb610d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:42.682738 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8a1e1c50-501c-42ff-ac75-8b5832eb610d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:42.683167 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8a1e1c50-501c-42ff-ac75-8b5832eb610d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:42.683843 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8a1e1c50-501c-42ff-ac75-8b5832eb610d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:42.684290 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8a1e1c50-501c-42ff-ac75-8b5832eb610d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:42.684705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8a1e1c50-501c-42ff-ac75-8b5832eb610d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:42.697591 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-8a1e1c50-501c-42ff-ac75-8b5832eb610d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] HTTP exception thrown: Instance ca1cc4b4-8166-429a-ad7d-b554723f7fae could not be found. Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8a1e1c50-501c-42ff-ac75-8b5832eb610d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Request method failure captured: Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae HTTP/1.1 Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEja5ZTV2MU2Np2Q9vauI5PzjIH-bmqshU1UNhajeEe7W67C67veNxSnSRYem03yvbz5L_PKjbvW7NMwDvUfrAwFx0IILVZ92eH6AmIHRDj4oOQwC5iu121Td-CIF7ga-da3qfKTXXthrUtLfVKDP8Ic1w1g01MeufbHsMCjbKPexvA Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: b74da291ec0049c3aeb42c0a93568a1c Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-TestShelveInstance-1529829331 Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:57:42.699175 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:57:42.700379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b74da291ec0049c3aeb42c0a93568a1c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b74da291ec0049c3aeb42c0a93568a1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b74da291ec0049c3aeb42c0a93568a1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b74da291ec0049c3aeb42c0a93568a1c"}]}] Sep 01 05:57:42.700379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-TestShelveInstance-1529829331 Sep 01 05:57:42.700379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: b74da291ec0049c3aeb42c0a93568a1c Sep 01 05:57:42.700379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-TestShelveInstance-1529829331 Sep 01 05:57:42.700379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-TestShelveInstance-1529829331-project Sep 01 05:57:42.700379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:57:42.700379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:57:42.700379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 7999781239dc41e4b8fb9ac9e317eff4 Sep 01 05:57:42.700379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-TestShelveInstance-1529829331-project Sep 01 05:57:42.700379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:57:42.700379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance ca1cc4b4-8166-429a-ad7d-b554723f7fae could not be found. Sep 01 05:57:42.700379 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': 'ca1cc4b4-8166-429a-ad7d-b554723f7fae'} Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca1cc4b4-8166-429a-ad7d-b554723f7fae could not be found. Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:57:42.701047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca1cc4b4-8166-429a-ad7d-b554723f7fae could not be found. Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca1cc4b4-8166-429a-ad7d-b554723f7fae could not be found. Sep 01 05:57:42.702158 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:57:42.703047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8a1e1c50-501c-42ff-ac75-8b5832eb610d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Returning 404 to user: Instance ca1cc4b4-8166-429a-ad7d-b554723f7fae could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:57:42.703047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8a1e1c50-501c-42ff-ac75-8b5832eb610d tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae" status: 404 len: 111 microversion: 2.1 time: 0.030380 Sep 01 05:57:42.703047 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1380/2844] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:42 2022] GET /compute/v2.1/servers/ca1cc4b4-8166-429a-ad7d-b554723f7fae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:57:42.861780 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-25e5b926-5f16-4b13-9cfc-15f375e3dcfc tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] Calling method '.version_select at 0x7f96284b3af0>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:42.885043 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-25e5b926-5f16-4b13-9cfc-15f375e3dcfc tempest-TestShelveInstance-1529829331 tempest-TestShelveInstance-1529829331-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-161312406" status: 202 len: 0 microversion: 2.1 time: 0.027916 Sep 01 05:57:42.886116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1465/2845] 10.222.0.49 () {58 vars in 1251 bytes} [Thu Sep 1 05:57:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-161312406 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:57:49.882425 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1d043747-e0cf-401f-805b-dd6efd4df5e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:49.882912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-1d043747-e0cf-401f-805b-dd6efd4df5e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:49.885448 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:57:49.885597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 05:57:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf (ip 10.222.0.49) !!! Sep 01 05:57:49.902961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d043747-e0cf-401f-805b-dd6efd4df5e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:49.903454 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d043747-e0cf-401f-805b-dd6efd4df5e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:49.903895 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d043747-e0cf-401f-805b-dd6efd4df5e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:49.904594 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d043747-e0cf-401f-805b-dd6efd4df5e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:49.905084 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d043747-e0cf-401f-805b-dd6efd4df5e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:49.905540 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-1d043747-e0cf-401f-805b-dd6efd4df5e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:49.921043 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-1d043747-e0cf-401f-805b-dd6efd4df5e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] HTTP exception thrown: Instance 2a582556-d184-4047-ac19-285c0edd2fdf could not be found. Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1d043747-e0cf-401f-805b-dd6efd4df5e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Request method failure captured: Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf HTTP/1.1 Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjED-uT9bLu0AO2jZsoJR1id1NQ1Cb0kzJLLeVtKLIS_65rzdZws9Ovv2RmV7sTZOUg72U27n7c9XPjrR8Zi9BwVGJxr-gaiXu9H1X2rJ0rA3yIrcdwaDRk-9iHtkrfj-aiewxzKJNri45-Tw0_AFgfe1gAQ6OBbakIhlLRIHiEzuVkrc Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: 3a33ba1fe1ff4325b80a02053b1db739 Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 05:57:49.923298 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 05:57:49.924562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3a33ba1fe1ff4325b80a02053b1db739", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a33ba1fe1ff4325b80a02053b1db739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a33ba1fe1ff4325b80a02053b1db739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3a33ba1fe1ff4325b80a02053b1db739"}]}] Sep 01 05:57:49.924562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:57:49.924562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: 3a33ba1fe1ff4325b80a02053b1db739 Sep 01 05:57:49.924562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:57:49.924562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-AttachVolumeShelveTestJSON-2072305825-project Sep 01 05:57:49.924562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 05:57:49.924562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 05:57:49.924562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: d0b6981c4d53405fbe0395ccbcb9f015 Sep 01 05:57:49.924562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2072305825-project Sep 01 05:57:49.924562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 05:57:49.924562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance 2a582556-d184-4047-ac19-285c0edd2fdf could not be found. Sep 01 05:57:49.924562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': '2a582556-d184-4047-ac19-285c0edd2fdf'} Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a582556-d184-4047-ac19-285c0edd2fdf could not be found. Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:57:49.925222 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a582556-d184-4047-ac19-285c0edd2fdf could not be found. Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a582556-d184-4047-ac19-285c0edd2fdf could not be found. Sep 01 05:57:49.926275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 05:57:49.927262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-1d043747-e0cf-401f-805b-dd6efd4df5e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Returning 404 to user: Instance 2a582556-d184-4047-ac19-285c0edd2fdf could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:57:49.927262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-1d043747-e0cf-401f-805b-dd6efd4df5e9 tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 404 len: 111 microversion: 2.20 time: 0.046158 Sep 01 05:57:49.927262 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1381/2846] 10.222.0.49 () {60 vars in 1280 bytes} [Thu Sep 1 05:57:49 2022] DELETE /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:57:49.934584 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-911dcf08-1e6e-480f-a687-79720b74c96f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:49.935199 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-911dcf08-1e6e-480f-a687-79720b74c96f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] [instance: 2a582556-d184-4047-ac19-285c0edd2fdf] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:49.942096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-911dcf08-1e6e-480f-a687-79720b74c96f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:49.942575 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-911dcf08-1e6e-480f-a687-79720b74c96f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:49.943310 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-911dcf08-1e6e-480f-a687-79720b74c96f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:49.944001 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-911dcf08-1e6e-480f-a687-79720b74c96f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:49.944456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-911dcf08-1e6e-480f-a687-79720b74c96f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:49.944904 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-911dcf08-1e6e-480f-a687-79720b74c96f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:49.958706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.wsgi [None req-911dcf08-1e6e-480f-a687-79720b74c96f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] HTTP exception thrown: Instance 2a582556-d184-4047-ac19-285c0edd2fdf could not be found. Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-911dcf08-1e6e-480f-a687-79720b74c96f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Request method failure captured: Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: request: GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf HTTP/1.1 Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept: application/json Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Accept-Encoding: identity Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Connection: close Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Length: 0 Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Content-Type: application/json Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Host: 10.222.0.49 Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: Openstack-System-Scope: None Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: User-Agent: python-urllib3/1.26.12 Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Auth-Token: gAAAAABjED-uT9bLu0AO2jZsoJR1id1NQ1Cb0kzJLLeVtKLIS_65rzdZws9Ovv2RmV7sTZOUg72U27n7c9XPjrR8Zi9BwVGJxr-gaiXu9H1X2rJ0rA3yIrcdwaDRk-9iHtkrfj-aiewxzKJNri45-Tw0_AFgfe1gAQ6OBbakIhlLRIHiEzuVkrc Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Id: None Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Domain-Name: None Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Identity-Status: Confirmed Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Is-Admin-Project: True Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Id: default Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Domain-Name: Default Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Id: 3a33ba1fe1ff4325b80a02053b1db739 Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Role: member,reader Sep 01 05:57:49.960406 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Roles: member,reader Sep 01 05:57:49.962215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3a33ba1fe1ff4325b80a02053b1db739", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a33ba1fe1ff4325b80a02053b1db739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3a33ba1fe1ff4325b80a02053b1db739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3a33ba1fe1ff4325b80a02053b1db739"}]}] Sep 01 05:57:49.962215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:57:49.962215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Id: 3a33ba1fe1ff4325b80a02053b1db739 Sep 01 05:57:49.962215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2072305825 Sep 01 05:57:49.962215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User: tempest-AttachVolumeShelveTestJSON-2072305825-project Sep 01 05:57:49.962215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Id: default Sep 01 05:57:49.962215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Domain-Name: Default Sep 01 05:57:49.962215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Id: d0b6981c4d53405fbe0395ccbcb9f015 Sep 01 05:57:49.962215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2072305825-project Sep 01 05:57:49.962215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: method: > Sep 01 05:57:49.962215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: exception: Instance 2a582556-d184-4047-ac19-285c0edd2fdf could not be found. Sep 01 05:57:49.962215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: action_args: {'id': '2a582556-d184-4047-ac19-285c0edd2fdf'} Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a582556-d184-4047-ac19-285c0edd2fdf could not be found. Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:57:49.962922 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a582556-d184-4047-ac19-285c0edd2fdf could not be found. Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a582556-d184-4047-ac19-285c0edd2fdf could not be found. Sep 01 05:57:49.963874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR nova.api.openstack.wsgi Sep 01 05:57:49.964747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-911dcf08-1e6e-480f-a687-79720b74c96f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] Returning 404 to user: Instance 2a582556-d184-4047-ac19-285c0edd2fdf could not be found. {{(pid=120673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:57:49.964747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-911dcf08-1e6e-480f-a687-79720b74c96f tempest-AttachVolumeShelveTestJSON-2072305825 tempest-AttachVolumeShelveTestJSON-2072305825-project] 10.222.0.49 "GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf" status: 404 len: 111 microversion: 2.20 time: 0.032309 Sep 01 05:57:49.964747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1466/2847] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Sep 1 05:57:49 2022] GET /compute/v2.1/servers/2a582556-d184-4047-ac19-285c0edd2fdf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 05:59:13.980587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=10 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:13.981440 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=14 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:13.985611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6cd13223-fa48-4edc-9433-7dac833ceea8 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Action: 'create', calling method: .version_select at 0x7f9628500700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-203703004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5XM6btjuLRWkeXRn1oBukgFsHZ1inrbaMgKuNmttZu4QJiodlpnqiuP8IT2wxWhObAohuiawl3GeOQQYtr+kCPX96+J8qyMLdHYm/l4hweVYZ1mrv/TMiFOi0YGesqWQ=="}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:59:14.002067 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-6cd13223-fa48-4edc-9433-7dac833ceea8 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Getting quotas for project dab3698f589b4c9d9f1c363e19a15091. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:59:14.006450 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.quota [None req-6cd13223-fa48-4edc-9433-7dac833ceea8 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Getting quotas for user 06c821e445744c7fb2add093f1a65f6a and project dab3698f589b4c9d9f1c363e19a15091. Resources: {'key_pairs'} {{(pid=120674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:59:14.018468 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6cd13223-fa48-4edc-9433-7dac833ceea8 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [a6da914c-9dac-4bed-add2-0b66ae18441d] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:59:15.026179 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [None req-6cd13223-fa48-4edc-9433-7dac833ceea8 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [a6da914c-9dac-4bed-add2-0b66ae18441d] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39882. Sep 01 05:59:15.042377 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6cd13223-fa48-4edc-9433-7dac833ceea8 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.063421 Sep 01 05:59:15.042966 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1382/2848] 10.222.0.49 () {60 vars in 1159 bytes} [Thu Sep 1 05:59:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:59:15.089788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:15.090530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:15.094524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-855915801", "imageRef": "521dc95b-6cf0-42c3-bbc3-0d98f29d9360", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-203703004", "networks": [{"uuid": "00998c43-8276-48f2-b4a8-44747630c378"}]}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:59:15.147477 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.network.neutron [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] validate_networks() for [('00998c43-8276-48f2-b4a8-44747630c378', None, None, None, None, None)] {{(pid=120673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:59:15.515399 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Flavor limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:59:15.515824 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Image limits 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:59:15.516301 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Flavor pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:59:15.516712 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Image pref 0:0:0 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:59:15.517151 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.virt.hardware [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:59:15.526813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:15.527295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:15.527730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:15.528457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:15.528953 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:15.529379 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:15.546090 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Getting quotas for project dab3698f589b4c9d9f1c363e19a15091. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:59:15.550013 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.quota [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Getting quotas for user 06c821e445744c7fb2add093f1a65f6a and project dab3698f589b4c9d9f1c363e19a15091. Resources: {'ram', 'instances', 'cores'} {{(pid=120673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:59:15.560816 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Going to run 1 instances... {{(pid=120673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:59:15.563006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='521dc95b-6cf0-42c3-bbc3-0d98f29d9360',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:59:15.607543 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [35060e06-1709-4c2b-b0f6-8369cfc7e42d] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:59:16.615977 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO oslo.messaging._drivers.impl_rabbit [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [35060e06-1709-4c2b-b0f6-8369cfc7e42d] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39898. Sep 01 05:59:16.621424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b3ae4ed5-847c-47c6-b64b-4e4b3ec860c2 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.533565 Sep 01 05:59:16.622064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1467/2849] 10.222.0.49 () {60 vars in 1147 bytes} [Thu Sep 1 05:59:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:59:16.633252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-82944582-a64c-46cc-bdaa-309a789dac9d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:16.633864 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-82944582-a64c-46cc-bdaa-309a789dac9d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:16.687736 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-82944582-a64c-46cc-bdaa-309a789dac9d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:16.694444 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-82944582-a64c-46cc-bdaa-309a789dac9d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1257 microversion: 2.1 time: 0.065861 Sep 01 05:59:16.695009 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1383/2850] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:16 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:17.716797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-76c21a3a-4216-4aae-87cf-67cf5ea1ea8b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:17.717419 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-76c21a3a-4216-4aae-87cf-67cf5ea1ea8b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:17.774955 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-76c21a3a-4216-4aae-87cf-67cf5ea1ea8b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:17.781873 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-76c21a3a-4216-4aae-87cf-67cf5ea1ea8b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1257 microversion: 2.1 time: 0.069921 Sep 01 05:59:17.782433 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1468/2851] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:17 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:18.801476 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d0a4dd13-ecd2-486d-ac10-0de240494ff6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:18.802232 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d0a4dd13-ecd2-486d-ac10-0de240494ff6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:18.859137 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d0a4dd13-ecd2-486d-ac10-0de240494ff6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:18.866463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d0a4dd13-ecd2-486d-ac10-0de240494ff6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1257 microversion: 2.1 time: 0.068779 Sep 01 05:59:18.867088 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1384/2852] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:18 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:19.887631 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-fb001cc1-0d46-45ee-8fd4-d393a7d2ad4a tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:19.888253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-fb001cc1-0d46-45ee-8fd4-d393a7d2ad4a tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:19.942429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-fb001cc1-0d46-45ee-8fd4-d393a7d2ad4a tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:19.950303 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-fb001cc1-0d46-45ee-8fd4-d393a7d2ad4a tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1257 microversion: 2.1 time: 0.067178 Sep 01 05:59:19.951096 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1469/2853] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:19 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:20.971422 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9b3869a3-d2e7-4d27-9924-fc27f47d49dd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:20.972029 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9b3869a3-d2e7-4d27-9924-fc27f47d49dd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:20.979146 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b3869a3-d2e7-4d27-9924-fc27f47d49dd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:20.979628 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b3869a3-d2e7-4d27-9924-fc27f47d49dd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:20.980053 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b3869a3-d2e7-4d27-9924-fc27f47d49dd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:20.980725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b3869a3-d2e7-4d27-9924-fc27f47d49dd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:20.981200 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b3869a3-d2e7-4d27-9924-fc27f47d49dd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:20.981611 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9b3869a3-d2e7-4d27-9924-fc27f47d49dd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:21.043551 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9b3869a3-d2e7-4d27-9924-fc27f47d49dd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:21.051276 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9b3869a3-d2e7-4d27-9924-fc27f47d49dd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1261 microversion: 2.1 time: 0.083682 Sep 01 05:59:21.051846 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1385/2854] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:20 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:59:22.075489 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3f3512ff-ff99-49cf-b2c0-0de8f89a416d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:22.077365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3f3512ff-ff99-49cf-b2c0-0de8f89a416d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:22.089154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f3512ff-ff99-49cf-b2c0-0de8f89a416d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:22.092115 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f3512ff-ff99-49cf-b2c0-0de8f89a416d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:22.093451 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f3512ff-ff99-49cf-b2c0-0de8f89a416d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:22.094436 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f3512ff-ff99-49cf-b2c0-0de8f89a416d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:22.095155 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f3512ff-ff99-49cf-b2c0-0de8f89a416d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:22.095914 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3f3512ff-ff99-49cf-b2c0-0de8f89a416d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:22.195633 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3f3512ff-ff99-49cf-b2c0-0de8f89a416d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:22.206473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3f3512ff-ff99-49cf-b2c0-0de8f89a416d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1315 microversion: 2.1 time: 0.138399 Sep 01 05:59:22.223375 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1470/2855] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:22 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:23.233117 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-9cf8766f-5642-4776-807f-29eeb1fcbedd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:23.234552 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-9cf8766f-5642-4776-807f-29eeb1fcbedd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:23.246671 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9cf8766f-5642-4776-807f-29eeb1fcbedd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:23.247790 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9cf8766f-5642-4776-807f-29eeb1fcbedd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:23.248563 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9cf8766f-5642-4776-807f-29eeb1fcbedd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:23.250365 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9cf8766f-5642-4776-807f-29eeb1fcbedd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:23.252762 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9cf8766f-5642-4776-807f-29eeb1fcbedd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:23.253542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-9cf8766f-5642-4776-807f-29eeb1fcbedd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:23.409502 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-9cf8766f-5642-4776-807f-29eeb1fcbedd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:23.419075 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-9cf8766f-5642-4776-807f-29eeb1fcbedd tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.191303 Sep 01 05:59:23.434050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1386/2856] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:23 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:59:24.441154 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-01a8a02d-5866-4f21-985f-ab0cc1fcc26e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:24.441991 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-01a8a02d-5866-4f21-985f-ab0cc1fcc26e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:24.448511 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01a8a02d-5866-4f21-985f-ab0cc1fcc26e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:24.449110 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01a8a02d-5866-4f21-985f-ab0cc1fcc26e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:24.449537 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01a8a02d-5866-4f21-985f-ab0cc1fcc26e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:24.450215 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01a8a02d-5866-4f21-985f-ab0cc1fcc26e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:24.450652 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01a8a02d-5866-4f21-985f-ab0cc1fcc26e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:24.451064 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-01a8a02d-5866-4f21-985f-ab0cc1fcc26e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:24.609680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-01a8a02d-5866-4f21-985f-ab0cc1fcc26e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:24.617239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-01a8a02d-5866-4f21-985f-ab0cc1fcc26e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.180078 Sep 01 05:59:24.617797 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1471/2857] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:24 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:25.638393 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-b0ce9292-63f6-4d2f-9ba6-5ca3d0abca0c tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:25.638989 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-b0ce9292-63f6-4d2f-9ba6-5ca3d0abca0c tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:25.645802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b0ce9292-63f6-4d2f-9ba6-5ca3d0abca0c tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:25.646275 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b0ce9292-63f6-4d2f-9ba6-5ca3d0abca0c tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:25.646710 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b0ce9292-63f6-4d2f-9ba6-5ca3d0abca0c tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:25.647386 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b0ce9292-63f6-4d2f-9ba6-5ca3d0abca0c tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:25.647832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b0ce9292-63f6-4d2f-9ba6-5ca3d0abca0c tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:25.648252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-b0ce9292-63f6-4d2f-9ba6-5ca3d0abca0c tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:25.789705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-b0ce9292-63f6-4d2f-9ba6-5ca3d0abca0c tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:25.798219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-b0ce9292-63f6-4d2f-9ba6-5ca3d0abca0c tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.163594 Sep 01 05:59:25.799133 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1387/2858] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:25 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:26.821036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-cf01749d-9b30-4a6e-9cf6-335f21600a74 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:26.821656 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-cf01749d-9b30-4a6e-9cf6-335f21600a74 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:26.824315 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=2 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:26.841981 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf01749d-9b30-4a6e-9cf6-335f21600a74 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:26.842469 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf01749d-9b30-4a6e-9cf6-335f21600a74 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:26.842975 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf01749d-9b30-4a6e-9cf6-335f21600a74 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:26.843673 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf01749d-9b30-4a6e-9cf6-335f21600a74 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:26.844116 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf01749d-9b30-4a6e-9cf6-335f21600a74 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:26.844533 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-cf01749d-9b30-4a6e-9cf6-335f21600a74 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:26.989290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-cf01749d-9b30-4a6e-9cf6-335f21600a74 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:26.997404 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-cf01749d-9b30-4a6e-9cf6-335f21600a74 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.181596 Sep 01 05:59:26.998309 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1472/2859] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:26 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:28.018463 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a6291004-af98-48c9-90cc-ca1204cda852 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:28.019058 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a6291004-af98-48c9-90cc-ca1204cda852 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:28.025973 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a6291004-af98-48c9-90cc-ca1204cda852 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:28.026530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a6291004-af98-48c9-90cc-ca1204cda852 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:28.027961 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a6291004-af98-48c9-90cc-ca1204cda852 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:28.028663 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a6291004-af98-48c9-90cc-ca1204cda852 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:28.029460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a6291004-af98-48c9-90cc-ca1204cda852 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:28.029898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a6291004-af98-48c9-90cc-ca1204cda852 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:28.171065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a6291004-af98-48c9-90cc-ca1204cda852 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:28.178747 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a6291004-af98-48c9-90cc-ca1204cda852 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.164124 Sep 01 05:59:28.179308 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1388/2860] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:28 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:29.199649 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-3fbab3a2-0432-4e13-9263-7ed620c5b684 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:29.200324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-3fbab3a2-0432-4e13-9263-7ed620c5b684 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:29.206938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3fbab3a2-0432-4e13-9263-7ed620c5b684 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:29.207424 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3fbab3a2-0432-4e13-9263-7ed620c5b684 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:29.207866 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3fbab3a2-0432-4e13-9263-7ed620c5b684 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:29.208552 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3fbab3a2-0432-4e13-9263-7ed620c5b684 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:29.210565 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3fbab3a2-0432-4e13-9263-7ed620c5b684 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:29.210863 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-3fbab3a2-0432-4e13-9263-7ed620c5b684 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:29.389405 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-3fbab3a2-0432-4e13-9263-7ed620c5b684 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:29.397373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-3fbab3a2-0432-4e13-9263-7ed620c5b684 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.201672 Sep 01 05:59:29.397941 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1473/2861] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:29 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:30.418633 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-680ec24e-9455-4941-bb92-0a62fce10f8e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:30.419238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-680ec24e-9455-4941-bb92-0a62fce10f8e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:30.421147 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=8 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:30.428034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-680ec24e-9455-4941-bb92-0a62fce10f8e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:30.428510 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-680ec24e-9455-4941-bb92-0a62fce10f8e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:30.429219 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-680ec24e-9455-4941-bb92-0a62fce10f8e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:30.429959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-680ec24e-9455-4941-bb92-0a62fce10f8e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:30.430407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-680ec24e-9455-4941-bb92-0a62fce10f8e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:30.430828 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-680ec24e-9455-4941-bb92-0a62fce10f8e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:30.562489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-680ec24e-9455-4941-bb92-0a62fce10f8e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:30.570027 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-680ec24e-9455-4941-bb92-0a62fce10f8e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.155550 Sep 01 05:59:30.570587 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1389/2862] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:30 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:31.592735 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-f1615753-5d23-47a4-a90d-593c41ca39b7 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:31.593470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-f1615753-5d23-47a4-a90d-593c41ca39b7 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:31.597611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell0:SELECT=10 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:31.603245 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-8c2ca879-06a8-4fc7-8d5c-8c9467ac9b2a req-26fd1891-b548-4a79-b4d4-646fe9911ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3647a6-a8fe-431c-856e-41b917f6f38d", "tag": "31768c0b-a2dd-4a90-9b84-3ad99986f353"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:59:31.613243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f1615753-5d23-47a4-a90d-593c41ca39b7 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:31.614107 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f1615753-5d23-47a4-a90d-593c41ca39b7 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:31.615175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f1615753-5d23-47a4-a90d-593c41ca39b7 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:31.616987 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f1615753-5d23-47a4-a90d-593c41ca39b7 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:31.617532 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f1615753-5d23-47a4-a90d-593c41ca39b7 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:31.618054 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-f1615753-5d23-47a4-a90d-593c41ca39b7 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:31.623211 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-8c2ca879-06a8-4fc7-8d5c-8c9467ac9b2a req-26fd1891-b548-4a79-b4d4-646fe9911ee3 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:31.623873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-8c2ca879-06a8-4fc7-8d5c-8c9467ac9b2a req-26fd1891-b548-4a79-b4d4-646fe9911ee3 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:31.624505 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-8c2ca879-06a8-4fc7-8d5c-8c9467ac9b2a req-26fd1891-b548-4a79-b4d4-646fe9911ee3 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:31.640514 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-8c2ca879-06a8-4fc7-8d5c-8c9467ac9b2a req-26fd1891-b548-4a79-b4d4-646fe9911ee3 service nova] Creating event network-changed:31768c0b-a2dd-4a90-9b84-3ad99986f353 for instance bf3647a6-a8fe-431c-856e-41b917f6f38d on hv-cinder-85391 Sep 01 05:59:31.647844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-8c2ca879-06a8-4fc7-8d5c-8c9467ac9b2a req-26fd1891-b548-4a79-b4d4-646fe9911ee3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051994 Sep 01 05:59:31.650302 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1390/2863] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:59:31.782293 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-f1615753-5d23-47a4-a90d-593c41ca39b7 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:31.790200 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-f1615753-5d23-47a4-a90d-593c41ca39b7 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.202460 Sep 01 05:59:31.790777 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1474/2864] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:31 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:32.813112 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f6822778-bb29-4f29-bab0-e533438df354 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:32.813817 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f6822778-bb29-4f29-bab0-e533438df354 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:32.819914 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f6822778-bb29-4f29-bab0-e533438df354 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:32.820398 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f6822778-bb29-4f29-bab0-e533438df354 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:32.820853 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f6822778-bb29-4f29-bab0-e533438df354 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:32.821541 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f6822778-bb29-4f29-bab0-e533438df354 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:32.821993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f6822778-bb29-4f29-bab0-e533438df354 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:32.822413 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f6822778-bb29-4f29-bab0-e533438df354 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:33.047414 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f6822778-bb29-4f29-bab0-e533438df354 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:33.054999 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f6822778-bb29-4f29-bab0-e533438df354 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.247187 Sep 01 05:59:33.055574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1391/2865] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:32 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:34.075942 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-72f64dd6-5755-4298-8060-154812a79e40 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:34.076559 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-72f64dd6-5755-4298-8060-154812a79e40 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:34.083089 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72f64dd6-5755-4298-8060-154812a79e40 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:34.083570 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72f64dd6-5755-4298-8060-154812a79e40 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:34.084008 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72f64dd6-5755-4298-8060-154812a79e40 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:34.084695 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72f64dd6-5755-4298-8060-154812a79e40 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:34.085172 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72f64dd6-5755-4298-8060-154812a79e40 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:34.085599 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-72f64dd6-5755-4298-8060-154812a79e40 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:34.212285 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-72f64dd6-5755-4298-8060-154812a79e40 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:34.219882 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-72f64dd6-5755-4298-8060-154812a79e40 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.147851 Sep 01 05:59:34.220444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1475/2866] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:34 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:35.241408 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-6059def9-67a0-43bb-8e85-4d14cd6af593 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:35.241930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-6059def9-67a0-43bb-8e85-4d14cd6af593 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:35.248666 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6059def9-67a0-43bb-8e85-4d14cd6af593 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:35.249178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6059def9-67a0-43bb-8e85-4d14cd6af593 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:35.249621 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6059def9-67a0-43bb-8e85-4d14cd6af593 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:35.250300 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6059def9-67a0-43bb-8e85-4d14cd6af593 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:35.250750 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6059def9-67a0-43bb-8e85-4d14cd6af593 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:35.251170 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-6059def9-67a0-43bb-8e85-4d14cd6af593 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:35.377068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-6059def9-67a0-43bb-8e85-4d14cd6af593 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:35.384528 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-6059def9-67a0-43bb-8e85-4d14cd6af593 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.147055 Sep 01 05:59:35.385187 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1392/2867] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:35 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:36.406032 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8cae2afb-331e-4341-858f-bcf7b1c7883e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:36.406667 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8cae2afb-331e-4341-858f-bcf7b1c7883e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:36.413033 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8cae2afb-331e-4341-858f-bcf7b1c7883e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:36.413504 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8cae2afb-331e-4341-858f-bcf7b1c7883e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:36.413931 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8cae2afb-331e-4341-858f-bcf7b1c7883e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:36.414605 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8cae2afb-331e-4341-858f-bcf7b1c7883e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:36.415041 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8cae2afb-331e-4341-858f-bcf7b1c7883e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:36.415457 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8cae2afb-331e-4341-858f-bcf7b1c7883e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:36.549454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8cae2afb-331e-4341-858f-bcf7b1c7883e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:36.556994 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8cae2afb-331e-4341-858f-bcf7b1c7883e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.154796 Sep 01 05:59:36.557582 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1476/2868] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:36 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:59:36.791321 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-e2f98e1b-983e-4543-bb1f-3101ef64bb9b req-9fb03a10-3495-4cd9-bfcc-d35e3f2c9c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3647a6-a8fe-431c-856e-41b917f6f38d", "name": "network-vif-plugged", "status": "completed", "tag": "31768c0b-a2dd-4a90-9b84-3ad99986f353"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:59:36.802976 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-e2f98e1b-983e-4543-bb1f-3101ef64bb9b req-9fb03a10-3495-4cd9-bfcc-d35e3f2c9c7c service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:36.803517 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-e2f98e1b-983e-4543-bb1f-3101ef64bb9b req-9fb03a10-3495-4cd9-bfcc-d35e3f2c9c7c service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:36.804176 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-e2f98e1b-983e-4543-bb1f-3101ef64bb9b req-9fb03a10-3495-4cd9-bfcc-d35e3f2c9c7c service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:36.816068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-e2f98e1b-983e-4543-bb1f-3101ef64bb9b req-9fb03a10-3495-4cd9-bfcc-d35e3f2c9c7c service nova] Creating event network-vif-plugged:31768c0b-a2dd-4a90-9b84-3ad99986f353 for instance bf3647a6-a8fe-431c-856e-41b917f6f38d on hv-cinder-85391 Sep 01 05:59:36.821334 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-e2f98e1b-983e-4543-bb1f-3101ef64bb9b req-9fb03a10-3495-4cd9-bfcc-d35e3f2c9c7c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033637 Sep 01 05:59:36.821946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1393/2869] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:59:37.577734 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8621e9c8-9742-483a-acc3-ebb6ad3460b9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:37.578336 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8621e9c8-9742-483a-acc3-ebb6ad3460b9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:37.584853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8621e9c8-9742-483a-acc3-ebb6ad3460b9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:37.585335 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8621e9c8-9742-483a-acc3-ebb6ad3460b9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:37.585772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8621e9c8-9742-483a-acc3-ebb6ad3460b9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:37.586454 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8621e9c8-9742-483a-acc3-ebb6ad3460b9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:37.586904 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8621e9c8-9742-483a-acc3-ebb6ad3460b9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:37.592666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8621e9c8-9742-483a-acc3-ebb6ad3460b9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:37.716476 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-8621e9c8-9742-483a-acc3-ebb6ad3460b9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:37.724146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8621e9c8-9742-483a-acc3-ebb6ad3460b9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1357 microversion: 2.1 time: 0.150264 Sep 01 05:59:37.724706 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1477/2870] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:37 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:38.745775 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-313d4756-d48e-465d-80d7-4bdcbc02ad17 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:38.746472 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-313d4756-d48e-465d-80d7-4bdcbc02ad17 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:38.752565 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-313d4756-d48e-465d-80d7-4bdcbc02ad17 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:38.753078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-313d4756-d48e-465d-80d7-4bdcbc02ad17 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:38.753512 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-313d4756-d48e-465d-80d7-4bdcbc02ad17 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:38.754189 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-313d4756-d48e-465d-80d7-4bdcbc02ad17 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:38.754635 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-313d4756-d48e-465d-80d7-4bdcbc02ad17 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:38.755050 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-313d4756-d48e-465d-80d7-4bdcbc02ad17 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:38.887754 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-313d4756-d48e-465d-80d7-4bdcbc02ad17 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:38.896223 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-313d4756-d48e-465d-80d7-4bdcbc02ad17 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1546 microversion: 2.1 time: 0.154786 Sep 01 05:59:38.896333 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1394/2871] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:38 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:38.915470 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-afcac5a5-4033-4278-a752-01f765e7087f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:38.916088 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-afcac5a5-4033-4278-a752-01f765e7087f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:38.922666 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-afcac5a5-4033-4278-a752-01f765e7087f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:38.923146 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-afcac5a5-4033-4278-a752-01f765e7087f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:38.923578 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-afcac5a5-4033-4278-a752-01f765e7087f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:38.924255 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-afcac5a5-4033-4278-a752-01f765e7087f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:38.924705 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-afcac5a5-4033-4278-a752-01f765e7087f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:38.925304 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-afcac5a5-4033-4278-a752-01f765e7087f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:39.053576 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-afcac5a5-4033-4278-a752-01f765e7087f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:39.061658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-afcac5a5-4033-4278-a752-01f765e7087f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1546 microversion: 2.1 time: 0.150044 Sep 01 05:59:39.062216 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1478/2872] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:38 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:39.081364 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-2358c2ec-053e-4de5-a9a1-d4611b940cd0 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:39.086123 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-2358c2ec-053e-4de5-a9a1-d4611b940cd0 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:39.086873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-2358c2ec-053e-4de5-a9a1-d4611b940cd0 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Searching by: {'deleted': False, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091'} {{(pid=120674) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:59:39.093387 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2358c2ec-053e-4de5-a9a1-d4611b940cd0 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:39.093859 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2358c2ec-053e-4de5-a9a1-d4611b940cd0 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:39.094283 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2358c2ec-053e-4de5-a9a1-d4611b940cd0 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:39.094986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2358c2ec-053e-4de5-a9a1-d4611b940cd0 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:39.095428 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2358c2ec-053e-4de5-a9a1-d4611b940cd0 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:39.095844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-2358c2ec-053e-4de5-a9a1-d4611b940cd0 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:39.182643 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.multi_cell_list [None req-2358c2ec-053e-4de5-a9a1-d4611b940cd0 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120674) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:59:39.278844 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-2358c2ec-053e-4de5-a9a1-d4611b940cd0 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201014 Sep 01 05:59:39.279346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1395/2873] 10.222.0.49 () {58 vars in 1125 bytes} [Thu Sep 1 05:59:39 2022] GET /compute/v2.1/servers => generated 342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:59:39.291014 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5971b440-35b2-424c-b5fa-760c533c9b71 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:39.291772 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5971b440-35b2-424c-b5fa-760c533c9b71 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:39.298422 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5971b440-35b2-424c-b5fa-760c533c9b71 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:39.298894 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5971b440-35b2-424c-b5fa-760c533c9b71 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:39.299321 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5971b440-35b2-424c-b5fa-760c533c9b71 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:39.299989 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5971b440-35b2-424c-b5fa-760c533c9b71 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:39.300429 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5971b440-35b2-424c-b5fa-760c533c9b71 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:39.300874 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5971b440-35b2-424c-b5fa-760c533c9b71 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:39.430074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5971b440-35b2-424c-b5fa-760c533c9b71 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:39.438280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5971b440-35b2-424c-b5fa-760c533c9b71 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1546 microversion: 2.1 time: 0.151141 Sep 01 05:59:39.438844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1479/2874] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:39 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:40.960993 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-fa104173-0449-4401-8c24-4c4a5ac07e0f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33d4bd87-8760-4400-9095-8208c2588c4e"}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:59:40.963265 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-fa104173-0449-4401-8c24-4c4a5ac07e0f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:40.970531 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa104173-0449-4401-8c24-4c4a5ac07e0f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:40.970942 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa104173-0449-4401-8c24-4c4a5ac07e0f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:40.971367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa104173-0449-4401-8c24-4c4a5ac07e0f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:40.972045 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa104173-0449-4401-8c24-4c4a5ac07e0f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:40.972484 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa104173-0449-4401-8c24-4c4a5ac07e0f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:40.972927 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-fa104173-0449-4401-8c24-4c4a5ac07e0f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:41.207827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-fa104173-0449-4401-8c24-4c4a5ac07e0f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "POST /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250588 Sep 01 05:59:41.208443 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1396/2875] 10.222.0.49 () {60 vars in 1323 bytes} [Thu Sep 1 05:59:40 2022] POST /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:59:47.722599 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-048f0369-7b45-4f5d-a122-0b787fed8cae tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:47.723239 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-048f0369-7b45-4f5d-a122-0b787fed8cae tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:47.725670 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:47.731165 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-048f0369-7b45-4f5d-a122-0b787fed8cae tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:47.731634 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-048f0369-7b45-4f5d-a122-0b787fed8cae tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:47.732062 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-048f0369-7b45-4f5d-a122-0b787fed8cae tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:47.732733 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-048f0369-7b45-4f5d-a122-0b787fed8cae tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:47.733198 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-048f0369-7b45-4f5d-a122-0b787fed8cae tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:47.733611 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-048f0369-7b45-4f5d-a122-0b787fed8cae tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:47.738042 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=63 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:47.862661 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-048f0369-7b45-4f5d-a122-0b787fed8cae tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:47.871273 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-048f0369-7b45-4f5d-a122-0b787fed8cae tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1592 microversion: 2.1 time: 0.152457 Sep 01 05:59:47.871838 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1480/2876] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:47 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1592 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:49.540285 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-bf143217-3d19-4507-85b5-0ba1bd6750bf req-fde9ebc7-c077-4bc5-920e-98831b9e9ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3647a6-a8fe-431c-856e-41b917f6f38d", "tag": "31768c0b-a2dd-4a90-9b84-3ad99986f353"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:59:49.546238 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell0:SELECT=2 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:49.547095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:49.553309 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-bf143217-3d19-4507-85b5-0ba1bd6750bf req-fde9ebc7-c077-4bc5-920e-98831b9e9ce8 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:49.553795 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-bf143217-3d19-4507-85b5-0ba1bd6750bf req-fde9ebc7-c077-4bc5-920e-98831b9e9ce8 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:49.554374 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-bf143217-3d19-4507-85b5-0ba1bd6750bf req-fde9ebc7-c077-4bc5-920e-98831b9e9ce8 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:49.557316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:49.569292 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-bf143217-3d19-4507-85b5-0ba1bd6750bf req-fde9ebc7-c077-4bc5-920e-98831b9e9ce8 service nova] Creating event network-changed:31768c0b-a2dd-4a90-9b84-3ad99986f353 for instance bf3647a6-a8fe-431c-856e-41b917f6f38d on hv-cinder-85391 Sep 01 05:59:49.575132 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-bf143217-3d19-4507-85b5-0ba1bd6750bf req-fde9ebc7-c077-4bc5-920e-98831b9e9ce8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038654 Sep 01 05:59:49.575735 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1397/2877] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:59:50.559134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-1b409392-8dc4-45be-8495-cb5ee9827998 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2115806246"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:59:50.559699 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-1b409392-8dc4-45be-8495-cb5ee9827998 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:50.566128 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1b409392-8dc4-45be-8495-cb5ee9827998 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:50.566609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1b409392-8dc4-45be-8495-cb5ee9827998 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:50.567036 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1b409392-8dc4-45be-8495-cb5ee9827998 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:50.567713 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1b409392-8dc4-45be-8495-cb5ee9827998 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:50.568153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1b409392-8dc4-45be-8495-cb5ee9827998 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:50.568564 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-1b409392-8dc4-45be-8495-cb5ee9827998 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:50.697609 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.network.security_group_api [None req-1b409392-8dc4-45be-8495-cb5ee9827998 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Adding security group e57de3f8-9442-4f0f-8ecd-6056f70a3c69 to port 31768c0b-a2dd-4a90-9b84-3ad99986f353 Sep 01 05:59:51.275117 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-1b409392-8dc4-45be-8495-cb5ee9827998 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "POST /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/action" status: 202 len: 0 microversion: 2.1 time: 0.720003 Sep 01 05:59:51.281932 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1481/2878] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 05:59:50 2022] POST /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:59:51.286662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-0d4aff6d-fccd-4b0d-b2d9-6b3a8b1d6f3f req-f2f2ef7e-a5f2-426f-96d5-752bc0cbea1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3647a6-a8fe-431c-856e-41b917f6f38d", "tag": "31768c0b-a2dd-4a90-9b84-3ad99986f353"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:59:51.287378 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-0c115b9d-43d5-4047-b96c-a4895afea808 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:51.288003 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-0c115b9d-43d5-4047-b96c-a4895afea808 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:51.294745 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c115b9d-43d5-4047-b96c-a4895afea808 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:51.295236 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c115b9d-43d5-4047-b96c-a4895afea808 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:51.295676 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c115b9d-43d5-4047-b96c-a4895afea808 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:51.296373 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c115b9d-43d5-4047-b96c-a4895afea808 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:51.296849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c115b9d-43d5-4047-b96c-a4895afea808 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:51.297281 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-0c115b9d-43d5-4047-b96c-a4895afea808 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:51.300986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-0d4aff6d-fccd-4b0d-b2d9-6b3a8b1d6f3f req-f2f2ef7e-a5f2-426f-96d5-752bc0cbea1b service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:51.301913 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-0d4aff6d-fccd-4b0d-b2d9-6b3a8b1d6f3f req-f2f2ef7e-a5f2-426f-96d5-752bc0cbea1b service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:51.302432 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-0d4aff6d-fccd-4b0d-b2d9-6b3a8b1d6f3f req-f2f2ef7e-a5f2-426f-96d5-752bc0cbea1b service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:51.318873 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-0d4aff6d-fccd-4b0d-b2d9-6b3a8b1d6f3f req-f2f2ef7e-a5f2-426f-96d5-752bc0cbea1b service nova] Creating event network-changed:31768c0b-a2dd-4a90-9b84-3ad99986f353 for instance bf3647a6-a8fe-431c-856e-41b917f6f38d on hv-cinder-85391 Sep 01 05:59:51.329078 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-0d4aff6d-fccd-4b0d-b2d9-6b3a8b1d6f3f req-f2f2ef7e-a5f2-426f-96d5-752bc0cbea1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047367 Sep 01 05:59:51.330323 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1398/2879] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 05:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:59:51.465340 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-0c115b9d-43d5-4047-b96c-a4895afea808 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:51.477788 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-0c115b9d-43d5-4047-b96c-a4895afea808 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1758 microversion: 2.1 time: 0.194719 Sep 01 05:59:51.478370 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1482/2880] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:51 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:13.799204 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:00:13.800367 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=3 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:00:13.805095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-c6a9e884-9a5c-4499-974d-45919f75f868 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:00:13.807342 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-c6a9e884-9a5c-4499-974d-45919f75f868 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:13.815000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6a9e884-9a5c-4499-974d-45919f75f868 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:13.815477 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6a9e884-9a5c-4499-974d-45919f75f868 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:13.815907 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6a9e884-9a5c-4499-974d-45919f75f868 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:13.816577 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6a9e884-9a5c-4499-974d-45919f75f868 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:13.817118 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6a9e884-9a5c-4499-974d-45919f75f868 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:13.817562 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-c6a9e884-9a5c-4499-974d-45919f75f868 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:13.889384 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-c6a9e884-9a5c-4499-974d-45919f75f868 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "POST /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/action" status: 202 len: 0 microversion: 2.1 time: 0.091357 Sep 01 06:00:13.889987 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1399/2881] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 06:00:13 2022] POST /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:00:13.898584 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-238aed19-1216-4ac9-8308-d46b51dd6d65 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:13.899235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-238aed19-1216-4ac9-8308-d46b51dd6d65 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:13.901235 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=5 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:00:13.901893 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=15 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:00:13.907930 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-238aed19-1216-4ac9-8308-d46b51dd6d65 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:13.908413 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-238aed19-1216-4ac9-8308-d46b51dd6d65 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:13.908921 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-238aed19-1216-4ac9-8308-d46b51dd6d65 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:13.909615 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-238aed19-1216-4ac9-8308-d46b51dd6d65 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:13.910066 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-238aed19-1216-4ac9-8308-d46b51dd6d65 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:13.910545 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-238aed19-1216-4ac9-8308-d46b51dd6d65 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:14.057530 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-238aed19-1216-4ac9-8308-d46b51dd6d65 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:14.066175 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-238aed19-1216-4ac9-8308-d46b51dd6d65 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1750 microversion: 2.1 time: 0.171917 Sep 01 06:00:14.066752 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1483/2882] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:13 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:15.088051 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-cf74be14-010d-4f55-8628-7363b5936686 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:15.088696 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-cf74be14-010d-4f55-8628-7363b5936686 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:15.095352 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf74be14-010d-4f55-8628-7363b5936686 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:15.095833 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf74be14-010d-4f55-8628-7363b5936686 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:15.096267 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf74be14-010d-4f55-8628-7363b5936686 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:15.097048 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf74be14-010d-4f55-8628-7363b5936686 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:15.097497 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf74be14-010d-4f55-8628-7363b5936686 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:15.097915 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-cf74be14-010d-4f55-8628-7363b5936686 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:15.242001 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-cf74be14-010d-4f55-8628-7363b5936686 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:15.250178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-cf74be14-010d-4f55-8628-7363b5936686 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.166843 Sep 01 06:00:15.250743 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1400/2883] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:15 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:16.272179 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-d5bb9d1e-850b-4d27-91a9-664ab6bb242e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:16.272718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-d5bb9d1e-850b-4d27-91a9-664ab6bb242e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:16.279791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5bb9d1e-850b-4d27-91a9-664ab6bb242e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:16.280261 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5bb9d1e-850b-4d27-91a9-664ab6bb242e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:16.280747 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5bb9d1e-850b-4d27-91a9-664ab6bb242e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:16.281473 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5bb9d1e-850b-4d27-91a9-664ab6bb242e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:16.281945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5bb9d1e-850b-4d27-91a9-664ab6bb242e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:16.282356 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-d5bb9d1e-850b-4d27-91a9-664ab6bb242e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:16.426163 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-d5bb9d1e-850b-4d27-91a9-664ab6bb242e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:16.434630 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-d5bb9d1e-850b-4d27-91a9-664ab6bb242e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.166333 Sep 01 06:00:16.435440 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1484/2884] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:16 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:17.455936 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-67d17317-6ac6-49a6-97d3-90b27c8fa751 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:17.456661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-67d17317-6ac6-49a6-97d3-90b27c8fa751 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:17.463064 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67d17317-6ac6-49a6-97d3-90b27c8fa751 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:17.463655 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67d17317-6ac6-49a6-97d3-90b27c8fa751 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:17.464018 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67d17317-6ac6-49a6-97d3-90b27c8fa751 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:17.464705 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67d17317-6ac6-49a6-97d3-90b27c8fa751 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:17.465433 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67d17317-6ac6-49a6-97d3-90b27c8fa751 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:17.465996 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-67d17317-6ac6-49a6-97d3-90b27c8fa751 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:17.607270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-67d17317-6ac6-49a6-97d3-90b27c8fa751 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:17.615343 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-67d17317-6ac6-49a6-97d3-90b27c8fa751 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.164187 Sep 01 06:00:17.615902 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1401/2885] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:17 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:18.637551 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-5269c5f8-bfd7-4450-880f-23e9d9abd3bf tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:18.638153 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-5269c5f8-bfd7-4450-880f-23e9d9abd3bf tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:18.644909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5269c5f8-bfd7-4450-880f-23e9d9abd3bf tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:18.645384 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5269c5f8-bfd7-4450-880f-23e9d9abd3bf tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:18.645807 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5269c5f8-bfd7-4450-880f-23e9d9abd3bf tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:18.646475 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5269c5f8-bfd7-4450-880f-23e9d9abd3bf tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:18.646917 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5269c5f8-bfd7-4450-880f-23e9d9abd3bf tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:18.647329 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-5269c5f8-bfd7-4450-880f-23e9d9abd3bf tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:18.788522 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-5269c5f8-bfd7-4450-880f-23e9d9abd3bf tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:18.797270 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-5269c5f8-bfd7-4450-880f-23e9d9abd3bf tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.163559 Sep 01 06:00:18.797830 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1485/2886] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:18 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:19.818244 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-a7ca9758-c3bd-465f-8389-2bf90ddc37a5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:19.818841 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-a7ca9758-c3bd-465f-8389-2bf90ddc37a5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:19.825483 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7ca9758-c3bd-465f-8389-2bf90ddc37a5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:19.825955 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7ca9758-c3bd-465f-8389-2bf90ddc37a5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:19.826383 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7ca9758-c3bd-465f-8389-2bf90ddc37a5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:19.827061 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7ca9758-c3bd-465f-8389-2bf90ddc37a5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:19.827503 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7ca9758-c3bd-465f-8389-2bf90ddc37a5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:19.827920 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-a7ca9758-c3bd-465f-8389-2bf90ddc37a5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:19.971906 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-a7ca9758-c3bd-465f-8389-2bf90ddc37a5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:19.980103 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-a7ca9758-c3bd-465f-8389-2bf90ddc37a5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.165639 Sep 01 06:00:19.981329 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1402/2887] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:19 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:00:21.002253 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b2e1fae4-0001-49bf-8f17-ed875828477d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:21.002794 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b2e1fae4-0001-49bf-8f17-ed875828477d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:21.009217 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2e1fae4-0001-49bf-8f17-ed875828477d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:21.009693 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2e1fae4-0001-49bf-8f17-ed875828477d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:21.010124 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2e1fae4-0001-49bf-8f17-ed875828477d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:21.010796 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2e1fae4-0001-49bf-8f17-ed875828477d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:21.011242 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2e1fae4-0001-49bf-8f17-ed875828477d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:21.011658 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b2e1fae4-0001-49bf-8f17-ed875828477d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:21.155721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-b2e1fae4-0001-49bf-8f17-ed875828477d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:21.163849 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b2e1fae4-0001-49bf-8f17-ed875828477d tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.165519 Sep 01 06:00:21.164411 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1486/2888] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:20 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:22.185620 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-01bb6db1-8aba-4527-9d62-87afa5e0ed16 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:22.186178 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-01bb6db1-8aba-4527-9d62-87afa5e0ed16 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:22.192076 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01bb6db1-8aba-4527-9d62-87afa5e0ed16 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:22.192554 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01bb6db1-8aba-4527-9d62-87afa5e0ed16 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:22.193022 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01bb6db1-8aba-4527-9d62-87afa5e0ed16 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:22.193697 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01bb6db1-8aba-4527-9d62-87afa5e0ed16 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:22.194143 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01bb6db1-8aba-4527-9d62-87afa5e0ed16 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:22.194584 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-01bb6db1-8aba-4527-9d62-87afa5e0ed16 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:22.335530 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-01bb6db1-8aba-4527-9d62-87afa5e0ed16 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:22.344498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-01bb6db1-8aba-4527-9d62-87afa5e0ed16 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.163571 Sep 01 06:00:22.345095 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1403/2889] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:22 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:23.366282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-14d41433-4c21-47ec-83b8-23d8068429da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:23.366902 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-14d41433-4c21-47ec-83b8-23d8068429da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:23.374252 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14d41433-4c21-47ec-83b8-23d8068429da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:23.374730 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14d41433-4c21-47ec-83b8-23d8068429da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:23.375162 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14d41433-4c21-47ec-83b8-23d8068429da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:23.375842 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14d41433-4c21-47ec-83b8-23d8068429da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:23.376290 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14d41433-4c21-47ec-83b8-23d8068429da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:23.376710 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-14d41433-4c21-47ec-83b8-23d8068429da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:23.520397 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-14d41433-4c21-47ec-83b8-23d8068429da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:23.528968 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-14d41433-4c21-47ec-83b8-23d8068429da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.166499 Sep 01 06:00:23.529568 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1487/2890] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:23 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:24.549707 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-db19c2d1-58ec-4b5d-98d4-a4d06da39d6f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:24.550316 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-db19c2d1-58ec-4b5d-98d4-a4d06da39d6f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:24.557000 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-db19c2d1-58ec-4b5d-98d4-a4d06da39d6f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:24.557478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-db19c2d1-58ec-4b5d-98d4-a4d06da39d6f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:24.557908 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-db19c2d1-58ec-4b5d-98d4-a4d06da39d6f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:24.558593 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-db19c2d1-58ec-4b5d-98d4-a4d06da39d6f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:24.559656 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-db19c2d1-58ec-4b5d-98d4-a4d06da39d6f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:24.560077 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-db19c2d1-58ec-4b5d-98d4-a4d06da39d6f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:24.704868 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-db19c2d1-58ec-4b5d-98d4-a4d06da39d6f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:24.712946 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-db19c2d1-58ec-4b5d-98d4-a4d06da39d6f tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.167052 Sep 01 06:00:24.713509 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1404/2891] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:24 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:25.734306 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-668f056d-dd76-452e-852b-8c83f27c5913 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:25.734948 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-668f056d-dd76-452e-852b-8c83f27c5913 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:25.741467 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-668f056d-dd76-452e-852b-8c83f27c5913 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:25.741937 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-668f056d-dd76-452e-852b-8c83f27c5913 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:25.742362 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-668f056d-dd76-452e-852b-8c83f27c5913 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:25.743028 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-668f056d-dd76-452e-852b-8c83f27c5913 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:25.743468 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-668f056d-dd76-452e-852b-8c83f27c5913 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:25.743879 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-668f056d-dd76-452e-852b-8c83f27c5913 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:25.883466 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-668f056d-dd76-452e-852b-8c83f27c5913 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:25.892465 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-668f056d-dd76-452e-852b-8c83f27c5913 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.161955 Sep 01 06:00:25.893082 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1488/2892] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:25 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:26.914677 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-d742ac23-82a4-4577-900d-a85d0bcfa102 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:26.915291 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-d742ac23-82a4-4577-900d-a85d0bcfa102 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:26.922270 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d742ac23-82a4-4577-900d-a85d0bcfa102 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:26.922746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d742ac23-82a4-4577-900d-a85d0bcfa102 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:26.923173 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d742ac23-82a4-4577-900d-a85d0bcfa102 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:26.923860 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d742ac23-82a4-4577-900d-a85d0bcfa102 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:26.924306 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d742ac23-82a4-4577-900d-a85d0bcfa102 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:26.924718 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-d742ac23-82a4-4577-900d-a85d0bcfa102 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:27.071460 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-d742ac23-82a4-4577-900d-a85d0bcfa102 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:27.079661 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-d742ac23-82a4-4577-900d-a85d0bcfa102 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.168837 Sep 01 06:00:27.080225 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1405/2893] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:26 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:28.101332 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-90b04a68-24eb-41da-a4d1-58162967d3da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:28.101938 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-90b04a68-24eb-41da-a4d1-58162967d3da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:28.108819 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90b04a68-24eb-41da-a4d1-58162967d3da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:28.109296 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90b04a68-24eb-41da-a4d1-58162967d3da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:28.109721 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90b04a68-24eb-41da-a4d1-58162967d3da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:28.110390 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90b04a68-24eb-41da-a4d1-58162967d3da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:28.110831 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90b04a68-24eb-41da-a4d1-58162967d3da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:28.111243 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-90b04a68-24eb-41da-a4d1-58162967d3da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:28.254741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-90b04a68-24eb-41da-a4d1-58162967d3da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:28.262992 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-90b04a68-24eb-41da-a4d1-58162967d3da tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.165570 Sep 01 06:00:28.263550 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1489/2894] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:28 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:29.284407 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-f858b6b0-a4b8-4562-bae7-3d2272eea533 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:29.285035 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-f858b6b0-a4b8-4562-bae7-3d2272eea533 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:29.291533 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f858b6b0-a4b8-4562-bae7-3d2272eea533 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:29.292013 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f858b6b0-a4b8-4562-bae7-3d2272eea533 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:29.292472 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f858b6b0-a4b8-4562-bae7-3d2272eea533 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:29.293371 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f858b6b0-a4b8-4562-bae7-3d2272eea533 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:29.293827 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f858b6b0-a4b8-4562-bae7-3d2272eea533 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:29.294305 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-f858b6b0-a4b8-4562-bae7-3d2272eea533 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:29.434519 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-f858b6b0-a4b8-4562-bae7-3d2272eea533 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:29.442725 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-f858b6b0-a4b8-4562-bae7-3d2272eea533 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.162159 Sep 01 06:00:29.443399 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1406/2895] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:29 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:30.464740 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-60b843d2-02c0-491a-a9eb-3400b9254ed9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:30.466229 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-60b843d2-02c0-491a-a9eb-3400b9254ed9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:30.472791 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60b843d2-02c0-491a-a9eb-3400b9254ed9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:30.473282 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60b843d2-02c0-491a-a9eb-3400b9254ed9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:30.473718 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60b843d2-02c0-491a-a9eb-3400b9254ed9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:30.474408 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60b843d2-02c0-491a-a9eb-3400b9254ed9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:30.474856 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60b843d2-02c0-491a-a9eb-3400b9254ed9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:30.475278 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-60b843d2-02c0-491a-a9eb-3400b9254ed9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:30.620979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-60b843d2-02c0-491a-a9eb-3400b9254ed9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:30.629224 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-60b843d2-02c0-491a-a9eb-3400b9254ed9 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1755 microversion: 2.1 time: 0.169004 Sep 01 06:00:30.629793 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1490/2896] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:30 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:00:31.649712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-5563002f-0ce5-40d9-a5d7-b0921061fffe tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:00:31.650310 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-5563002f-0ce5-40d9-a5d7-b0921061fffe tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:00:31.657746 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5563002f-0ce5-40d9-a5d7-b0921061fffe tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:31.658227 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5563002f-0ce5-40d9-a5d7-b0921061fffe tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:31.658662 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5563002f-0ce5-40d9-a5d7-b0921061fffe tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:31.659347 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5563002f-0ce5-40d9-a5d7-b0921061fffe tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:00:31.659813 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5563002f-0ce5-40d9-a5d7-b0921061fffe tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:00:31.660240 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-5563002f-0ce5-40d9-a5d7-b0921061fffe tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:00:31.802507 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-5563002f-0ce5-40d9-a5d7-b0921061fffe tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:00:31.810867 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-5563002f-0ce5-40d9-a5d7-b0921061fffe tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1758 microversion: 2.1 time: 0.164977 Sep 01 06:00:31.811486 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1407/2897] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:00:31 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:01:04.058326 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-210564e0-719a-4580-a013-f147a2599bd1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2115806246"}} {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:01:04.058901 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-210564e0-719a-4580-a013-f147a2599bd1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:04.061051 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_api:SELECT=16 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:01:04.061690 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG dbcounter [-] [120673] Writing DB stats nova_cell1:SELECT=48 {{(pid=120673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:01:04.067210 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-210564e0-719a-4580-a013-f147a2599bd1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:04.067680 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-210564e0-719a-4580-a013-f147a2599bd1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:04.068113 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-210564e0-719a-4580-a013-f147a2599bd1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:04.068803 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-210564e0-719a-4580-a013-f147a2599bd1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:04.069247 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-210564e0-719a-4580-a013-f147a2599bd1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:04.069663 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-210564e0-719a-4580-a013-f147a2599bd1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:04.323280 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.network.security_group_api [None req-210564e0-719a-4580-a013-f147a2599bd1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Removing security group e57de3f8-9442-4f0f-8ecd-6056f70a3c69 from port 31768c0b-a2dd-4a90-9b84-3ad99986f353 Sep 01 06:01:04.624316 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-210564e0-719a-4580-a013-f147a2599bd1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "POST /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/action" status: 202 len: 0 microversion: 2.1 time: 0.569704 Sep 01 06:01:04.628365 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1491/2898] 10.222.0.49 () {60 vars in 1278 bytes} [Thu Sep 1 06:01:04 2022] POST /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:01:04.634186 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-9bcdbc69-c73f-4c08-8e59-23e260722111 req-5edf963a-2a1f-4b1c-b503-f3e5775c3ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3647a6-a8fe-431c-856e-41b917f6f38d", "tag": "31768c0b-a2dd-4a90-9b84-3ad99986f353"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:01:04.640152 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_api:SELECT=18 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:01:04.640832 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG dbcounter [-] [120674] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:01:04.647969 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9bcdbc69-c73f-4c08-8e59-23e260722111 req-5edf963a-2a1f-4b1c-b503-f3e5775c3ea5 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:04.648160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9bcdbc69-c73f-4c08-8e59-23e260722111 req-5edf963a-2a1f-4b1c-b503-f3e5775c3ea5 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:04.648652 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-9bcdbc69-c73f-4c08-8e59-23e260722111 req-5edf963a-2a1f-4b1c-b503-f3e5775c3ea5 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:04.662701 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-9bcdbc69-c73f-4c08-8e59-23e260722111 req-5edf963a-2a1f-4b1c-b503-f3e5775c3ea5 service nova] Creating event network-changed:31768c0b-a2dd-4a90-9b84-3ad99986f353 for instance bf3647a6-a8fe-431c-856e-41b917f6f38d on hv-cinder-85391 Sep 01 06:01:04.668185 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-9bcdbc69-c73f-4c08-8e59-23e260722111 req-5edf963a-2a1f-4b1c-b503-f3e5775c3ea5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039896 Sep 01 06:01:04.670388 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1408/2899] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 06:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:01:06.217036 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-4fa71157-49a2-4e82-b653-5138c6917cd1 req-18a88b09-72ab-4521-8092-0248347cffa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3647a6-a8fe-431c-856e-41b917f6f38d", "tag": "31768c0b-a2dd-4a90-9b84-3ad99986f353"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:01:06.224311 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-378e9e21-d4fa-444c-8cec-5d40bacc1771 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:01:06.224817 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-378e9e21-d4fa-444c-8cec-5d40bacc1771 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:06.231295 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-378e9e21-d4fa-444c-8cec-5d40bacc1771 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:06.231775 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-378e9e21-d4fa-444c-8cec-5d40bacc1771 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:06.232203 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-378e9e21-d4fa-444c-8cec-5d40bacc1771 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:06.232909 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-378e9e21-d4fa-444c-8cec-5d40bacc1771 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:06.233354 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-378e9e21-d4fa-444c-8cec-5d40bacc1771 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:06.233768 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-378e9e21-d4fa-444c-8cec-5d40bacc1771 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:06.233903 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4fa71157-49a2-4e82-b653-5138c6917cd1 req-18a88b09-72ab-4521-8092-0248347cffa3 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:06.234597 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4fa71157-49a2-4e82-b653-5138c6917cd1 req-18a88b09-72ab-4521-8092-0248347cffa3 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:06.235062 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-4fa71157-49a2-4e82-b653-5138c6917cd1 req-18a88b09-72ab-4521-8092-0248347cffa3 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:06.247491 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-4fa71157-49a2-4e82-b653-5138c6917cd1 req-18a88b09-72ab-4521-8092-0248347cffa3 service nova] Creating event network-changed:31768c0b-a2dd-4a90-9b84-3ad99986f353 for instance bf3647a6-a8fe-431c-856e-41b917f6f38d on hv-cinder-85391 Sep 01 06:01:06.252385 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-4fa71157-49a2-4e82-b653-5138c6917cd1 req-18a88b09-72ab-4521-8092-0248347cffa3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040936 Sep 01 06:01:06.253226 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1409/2900] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 06:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:01:06.324238 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-378e9e21-d4fa-444c-8cec-5d40bacc1771 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lazy-loading 'services' on Instance uuid bf3647a6-a8fe-431c-856e-41b917f6f38d {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 06:01:06.406618 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-378e9e21-d4fa-444c-8cec-5d40bacc1771 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/os-volume_attachments/33d4bd87-8760-4400-9095-8208c2588c4e" status: 202 len: 0 microversion: 2.1 time: 0.197514 Sep 01 06:01:06.408006 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1492/2901] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 06:01:06 2022] DELETE /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/os-volume_attachments/33d4bd87-8760-4400-9095-8208c2588c4e => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:01:06.417900 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-8dd81c00-ca49-4978-863a-fc00ed552f46 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:01:06.421249 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-8dd81c00-ca49-4978-863a-fc00ed552f46 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:06.428473 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8dd81c00-ca49-4978-863a-fc00ed552f46 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:06.429252 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8dd81c00-ca49-4978-863a-fc00ed552f46 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:06.429802 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8dd81c00-ca49-4978-863a-fc00ed552f46 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:06.430898 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8dd81c00-ca49-4978-863a-fc00ed552f46 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:06.431424 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8dd81c00-ca49-4978-863a-fc00ed552f46 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:06.431959 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-8dd81c00-ca49-4978-863a-fc00ed552f46 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:06.464712 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-8dd81c00-ca49-4978-863a-fc00ed552f46 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050732 Sep 01 06:01:06.472065 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1410/2902] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 06:01:06 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:01:07.481074 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-b1bc456b-2a4b-4fcc-add0-d1f96d0a6e2e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:01:07.483484 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-b1bc456b-2a4b-4fcc-add0-d1f96d0a6e2e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:07.489813 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1bc456b-2a4b-4fcc-add0-d1f96d0a6e2e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:07.490227 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1bc456b-2a4b-4fcc-add0-d1f96d0a6e2e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:07.490653 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1bc456b-2a4b-4fcc-add0-d1f96d0a6e2e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:07.491328 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1bc456b-2a4b-4fcc-add0-d1f96d0a6e2e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:07.491766 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1bc456b-2a4b-4fcc-add0-d1f96d0a6e2e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:07.492177 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-b1bc456b-2a4b-4fcc-add0-d1f96d0a6e2e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:07.522363 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-b1bc456b-2a4b-4fcc-add0-d1f96d0a6e2e tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047113 Sep 01 06:01:07.522915 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1493/2903] 10.222.0.49 () {58 vars in 1302 bytes} [Thu Sep 1 06:01:07 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 06:01:07.533631 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e86841a1-e1c4-411c-b6d3-448b122e230b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:01:07.534184 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-e86841a1-e1c4-411c-b6d3-448b122e230b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:07.540480 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e86841a1-e1c4-411c-b6d3-448b122e230b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:07.540986 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e86841a1-e1c4-411c-b6d3-448b122e230b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:07.541416 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e86841a1-e1c4-411c-b6d3-448b122e230b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:07.542081 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e86841a1-e1c4-411c-b6d3-448b122e230b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:07.542521 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e86841a1-e1c4-411c-b6d3-448b122e230b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:07.542930 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-e86841a1-e1c4-411c-b6d3-448b122e230b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:07.719160 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-e86841a1-e1c4-411c-b6d3-448b122e230b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] HTTP exception thrown: Instance bf3647a6-a8fe-431c-856e-41b917f6f38d is not attached to volume 33d4bd87-8760-4400-9095-8208c2588c4e Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e86841a1-e1c4-411c-b6d3-448b122e230b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Request method failure captured: Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: DELETE /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/os-volume_attachments/33d4bd87-8760-4400-9095-8208c2588c4e HTTP/1.1 Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEojOfZ3cnWwyLaNdEuqpTHqAUbTxGH1KiDt_ok9uiuwEExFfcxt3MqkhUr7md9dSn54XIgJvzrc1OWvCe5YjFroD5ZWR8hZhggxUOn28hpALxh1BwV5pkh9-_U9YreHrFGj3GQtG2vmwsKBLXC-hxMoulZ1dCe7RFgFS9C1P0l7gDM Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: dab3698f589b4c9d9f1c363e19a15091 Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-TestMinimumBasicScenario-1525021050 Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 06:01:07.721478 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 06:01:07.722869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dab3698f589b4c9d9f1c363e19a15091", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dab3698f589b4c9d9f1c363e19a15091"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dab3698f589b4c9d9f1c363e19a15091"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dab3698f589b4c9d9f1c363e19a15091"}]}] Sep 01 06:01:07.722869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-TestMinimumBasicScenario-1525021050 Sep 01 06:01:07.722869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: dab3698f589b4c9d9f1c363e19a15091 Sep 01 06:01:07.722869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1525021050 Sep 01 06:01:07.722869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-TestMinimumBasicScenario-1525021050-project Sep 01 06:01:07.722869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 06:01:07.722869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 06:01:07.722869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 06c821e445744c7fb2add093f1a65f6a Sep 01 06:01:07.722869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-TestMinimumBasicScenario-1525021050-project Sep 01 06:01:07.722869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 06:01:07.722869 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance bf3647a6-a8fe-431c-856e-41b917f6f38d is not attached to volume 33d4bd87-8760-4400-9095-8208c2588c4e Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'server_id': 'bf3647a6-a8fe-431c-856e-41b917f6f38d', 'id': '33d4bd87-8760-4400-9095-8208c2588c4e'} Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 33d4bd87-8760-4400-9095-8208c2588c4e. Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:01:07.723634 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3647a6-a8fe-431c-856e-41b917f6f38d is not attached to volume 33d4bd87-8760-4400-9095-8208c2588c4e Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3647a6-a8fe-431c-856e-41b917f6f38d is not attached to volume 33d4bd87-8760-4400-9095-8208c2588c4e Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 06:01:07.724912 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-e86841a1-e1c4-411c-b6d3-448b122e230b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Returning 404 to user: Instance bf3647a6-a8fe-431c-856e-41b917f6f38d is not attached to volume 33d4bd87-8760-4400-9095-8208c2588c4e {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:01:07.725722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-e86841a1-e1c4-411c-b6d3-448b122e230b tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/os-volume_attachments/33d4bd87-8760-4400-9095-8208c2588c4e" status: 404 len: 154 microversion: 2.1 time: 0.193208 Sep 01 06:01:07.725722 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1411/2904] 10.222.0.49 () {58 vars in 1416 bytes} [Thu Sep 1 06:01:07 2022] DELETE /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d/os-volume_attachments/33d4bd87-8760-4400-9095-8208c2588c4e => generated 154 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:01:08.865020 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-8e69e910-75fc-4dc8-99a5-b109b43eefc5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:01:08.865529 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8e69e910-75fc-4dc8-99a5-b109b43eefc5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:08.872337 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e69e910-75fc-4dc8-99a5-b109b43eefc5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:08.872844 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e69e910-75fc-4dc8-99a5-b109b43eefc5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:08.873275 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e69e910-75fc-4dc8-99a5-b109b43eefc5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:08.873949 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e69e910-75fc-4dc8-99a5-b109b43eefc5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:08.874391 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e69e910-75fc-4dc8-99a5-b109b43eefc5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:08.874805 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-8e69e910-75fc-4dc8-99a5-b109b43eefc5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:08.899923 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-8e69e910-75fc-4dc8-99a5-b109b43eefc5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Going to try to terminate instance {{(pid=120673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 06:01:08.976508 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-8e69e910-75fc-4dc8-99a5-b109b43eefc5 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 204 len: 0 microversion: 2.1 time: 0.115023 Sep 01 06:01:08.977324 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1494/2905] 10.222.0.49 () {58 vars in 1239 bytes} [Thu Sep 1 06:01:08 2022] DELETE /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 06:01:08.987034 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-77d96aeb-fcb4-4e04-bfac-9104ceec0ee6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:01:08.987650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-77d96aeb-fcb4-4e04-bfac-9104ceec0ee6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:08.994021 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77d96aeb-fcb4-4e04-bfac-9104ceec0ee6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:08.994489 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77d96aeb-fcb4-4e04-bfac-9104ceec0ee6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:08.994910 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77d96aeb-fcb4-4e04-bfac-9104ceec0ee6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:08.995574 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77d96aeb-fcb4-4e04-bfac-9104ceec0ee6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:08.996016 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77d96aeb-fcb4-4e04-bfac-9104ceec0ee6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:08.997033 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-77d96aeb-fcb4-4e04-bfac-9104ceec0ee6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:09.129131 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.policy [None req-77d96aeb-fcb4-4e04-bfac-9104ceec0ee6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:01:09.136708 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-77d96aeb-fcb4-4e04-bfac-9104ceec0ee6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1552 microversion: 2.1 time: 0.154110 Sep 01 06:01:09.137958 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1412/2906] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:01:08 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:01:10.160134 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-685b3c13-33e3-416b-a16d-127cd8e5c1f6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:01:10.160742 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-685b3c13-33e3-416b-a16d-127cd8e5c1f6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:10.167057 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-685b3c13-33e3-416b-a16d-127cd8e5c1f6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:10.167524 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-685b3c13-33e3-416b-a16d-127cd8e5c1f6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:10.167947 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-685b3c13-33e3-416b-a16d-127cd8e5c1f6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:10.168741 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-685b3c13-33e3-416b-a16d-127cd8e5c1f6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:10.169417 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-685b3c13-33e3-416b-a16d-127cd8e5c1f6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:10.169835 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-685b3c13-33e3-416b-a16d-127cd8e5c1f6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:10.296895 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-685b3c13-33e3-416b-a16d-127cd8e5c1f6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:01:10.304490 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-685b3c13-33e3-416b-a16d-127cd8e5c1f6 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1552 microversion: 2.1 time: 0.148728 Sep 01 06:01:10.305078 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1495/2907] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:01:10 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:01:11.076468 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [req-c9076633-7ba5-4c93-a833-a67f9a1e72b6 req-b142eb42-be06-4f99-b091-4f085a839893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3647a6-a8fe-431c-856e-41b917f6f38d", "name": "network-vif-deleted", "tag": "31768c0b-a2dd-4a90-9b84-3ad99986f353"}]} {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:01:11.083498 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:01:11.083658 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Thu Sep 1 06:01:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.49) !!! Sep 01 06:01:11.091439 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-c9076633-7ba5-4c93-a833-a67f9a1e72b6 req-b142eb42-be06-4f99-b091-4f085a839893 service nova] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:11.091917 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-c9076633-7ba5-4c93-a833-a67f9a1e72b6 req-b142eb42-be06-4f99-b091-4f085a839893 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:11.092346 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [req-c9076633-7ba5-4c93-a833-a67f9a1e72b6 req-b142eb42-be06-4f99-b091-4f085a839893 service nova] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:11.103816 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.compute.server_external_events [req-c9076633-7ba5-4c93-a833-a67f9a1e72b6 req-b142eb42-be06-4f99-b091-4f085a839893 service nova] Creating event network-vif-deleted:31768c0b-a2dd-4a90-9b84-3ad99986f353 for instance bf3647a6-a8fe-431c-856e-41b917f6f38d on hv-cinder-85391 Sep 01 06:01:11.108933 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [req-c9076633-7ba5-4c93-a833-a67f9a1e72b6 req-b142eb42-be06-4f99-b091-4f085a839893 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037054 Sep 01 06:01:11.109526 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1413/2908] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Sep 1 06:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:01:11.327853 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:01:11.328377 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.compute.api [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:11.334961 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:11.335439 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:11.335869 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:11.336563 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:11.337027 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:11.337442 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:11.372456 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:11.372979 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:11.373412 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG oslo_concurrency.lockutils [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:11.373867 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.objects.instance [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lazy-loading 'fault' on Instance uuid bf3647a6-a8fe-431c-856e-41b917f6f38d {{(pid=120673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 06:01:11.417945 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.policy [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c821e445744c7fb2add093f1a65f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3698f589b4c9d9f1c363e19a15091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:01:11.427896 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-04ed68b8-2e79-47ec-a6e6-3e260a504fb1 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 200 len: 1347 microversion: 2.1 time: 0.104977 Sep 01 06:01:11.428478 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1496/2909] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:01:11 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 1347 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:01:12.450848 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-06463e0f-7bfb-4cf8-8275-438b15840693 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '>' {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:01:12.451542 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.compute.api [None req-06463e0f-7bfb-4cf8-8275-438b15840693 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] [instance: bf3647a6-a8fe-431c-856e-41b917f6f38d] Fetching instance by UUID {{(pid=120674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:12.457609 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06463e0f-7bfb-4cf8-8275-438b15840693 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:12.458111 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06463e0f-7bfb-4cf8-8275-438b15840693 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:12.458538 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06463e0f-7bfb-4cf8-8275-438b15840693 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:12.459208 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06463e0f-7bfb-4cf8-8275-438b15840693 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Acquiring lock "1a090075-45e2-480a-a3b7-44373d134320" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:12.459650 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06463e0f-7bfb-4cf8-8275-438b15840693 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:12.460068 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG oslo_concurrency.lockutils [None req-06463e0f-7bfb-4cf8-8275-438b15840693 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Lock "1a090075-45e2-480a-a3b7-44373d134320" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:12.473669 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.wsgi [None req-06463e0f-7bfb-4cf8-8275-438b15840693 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] HTTP exception thrown: Instance bf3647a6-a8fe-431c-856e-41b917f6f38d could not be found. Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-06463e0f-7bfb-4cf8-8275-438b15840693 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Request method failure captured: Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: request: GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d HTTP/1.1 Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept: application/json Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Accept-Encoding: identity Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Connection: close Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Length: 0 Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Content-Type: application/json Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Host: 10.222.0.49 Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: Openstack-System-Scope: None Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: User-Agent: python-urllib3/1.26.12 Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Auth-Token: gAAAAABjEEojOfZ3cnWwyLaNdEuqpTHqAUbTxGH1KiDt_ok9uiuwEExFfcxt3MqkhUr7md9dSn54XIgJvzrc1OWvCe5YjFroD5ZWR8hZhggxUOn28hpALxh1BwV5pkh9-_U9YreHrFGj3GQtG2vmwsKBLXC-hxMoulZ1dCe7RFgFS9C1P0l7gDM Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Id: None Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Domain-Name: None Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Identity-Status: Confirmed Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Is-Admin-Project: True Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Id: default Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Domain-Name: Default Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Id: dab3698f589b4c9d9f1c363e19a15091 Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Project-Name: tempest-TestMinimumBasicScenario-1525021050 Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Role: member,reader Sep 01 06:01:12.475296 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Roles: member,reader Sep 01 06:01:12.476676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dab3698f589b4c9d9f1c363e19a15091", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dab3698f589b4c9d9f1c363e19a15091"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dab3698f589b4c9d9f1c363e19a15091"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dab3698f589b4c9d9f1c363e19a15091"}]}] Sep 01 06:01:12.476676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant: tempest-TestMinimumBasicScenario-1525021050 Sep 01 06:01:12.476676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Id: dab3698f589b4c9d9f1c363e19a15091 Sep 01 06:01:12.476676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1525021050 Sep 01 06:01:12.476676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User: tempest-TestMinimumBasicScenario-1525021050-project Sep 01 06:01:12.476676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Id: default Sep 01 06:01:12.476676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Domain-Name: Default Sep 01 06:01:12.476676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Id: 06c821e445744c7fb2add093f1a65f6a Sep 01 06:01:12.476676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: X-User-Name: tempest-TestMinimumBasicScenario-1525021050-project Sep 01 06:01:12.476676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: method: > Sep 01 06:01:12.476676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: exception: Instance bf3647a6-a8fe-431c-856e-41b917f6f38d could not be found. Sep 01 06:01:12.476676 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: action_args: {'id': 'bf3647a6-a8fe-431c-856e-41b917f6f38d'} Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: {{(pid=120674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3647a6-a8fe-431c-856e-41b917f6f38d could not be found. Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:01:12.477496 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3647a6-a8fe-431c-856e-41b917f6f38d could not be found. Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3647a6-a8fe-431c-856e-41b917f6f38d could not be found. Sep 01 06:01:12.478794 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: ERROR nova.api.openstack.wsgi Sep 01 06:01:12.480087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: DEBUG nova.api.openstack.wsgi [None req-06463e0f-7bfb-4cf8-8275-438b15840693 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Returning 404 to user: Instance bf3647a6-a8fe-431c-856e-41b917f6f38d could not be found. {{(pid=120674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:01:12.480087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: INFO nova.api.openstack.requestlog [None req-06463e0f-7bfb-4cf8-8275-438b15840693 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d" status: 404 len: 111 microversion: 2.1 time: 0.031128 Sep 01 06:01:12.480087 dv-cinder-853910-6-iscsi devstack@n-api.service[120674]: [pid: 120674|app: 0|req: 1414/2910] 10.222.0.49 () {58 vars in 1236 bytes} [Thu Sep 1 06:01:12 2022] GET /compute/v2.1/servers/bf3647a6-a8fe-431c-856e-41b917f6f38d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:01:12.485366 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: DEBUG nova.api.openstack.wsgi [None req-453acaef-727b-4097-993a-55f5641e7229 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] Calling method '.version_select at 0x7f9628404ca0>' {{(pid=120673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:01:12.505877 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: INFO nova.api.openstack.requestlog [None req-453acaef-727b-4097-993a-55f5641e7229 tempest-TestMinimumBasicScenario-1525021050 tempest-TestMinimumBasicScenario-1525021050-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-203703004" status: 202 len: 0 microversion: 2.1 time: 0.024255 Sep 01 06:01:12.506444 dv-cinder-853910-6-iscsi devstack@n-api.service[120673]: [pid: 120673|app: 0|req: 1497/2911] 10.222.0.49 () {58 vars in 1269 bytes} [Thu Sep 1 06:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-203703004 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)